feat: Migrate from IRV1 to KV-IR serializer.

[davemarco]

Description

This PR switches the serializer to KV-IR and drops support for the legacy IRV1 serializer.

KV-IR Serialization

This PR updates dependencies to use the new KV-IR serializer. The new serializer has a different API than the previous IRV1 serializer. The API change results in minor changes to the disk and memory writers.

JSON Parser Requirements

The KV-IR serializer requires logs to be parsed using Fluent Bit’s JSON parser. If logs are not JSON-parsed, the entire log will appear as a single string under the log key. The documentation has been updated to describe this requirement.

Autogenerated Keys

Autogenerated keys are not supported in this PR. Support for autogenerated keys will be added in a future PR.

Checklist

• The PR satisfies the contribution guidelines.
• This is a breaking change and that has been indicated in the PR title, OR this isn't a
  breaking change.
• Necessary docs have been updated, OR no docs need to be updated.

Validation performed

JSON logs were sent to S3 using both the disk writer and the memory writer. The resulting files were opened in the log viewer, and the contents appeared correct.

[coderabbitai]

Important

Review skipped

Auto reviews are disabled on base/target branches other than the default branch.

Please check the settings in the CodeRabbit UI or the .coderabbit.yaml file in this repository. To trigger a single review, invoke the @coderabbitai review command.

You can disable this status message by setting the reviews.review_status to false in the CodeRabbit configuration file.

• 🔍 Trigger a full review

---

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

• X
• Mastodon
• Reddit
• LinkedIn

_{Comment @coderabbitai help to get the list of available commands and usage tips.}

[davidlion]

Pretty small comments, nice work. Let's also make the title a bit more verbose since currently it isn't clear what we're dropping / migrating from.

[davemarco]

I responded to ur comment in the original post

[davidlion]

Last fix: update this last part of the doc-string as discussed offline.

[davemarco]

updated