NIFI-14367 Removed casting to BufferedInputStream in PublishKafka

[sammu97]

• This PR aims to fix issues arising when the Kafka Publisher process attempts to infer a schema from a Json Payload greater than 1 MB. This is because the mark() limit set on the current input stream is statically set at 1000000. This fix removes to casting of the Input Stream to a Buffer Input Stream, thus omitting the dependency on the mark() function.

Summary

NIFI-14367

Tracking

Please complete the following tracking steps prior to pull request creation.

Issue Tracking

• Apache NiFi Jira issue created

Pull Request Tracking

• Pull Request title starts with Apache NiFi Jira issue number, such as NIFI-00000
• Pull Request commit message starts with Apache NiFi Jira issue number, as such NIFI-00000

Pull Request Formatting

• Pull Request based on current revision of the main branch
• Pull Request refers to a feature branch with one commit containing changes

Verification

Please indicate the verification steps performed prior to pull request creation.

Build

• Build completed using mvn clean install -P contrib-check
  • JDK 21

Licensing

• New dependencies are compatible with the Apache License 2.0 according to the License Policy
• New dependencies are documented in applicable LICENSE and NOTICE files

Documentation

• Documentation formatting appears as expected in rendered files

[pvillard31]

Thanks for the change @sammu97 - would you mind adding a unit test or integration test to confirm the change / fix?

[sammu97]

Hi @pvillard31 , sure will do. Will need to give some thought about how to best go about testing this.

[sammu97]

Hi @pvillard31 , I've added 2 tests for the KafkaRecordConverter, however am finding it difficult to mock a RecordStreamKafkaRecordConverter and RecordWrapperStreamKafkaRecordConverter due to the RecordSetWriterFactory and RecordReaderFactory objects needed. Would appreciate some guidance here

[sammu97]

Hi @pvillard31 , I have added further tests for all KafkaRecordConverter classes, let me know what you think.

[pvillard31]

Hi @sammu97 - thanks for adding the tests! I did a larger refactor of the Kafka components in this PR #9807 and I retained your commit that is adding the tests to confirm that it's working with the refactored approach.

[sammu97]

Great @pvillard31 , thank you and looking forward to having this released 😄