Kafka practice on Springboot

Highlight

4 main sections, 4/4 now

• 1. Kafka Producer

  Allow customized class to send topic.

• 2. Kafka Consumer

  Allow customized class to receive topic.

• 3. Kafka Streaming (including windows)

• Perform Transformations and Actions.

• Materialize the KTable.

• Transfer to other topic.

• Handover Topology management to spring and only need to configure the connection info in one place.

• 4. InteractiveQuery to Ktable

  Get the KafkaStreams by bean injection in Spring, refer to here.

Spark-streaming or Flink-streaming need cluster to submit jobs, will not make any attempt so far.

Before you deploy

• Prepare the kafka cluster, can follow the instruction here and run on the top of docker.
• Create the topics in yml in advance.

After you deploy

The producer and streaming-interactive-query modules are open on Swagger page once you start this project.

The incoming topics can be viewd on Kafdrop also.