README.md

tags
Kafka

#Kafka

• Tools

• Problems

• Links

• Certification

Kafka Visualisation

Kafka Deep Dive

Tools

akhq.io

Kafka GUI for Apache Kafka ® to manage topics, topics data, consumers group, schema registry, connect and more...

#Problem

Poison Pill

What is a poison pill?

https://stephantromer.dev/blog/how-to-handle-poison-pills-in-kafka

Links #Link

https://kafka.apache.org/quickstart

Kafka Documentation

Kafka Download

Kafka for M1(kymeric/cp-kafka)

kafkacat

https://docs.confluent.io/platform/current/app-development/kafkacat-usage.html

Conductor

Certification

Certification

https://codingnconcepts.com/post/apache-kafka-ccdak-exam-notes/

Scripts

Topics:

Topic Options

Create a topic only if a topic with the same name doesn't exist:

bin/kafka-topics.sh --zookeeper zookeeper1:2181/kafka --create --topic test_topic --replication-factor 2 --partitions 2 --if-not-exists

List the topics:

bin/kafka-topics.sh --zookeeper zookeeper1:2181/kafka --list

Describe the topic:

bin/kafka-topics.sh --zookeeper zookeeper1:2181/kafka --topic test_topic --describe

Alter the number of partitions:

bin/kafka-topics.sh --zookeeper zookeeper1:2181/kafka --alter --topic test_topic --partitions 3

Delete a topic:

bin/kafka-topics.sh --zookeeper zookeeper1:2181/kafka --delete --topic test_topic

Create a topic with more replications than available brokers:

bin/kafka-topics.sh --zookeeper zookeeper1:2181/kafka --create --topic test_topic --replication-factor 4 --partitions 2

Dump the log segments:

bin/kafka-run-class.sh kafka.tools.DumpLogSegments --print-data-log --files /data/kafka/topic-1-0/00000000000000000001.log

Rotate the logs:

bin/kafka-configs.sh --zookeeper zookeeper1:2181/kafka --alter --entity-type topics --entity-name topic-1 --add-config segment.ms=60000