Define in zookeeper.properties
dataDir=D:/Hadoop/ECOSYSTEM/Kafka/zookeeper
Define in server.properties
log.dirs=D:/Hadoop/ECOSYSTEM/Kafka/logs
Start ZOOKEEPER
start zookeeper-server-start.bat config/zookeeper.properties
Start KAFKA
start kafka-server-start.bat config/server.properties
Create a TOPIC
kafka-topics.bat --create --zookeeper localhost:2181 --replication-factor 1 --partitions 1 --topic test
List TOPIC
kafka-topics.bat --list --zookeeper localhost:2181
Start a Producer (Send Messages)
kafka-console-producer.bat --broker-list localhost:9092 --topic test
This is a message
This is another message1
Start a Consumer (receives Messages)
kafka-console-consumer.bat --zookeeper localhost:2181 --topic test --from-beginning
This is a message
This is another message
Note:- If you have each of the above commands running in a different console
then you should now be able to type messages into the producer console and
see them appear in the consumer terminal.
Display Topic Information
kafka-topics.bat --describe --zookeeper localhost:2181 --topic test
Add Partitions to a Topic
kafka-topics.bat --alter --zookeeper localhost:2181 --topic test --partitions 3
WARNING: If partitions are increased for a topic that has a key, the partition logic or
ordering of the messages will be affected
Delete Topic
kafka-run-class.bat kafka.admin.DeleteTopicCommand --zookeeper localhost:2181 --topic test
Setting up a multi broker cluster
Create config/server2.properties
broker.id=1
port=9094
log.dir=log.dirs=D:/Hadoop/ECOSYSTEM/Kafka/logs1
start kafka-server-start.bat config/server2.properties
