head.daveops.net

Snippets for yer computer needs

Kafka

Kafka

Created Monday 23 October 2017

by default listens on port 9092

broker properties

property desc
broker.id unique non-negative integer to be used as broker name
host.name hostname of the broker
num.partitions default number of partitions per topic
default.replication.factor default replication factor for topics
unclean.leader.election.enable choose between consistency and availability in event of an unclean leader election

kafka-topics

arg desc
–create TOPIC create a topic
–delete TOPIC delete a topic
–alter TOPIC alter partitions / replica assignment / configuration for a topic
–list list the topics
–partitions NUM number of partitions for the topic being altered
–zookeeper URLS connection string for zookeeper connection (host:port)
–topic TOPIC The topic to be created/deleted/altered
–replication-factor NUM The replication factor for each partition in the topic being created

kafka-console-producer

kafka-console-producer --broker-list localhost:9092 --topic TOPIC

kafka-console-consumer

kafka-console-consumer --zookeeper localhost:2181 --topic kafkatopic --from-beginning