Kafka CLI

Question 1

What is the purpose of the kafka-topics.sh CLI script?

Answer 1

To manage Kafka topics, such as creating, deleting, listing, or describing them.

Question 2

What type of properties does playground.config typically contain?

Answer 2

Connection properties, such as authentication and security settings.

Question 3

What is the function of the -bootstrap-server option?

Answer 3

Specifies the Kafka broker to connect to.

Question 4

What is the command to view all topics?

Answer 4

kafka-topics.sh –command-config playground.config –bootstrap-server cluster.playground.cdkt.io:9092 –list

Question 5

How do you describe a specific topic?

Answer 5

Add the topic name and –describe to the kafka-topics.sh command.
kafka-topics.sh –command-config playground.config –botstrap-server cluster.playground.cdkt.io:9092 –topic first_topic –describe

Question 6

What is a replication factor in Kafka?

Answer 6

The number of copies of a partition that are maintained across different brokers.

Question 7

True or False: You can have a higher replication factor than the number of brokers available.

Answer 7

False.

Question 8

What command is used to delete a topic?

Answer 8

kafka-topics.sh –command-config playground.config –bootstrap-server cluster.playground.cdkt.io:9092 –topic second_topic –delete

Question 9

What is the purpose of the kafka-console-producer.sh command?

Answer 9

To produce data to a topic.

Question 10

What happens when you produce to a non-existing topic?

Answer 10

You will get an error unless the command is run in local Kafka, which will create a topic with default config. (replica= 1, partition=1), warning.

Question 11

Fill in the blank: The command to produce messages with keys is to use the property parse.key set to _______.

Answer 11

true

Question 12

What does the –property key.separator=: do?

Answer 12

It separates the key and value in produced messages.

Question 13

How do you consume messages from the tail of the topic?

Answer 13

kafka-console-consumer.sh –consumer.config playground.config –botstrap-server cluster.playground.cdkt.io:9092 –topic second_topic

Question 14

What is the command to consume messages from the beginning of the topic?

Answer 14

Add –from-beginning to the kafka-console-consumer.sh command.

kafka-console-consumer.sh –consumer.config playground.config –botstrap-server cluster.playground.cdkt.io:9092 –topic second_topic –from-beginning

Question 15

What does the –group option do in the consumer command?

Answer 15

It specifies that the consumer is part of a consumer group.

Question 16

What happens if the same consumer group command is run again?

Answer 16

You won’t see any messages because one consumer in that group has already read them.

Question 17

What command is used to list consumer groups?

Answer 17

kafka-consumer-groups.sh –command-config playground.config –botstrap-server cluster.playground.cdkt.io:9092 –list

Question 18

What indicates that a consumer is caught up with the newest messages?

Answer 18

When the current-offset and log-end-offset are the same.

Question 19

What is (consumer) lag?

Answer 19

The difference between the current offset and the log end offset, indicating unread messages.

Question 20

What does the –dry-run option do when resetting offsets?

Answer 20

It shows what the assignment will be without executing it.

eg.
kafka-consumer-groups.sh –command-config playground.config –botstrap-server cluster.playground.cdkt.io:9092 –group my-first-application –reset-offsets –to-earliest –topic third_topic –dry-run

Question 21

What must be done to execute the reset offset command?

Answer 21

Switch out –dry-run with –execute and stop the consumer.

kafka-consumer-groups.sh –command-config playground.config –botstrap-server cluster.playground.cdkt.io:9092 –group my-first-application –reset-offsets –to-earliest –topic third_topic –execute

Question 22

true or false: kafka-console-consumer uses a random group id

Answer 22

true

Question 23

what flag do you have to use to override the group.id for kafka-console-consumer?
1. –group mygroup
2. –property group.id=mygroup

Answer 23

1. –group mygroup

You override by creating a consumer group

Question 24

What script to I use to perform operations on the consumer offsets?

Answer 24

kafka-consumer-groups