Producer and Consumer details

Question 1

What are the steps to create a producer in Java?

Answer 1

1. Create producer properties
2. Create the producer
3. Send data
4. Flush and close the producer

The flush method is called automatically when closing the producer.

Question 2

What properties are set for a Kafka producer?

Answer 2

1. key.serializer
2. value.serializer

Both are set using StringSerializer.class.getName()

Question 3

What does the producer.send() method do?

Answer 3

Sends data asynchronously to the Kafka topic.

Question 4

What is the purpose of the producer.flush() method?

Answer 4

To send all data and block until done.

Question 5

What is the default batch size for Kafka?

Answer 5

16kB.

Question 6

True or False: If the same key is sent to Kafka, it will always go to the same partition.

Answer 6

True.

Question 7

What are the initial steps to consume messages from Kafka with Java?

Answer 7

1. Connect to Kafka
2. Create consumer configs
3. Create a consumer
4. Subscribe to a topic
5. Poll for data

Question 8

What are the key properties set for a Kafka consumer?

Answer 8

1. key.deserializer
2. value.deserializer
3. group.id
4. auto.offset.reset

Example values include StringDeserializer.class.getName() and ‘earliest’ for auto.offset.reset.

Question 9

What are the three values for auto.offset.reset?

Answer 9

• none
• earliest
• latest

Question 10

What happens during a partition rebalance in Kafka?

Answer 10

Partitions are moved between consumers when a consumer leaves or joins a group.

Question 11

What is Eager Rebalance in Kafka?

Answer 11

All consumers stop polling and rejoin the group for new partition assignments.

Question 12

What is Cooperative Rebalance in Kafka?

Answer 12

Reassigns a small subset of partitions while allowing other consumers to continue processing.

Question 13

What are the strategies for partition assignment in Kafka?

Answer 13

• RangeAssignor
• RoundRobin
• StickyAssignor
• CooperativeStickyAssignor

Question 14

What does acks = 0 mean in Kafka producer settings?

Answer 14

Producer won’t wait for acknowledgement, leading to possible data loss.

Question 15

What does acks = 1 mean in Kafka producer settings?

Answer 15

Producer waits for leader acknowledgement, allowing for limited data loss.

Question 16

What does acks = all (acks = -1) mean in Kafka producer settings?

Answer 16

Producer waits for acknowledgement from all in-sync replicas, ensuring no data loss.

Question 17

What is the purpose of min.insync.replicas in Kafka?

Answer 17

Controls the minimum number of replicas that must acknowledge a write for it to be considered successful.

Question 18

What is an Idempotent Producer in Kafka?

Answer 18

A producer that guarantees no duplicate messages on network errors.

Question 19

What is the default compression type for Kafka producers?

Answer 19

none

Question 20

What are the advantages of using compression in Kafka?

Answer 20

• Smaller producer request size
• Faster data transfer
• Better throughput
• Improved disk utilization

Question 21

What are the disadvantages of using compression in Kafka?

Answer 21

• Producers must commit CPU cycles to compression
• Consumers must commit CPU cycles to decompression

Question 22

What setting allows for increased batching in Kafka producers?

Answer 22

linger.ms.

Question 23

Fill in the blank: The rule ‘same key goes to the same partition’ is true unless the number of ______ changes.

Answer 23

partitions.