Kafka Java

Question 1

Configure the security protocol

Answer 1

props.put(CommonClientConfigs.SECURITY_PROTOCOL_CONFIG, “SSL”);

Question 2

Configure the path to the truststore file

Answer 2

props.put( SslConfigs.SSL_TRUSTSTORE_LOCATION_CONFIG, );

Question 3

Configure the truststore password

Answer 3

props.put(SslConfigs.SSL_TRUSTSTORE_PASSWORD_CONFIG, “password”);

Question 4

Configure bootstrap server

Answer 4

props.put(
ConsumerConfig.BOOTSTRAP_SERVERS_CONFIG,
“YOUR_KAFKA_BOOTSTRAP_HOST:YOUR_KAFKA_BOOTSTRAP_PORT”
);

Question 5

set the consumer group ID

Answer 5

props.put(
ConsumerConfig.GROUP_ID_CONFIG,
“reportingSystem”
);

Question 6

set the key deserializer

Answer 6

props.put(
ConsumerConfig.KEY_DESERIALIZER_CLASS_CONFIG,
“org.apache.kafka.common.serialization.StringDeserializer”
);

Question 7

set the value deserializer

Answer 7

props.put(
ConsumerConfig.VALUE_DESERIALIZER_CLASS_CONFIG,
“org.apache.kafka.common.serialization.IntegerDeserializer”
);

Question 8

set the offset reset config

Answer 8

props.put(
ConsumerConfig.AUTO_OFFSET_RESET_CONFIG,
“earliest”
);

Question 9

Initialize Kafka consumer

Answer 9

Consumer consumer = new KafkaConsumer<>(configureProperties());

Question 10

Consume events from kafka consumer

Answer 10

while (true) {
ConsumerRecords records = consumer.poll(Duration.ofSeconds(10));

        for (ConsumerRecord record : records) {
            printRecord(record);

}

Question 11

Subscribe consumer on topi

Answer 11

consumer.subscribe(Collections.singletonList(“wind-turbine-production”));

Question 12

Initialize Kafka producer

Answer 12

Producer producer = new KafkaProducer<>(
configureProperties()
);

Question 13

Final producer instruction

Answer 13

producer.close();

Question 14

List consumer config properties

Answer 14

1) Bootstrap server
2) key deserializer
3) value deserializer
4) ssl location
5) security protocol
6) ssl password
7) group id

Question 15

Steps for consuming events

Answer 15

1) Build config
2) Setup kafka consumer client
3) Subscribe to topics
4) Reapreatedly poll.

Question 16

Topic creation YAML

Answer 16

apiVersion: kafka.strimzi.io/v1beta2
kind: KafkaTopic
metadata:
  name: call-detail-records
  labels:
    strimzi.io/cluster: my-cluster
spec:
  partitions: 12
  replicas: 2
  config:
    retention.ms: 604800000
    segment.bytes: 1073741824