2025 Kafka Connectors and Client Drivers

Question 1

What versions of Kafka does the Snowflake Kafka Connector support?

Answer 1

Confluent and the open-source version

Question 2

What are the two variant columns are present in a table loaded by a Kafka connector?

Answer 2

Record_Content and Record_Metadata

Question 3

If the user adds addiontional columns to a a standard Kafka table, what do those columns need to be able to support?

Answer 3

Null Values

Question 4

What is the format of the Kafka message?

Answer 4

JSON/AVRO

Question 5

What metada can be found in RECORD_METADATA

Answer 5

Topic: Kafka topic Name
Partition: Number of the partition within the topic
Offset: Partition offset
CreateTime/LogAppendTime: Timestamp of the message in the Kafka Topic
Key: The key for Kafka KeyedMessage
Schema_id: Schema’s ID in the registry
Headers: User-defined Key-value pair

Question 6

The costs associated with the Kafka connector are

Answer 6

Snowpipe processing time and data storage

Question 7

What is the default retention time for Kafka topics

Answer 7

7 days

Question 8

When configuring Kafka Connect Cluster, what is the minimum recommended amount of RAM

Answer 8

5 MB per Kafka partition

Question 9

How are Kafka messages organized in Snowflake Objects

Answer 9

For each topic, the connector establishes an internal stage to temporarily hold the data files, a pipe for ingesting files for each topic partition, and a table dedicated to that topic.

Question 10

If the designated table for a Kafka topic doesn’t exist, what happens

Answer 10

The connector will create it

Question 11

What privileges does a role need to be used by a Kafka connector

Answer 11

Usage on a database
Usage on schema
Create tables in schema
create stages in schema
create pipes in schema