Data Analytics - Collection

Question 1

What are the three types of collection?

Answer 1

Real Time (immediate actions)
Near Real Time (reactive actions)
Batch (historical analysis)

Question 2

What services can be used for real time data collection?

Answer 2

Kinesis Data Streams (KDS)
Simple Queue Service (SQS)
Internet of Things (IoT)

Question 3

What services can be used for near real time data collection?

Answer 3

Kinesis Data Firehose (KDF)
Database Migration Service (DMS)

Question 4

What services can be used for batch data collection?

Answer 4

Snowball
Data Pipeline

Question 5

Kinesis data streams are made up of _________

Answer 5

Shards

Question 6

What are the two parts of an incoming record in kinesis data streams?

Answer 6

Partition key
Data blob

Question 7

How large is a data blob in kinesis data streams?

Answer 7

Up to 1MB

Question 8

Who sends the record to kinesis data streams?

Answer 8

Producers

Question 9

What speed can records be transferred into kinesis data streams?

Answer 9

1 MB/sec OR 1000 msg/sec PER SHARD

Question 10

Who consumes the data from kinesis data streams?

Answer 10

Consumers

Question 11

What are the three parts of an outgoing record in kinesis data streams?

Answer 11

Partition key
Sequence No
Data blob

Question 12

What speed can records be consumed from kinesis data streams?

Answer 12

2 MB/sec (shared) Per shard all consumers
2 MB/sec (enhanced) Per shard per consumer

Question 13

What is the retention in kinesis data streams?

Answer 13

Between 1 day to 365 days

Question 14

Kinesis data streams can replay / reprocess data (T/F)

Answer 14

True

Question 15

Once data is inserted in kinesis data streams, it can be deleted (T/F)

Answer 15

False

Question 16

Which producers can use kinesis data streams?

Answer 16

AWS SDK
Kinesis Producer Library (KPL)
Kinesis Agent

Question 17

Which consumers can use kinesis data streams?

Answer 17

Write your own (Kinesis Client Library KCL, AWS SDK)
Managed (AWS Lambda, Kinesis Data Firehose, Kinesis Data Analytics)

Question 18

Which mode of kinesis data streams should be used if the user knows their capacity in advance?

Answer 18

Provisioned mode