Domain 1: Collection Flashcards
Which Kinesis services offers asynchronous features and high throughput?
Kinesis Producer Library
Where must compression be implemented in Kinesis?
By the end user
How many GetRecords API calls are allowed per second by Kinesis streams in Classic mode?
5
What is the average latency in Kinesis Steams Enhanced Fan Out mode?
70ms
What is the throughput of Kinesis Consumer Classic mode?
2MB/sec
What are the 4 services that Kinesis Firehose can write to?
S3, Redshift, ElasticSearch, Slunk
Which protocol is not supported by IoT Device Gateway?
FTP
What is the minimum latency for Firehose with non full batches?
60 seconds
What data conversions are possible using Firehose with S3/
JSON to Parquet/ORC
What data transformations are possible using Firehose with Lambda?
CSV to JSON
What compression algorithms are supported by Firehose with S3?
GZIP, ZIP, SNAPPY
What compression algorithm is supported by Firehose with Redshift?
GZIP
How are you charged on Firehose?
Amount of data going through Firehose
Can Spark and KCL read from Firehose?
No
What is the minimum buffer time in Firehose?
60 seconds
Can resharding be done in parallel?
No
To how many AZs is data replicated in Kinesis Data Streams?
3
What is the default retention period in Kinesis Data Streams?
24 hours
Can data be deleted from Kinesis streams?
No
What is a key best practice with partition keys in Kinesis Streams?
Highly distributed keys
What is the maximum size of data blobs in Kinesis?
1MB
What are the throughput limits for Kinesis producers?
1MB/s or 1000 messages/s at write per shard
What happens if you exceed throughput limits on Kinesis producers?
Provisioned Throughput Exception
What are the throughput limits for Kinesis consumers in Classic mode?
2MB/s per shard across all consumers
5 API calls per second per shard across all consumers
What are the throughput limits for Kinesis consumers in EFO mode?
2MB/s per shard across per enhanced consumer
No API calls needed
Is Kinesis EFO a push or pull model?
Push
What are the use cases for Kinesis Producer SDK?
Low throughput, high latency, keep it simple, AWS Lambda
Can Kinesis Data Analytics produce back into Kinesis Data Streams?
Yes
What is the first troubleshooting step if you get a Provisioned Throughput Exception?
Check for hot shards (bad partition key)
How do you remediate a Provisioned Throughput exception?
- Retries with backoff
- Scale up your shards
- Improve partitions
What languages are available in Kinesis Producer Libraries?
C++ and Java
Which Kinesis producer should be used for asynchronous requirements (or more performant requirements)?
Kinesis Producer Libraries
Through what methods can Kinesis Producer Library records be de-coded?
Kinesis Client Library or special helper library (Lambda)
What configuration item can be used to adjust buffer times for KPL batches? What is the default configuration?
RecordMaxBufferedTime; 100 ms
Which Kinesis consumer option offers checkpointing using DynamoDB?
KCL (Client)
On what service must Kinesis Connector Libraries run?
EC2
What services can Kinesis Connector Libraries write to?
S3, DynamoDB, Elasticsearch, Redshift
Which two tools have mostly replaced the use case for Kinesis Connector Libraries?
Firehose and Lambda
What happens to the data in the old shard after it has been split or merged?
It will be deleted once the shard expires
Which protocols are supported by IoT Gateway?
MQTT, WebSockets, HTTP 1.1
What is IoT Message Broker?
Pub/Sub messaging tool, used for devices to communicate with each other
What is IoT Thing Registry?
IAM for IoT, supports metadata, creates X.509 certificates, provides IoT Groups
What are the three authentication methods for IoT Things?
X.509 certs, AWS SigV4, Custom tokens
What is the IoT Rules Engine rules defined?
On the MQTT topics
What is IoT Greengrass?
Allows compute (Lambda functions) to be executed on the IoT Thing itself.
