Kinesis 101

Question 1

What is Amazon Kinesis

Answer 1

Kinesis is platform to send your streaming data to. Kinesis makes it easy to load and analyze streaming data and also providing the ability for you to build your own custom applications to build your business needs

Amazon Kinesis Data Firehose is the easiest way to load streaming data into data stores and analytics tools. It can capture, transform, and load streaming data into Amazon S3, Amazon Redshift, Amazon Elasticsearch Service, and Splunk, enabling near real-time analytics with existing business intelligence tools and dashboards you’re already using today.

Question 2

Different types of Kinesis

Answer 2

Kinesis Streams
Kinesis Firehose
Kinesis Analytics

Question 3

Kinesis Streams

Answer 3

Kinesis streams allows you to store your day by default 24 hrs with a maximum retention of 7 days in Kinesis Shards while your data consumers go and do something with that data and store the data service like dynamo db or s3 or EMR or Redshift

Question 4

what are shards

Answer 4

Kinesis stream consists of shards. 5 tps for reads up to maximum total data read rate of 2 MB per second and up to 1,000 records per second for writes, up to maximum total data write rate of 1 MB per second(including partition keys) — OKKKK

Question 5

Total capacity of Kinesis stream

Answer 5

The data capacity of your stream is the function of number of shards that you specify for the stream. Total capacity of the stream is sum of the capacities of your shards. -OKKK

Question 6

what is Kinesis Firehose

Answer 6

Kinesis firehose does not have a data persistence.. You have to have lambda or simlar to process the data as soon as they arrive and then send it to either s3 to redshift or to elastic search

Question 7

what is Kinesis Analytics

Answer 7

Kinesis Analytics reads and analyze the data either from Kinesis streams or from Firehose and saves the same in either s3 or Redshift or elastic seach cluster

Question 8

Key componets of Kinesis Data Firehose

Answer 8

Key components of Kinesis Data Firehose are: delivery streams, records of data and destinations

Question 9

Key componets of Kinesis Data Streams

Answer 9

Producers, shards and consumers are components of Kinesis Data Streams.