Kinesis Flashcards
What is Kinesis?
Platform sending streaming data to other services
What is streaming data?
data generated continuously by thousands of data sources typically sned in the data records simultaneously and in small sizes
Examples of streaming data
Purchases form online stores
Stock Prices
Game data as gamer plays
Social network data
Geospatial data (uber)
ioT sensor data
How long does Kinesis store data?
Default 24hrs
But can be up to 7 days
Describe Kinesis Streams
Producer -> stream(shards) -> consumer -> AWS Service
Consumer is a fleet of SC2 instances that analyze data
Shard transaction per second erads
5 transactions per sec reads
Kinesis Firehouse
Producer -> firehouse -> S3 or ElasticSearch -> Redshift (optional)
no auto retention window
Kinesis Analytics
Producer -> Firehouse or Streams -> S3, Redshift, ElasticSearch Cluster
There can be SQL queries on data in firehouse or streams
Is kinesis poll or push based
Poll
How are you charged for Kinesis?
Hourly rate for each shard.
Max data 1 shard can process per second
1 MiB/sec
or
1000 records per sec for writes
Shard limit
500 for (us east, us west, and eu) others are 200