Kinesis Flashcards
Amazon ____ data streams enables you to build custom apps that process or analyze streaming data for specialized needs. ____ data streams can continuously capture and store “TB” of data per hour from hundreds of thousands of sources such as websites, clickstreams, financial transactions, social media feeds, IT logs, and location trakcing events.
kinesis
kinesis
Kinesis:
Launched in Nov ___
Programs attached to streams to process and direct ___
typically light processing due to transfer ____
2013
data
volumes
Kinesis stream shards
data recived by _____
Ingest:
____ tx/second
____ mb/second
output:
____ records/second
____ mb/second
shards
5
2
1000
1
Shards
- total capacity of stream is based on ____ of shards
- data stored in stream: ___ hours default, ___ days max
- shards can be ___ and ____ to manage traffic flow
number
24; 7
dicided; combined
Amazon Kinesis data _____ is the easiest way to load streaming data into data stores and analytics tools. It can capture and transform and load streaming data into S3, redshift, elastisearch service, and splunk, enabling near real-time analytics with existing business intelligence tools and dashboards you are already using today.
Launched in Oct ____
Think real-time ____
massive ___ ingestion
firehose
2015
ETL
data
Kinesis analytics
-Kinesis data analytics is the easiest way to process streaming ___ in real time with standard SQL without having to learn new programming languages or processing frameworks. it enables you to ___ streaming data or build entire streaming apps using SQL, so that you can gain or actionable insights and respond to your business and customer needs promptly.
data
query
Kinesis data analytics takes care of everything required to run your queries continuously and scales automatically to match the ____ and ____ rate of your incomgin data.
with kinesis data analytics, you only pay for the resources your ____ consume. There is no minimum fee or setup cost.
Launched in AUg ___
____ from streams or firehose
recognized common ___ formats
suggests ____
runs ____ against data streams continuously
passes results to other storage, programs, or ____
volume and throughput
queries
2016
reads
data
schema
quieries
messaging
Kinesis video streams
machine learning for ___ streams
streams stored in ____
use cases: ___ time license plate reading
retail foot ____ flow
further machine learning to identify trends, predictive ______
video
s3
real
traffic
analytics
Kinesis Pricing
Varies per ____
combo of:
amount of ___ ingested
amount of “underneath” ___ use
____ stored
service
data
instance
data
data pipeline:
-pick one: (aws managed or cust managed) service
ETL = ___
pre-populated library of common ____
allows scheduled ____
____ handling
use case: placing ___ file entries into EMR
pricing $____ - $____ /execution, other resources charged at their rates
aws managed
extract, transform, load
transformations
executions
error
log
$.60-$3.00