Amazon Kinesis Family Flashcards
What is Amazon Kinesis?
The Amazon Kinesis Family makes it easier to collect, process, and analyze real-time, streaming data so that you can get timely insights and react quickly to new information.
Name 4 of the Kinesis families
- Data Streams
- Firehose
- Data Analytics
- Video Streams
What is Kinesis Data Streams?
Real time data steaming.
Collect and process large streams of data records in real time.
Amazon Kinesis Data Streams is a massively scalable and durable real-time data streaming service. Kinesis Data Streams is designed to continuously capture gigabytes of data per second from hundreds of thousands of sources, such as website clickstreams, database event streams, financial transactions, social media feeds, IT logs, and location-tracking events.
What is Kinesis Firehose?
Data delivery service.
Amazon Kinesis Data Firehose is designed to reliably load streaming data into data lakes, data stores, and analytics services. It can capture, transform, and deliver streaming data to Amazon Simple Storage Service (Amazon S3), Amazon Redshift, Amazon Elasticsearch Service, generic HTTP endpoints, and service providers like Datadog, New Relic, MongoDB, and Splunk.
What is Kinesis Data Analytics
Real time data analytics
Amazon Kinesis Data Analytics is designed to transform and analyze streaming data in real time with Apache Flink. Apache Flink is an open-source framework and engine for processing data streams. Amazon Kinesis Data Analytics reduces the complexity of building, managing, and integrating Apache Flink applications with other AWS services. Amazon Kinesis Data Analytics is designed to take care of everything that’s required to run streaming applications continuously
What is Kinesis Video Streams?
Stream video data.
Amazon Kinesis Video Streams is designed to securely stream video from connected devices to AWS for analytics, machine learning (ML), playback, and other forms of processing. Kinesis Video Streams automatically provisions and elastically scales the infrastructure that’s needed to ingest streaming video data from millions of devices.
Stream vs Analytics
Use “Kinesis Data Streams” (streaming) when you need to rapidly ingest and move large volumes of real-time data from various sources, while “Kinesis Data Analytics” is best when you want to perform actual analysis on that streaming data using SQL-like queries or more complex Apache Flink applications for real-time insights and actions, essentially processing the data as it flows through the stream; think of streaming as the data pipeline and analytics as the processing engine on top of it