Development (data processing, analytics and big data solutions)

Question 1

What service would you use to ANALYSE data using SQL?

Answer 1

Athena

Question 2

What service would allow you to COLLECT and PROCESS large amounts of data on the availability of flights to display to customers?

Answer 2

Kinesis Data Streams because it specializes in handling real-time streaming data

Question 3

You want to put some data in and search it.

What is a good option for this?

Answer 3

Opensearch

Question 4

If you hear “real time streaming of data” what’s usually the answer?

Answer 4

Kinesis because it takes that real time data and has it ready for us whenever we want to process it

Question 5

What would you use to write standard SQL queries on STREAMING DATA?

Answer 5

Kinesis Analytics is best for real time analytics on streaming data using SQL queries

Question 6

A supermarket wants to analyze real time data of users based on their clicks on the web page

What service should you use

Answer 6

Kinesis firehose because it can ingest the clickstream data and send it to an analytics service

Question 7

You have video camera door bell. You want to STORE the data for potential playback and for ML ANALYTICS

What is a good option?

Answer 7

Kinesis video streams

Question 8

You want to LOAD a video and transform it into DIFFERENT FORMATS

What is a good option?

Answer 8

Elemental Media Services

Question 9

Name Amazon’s version of zoom?

Answer 9

Chime

Question 10

You want to LOAD streaming data into Kinesis Analytics, S3, Redshift and Open Search

What should you use?

Answer 10

Kinesis firehose because it can do it 1 step

If you used streams you would need to add a lambda function or something

Question 11

What would you do to keep a strong performance if shards are hot?

Answer 11

Split the shards

Question 12

5MB ingest and 40MB read

What is the min number of shards it needs

Answer 12

20 shards

because 1 write, 2 read

so

5/1 for write
40/2 for read

Question 13

What can you use to simplify data integration and ETL (Extract, Transform, Load) processes

Answer 13

Glue

Glue simplifies data integration and ETL processes by automatically cataloging, cleaning, and transforming data

Question 14

Name the 3 steps for processing real time data using Kinesis?

Answer 14

Data (temp sensors/click stream data/load sale info gather & batch so we can process in real time) → Kinesis → Compute (ec2 cluster, lambdas etc)

Question 15

Name 2 benefits of Kinesis?

Answer 15

Duarability
Scalability

Question 16

What is a shard?

Answer 16

A shard is the capacity of the data stream

Question 17

When would you re-shard?

Answer 17

You would re-shard (increase the num of shards) when the data rate increases

Question 18

Does the number of shards directly impact its ability to process incoming data?

Answer 18

Yes

Question 19

Name 8 ways Kinesis policies can be implemented?

Answer 19

• IAM policies (users, roles or groups)
• Resource based policies
• Fine grained access control (ie., tags)
• Kinesis Data Streams Access Control
• Amazon CloudWatch Metrics and Alarms
• Cross-Account Access
• Integration with AWS Organizations
• Key Rotation and Encryption Policies

Question 20

Name 4 types of Kinesis

Answer 20

Kinesis streams
Kinesis video
Kinesis analytics
Kinesis firehouse

Question 21

You need to perform log analysis.

What would you use?

Answer 21

Opensearch because its used for full-text search & analytics

It is suitable for building search engines, log analysis and monitoring solutions

Question 22

What service would you use if you want to LOAD live stream data into REDSHIFT

Answer 22

Kinesis Data Firehose because it simplifies the process of capturing and loading data into data stores like Redshift by automatically handling the data delivery and ensuring that it is efficiently and reliably loaded for analysis.

Question 23

What is the difference between Athena and Aurora?

Answer 23

Athena is a serverless query service for s3

Aurora is a relational database service

Question 24

Name the 4 types of Kinesis:

Answer 24

1. Kinesis Data Streams: Collects and processes large streams of data records in real time.
2. Kinesis Data Firehose: Loads streaming data into AWS data stores for near real-time analytics.
3. Kinesis Data Analytics: Processes streaming data using SQL for real-time insights.
4. Kinesis Video Streams: Securely streams video from connected devices to AWS for analysis and processing.