Decoupling applications: SQS, SNS, Kinesis, Active MQ

Question 1

AWS messaging service that creates queues which producers post messages to it and consumers poll messages from it

Answer 1

Amazon Simple Queue Service (SQS)

Question 2

This term describes the period where an SQS message will appear invisible to other consumers while one consumer is processing the message

Answer 2

SQS - Message Visibility Timeout

Question 3

This API can be called if a consumer needs more time to process a message from an SQS Queue

Answer 3

ChangeMessageVisibility

Question 4

If you want to manage the size of an ASG of consumers based on the number of messages in an SQS Queue, you can use this default CloudWatch metric

Answer 4

ApproximateNumberOfMessages

Question 5

A way to optimize the number of API calls made to an SQS queue that also decreases latency

Answer 5

Enabling Long Polling on SQS queues

Question 6

SQS Queue type to use if you need to preserve the order of the messages and eliminate duplicates

Answer 6

FIFO Queue

Question 7

Use case for an SQS queue that allows you to handle spikes in traffic that could be limited by database insertion throughput

Answer 7

SQS as a buffer to database writes

Question 8

AWS Messaging service that enables a pub/sub architecture

Answer 8

Simple Notification Service (SNS)

Question 9

What are the available protocols for a SNS subscription?

Answer 9

Amazon Kinesis Data Firehose, Amazon SQS, AWS Lambda, Email, Email-JSON, HTTP, HTTPS, SMS

Question 10

Serverless streaming data service that makes it easy to capture, process, and store data streams at any scale

Answer 10

Amazon Kinesis Data Streams

Question 11

What are the three AWS services that Kinesis Data Firehose can send data to?

Answer 11

AWS S3
AWS Redshift
AWS ElasticSearch

Question 12

A fully managed service for delivering real-time streaming data to destinations

Answer 12

Kinesis Data Firehose

Question 13

You have an SQS Queue where each consumer polls 10 messages at a time and finishes processing them in 1 minute. After a while, you noticed that the same SQS messages are received by different consumers resulting in your messages being processed more than once. What should you do to resolve this issue?

Answer 13

Increase the Visibility Timeout

Question 14

You have 3 different applications that you’d like to send them the same message. All 3 applications are using SQS. What is the best approach would you choose?

Answer 14

Use SNS + SQS Fan Out Pattern

Question 15

You have a Kinesis data stream with 6 shards provisioned. This data stream usually receiving 5 MB/s of data and sending out 8 MB/s. Occasionally, your traffic spikes up to 2x and you get a ProvisionedThroughputExceeded exception. What should you do to resolve the issue?

Answer 15

Add more Shards

Question 16

You have a website where you want to analyze clickstream data such as the sequence of clicks a user makes, the amount of time a user spends, and where the navigation begins and how it ends. You decided to use Amazon Kinesis, so you have configured the website to send these clickstream data all the way to a Kinesis data stream. While you checking the data sent to your Kinesis data stream, you found that the users’ data is not ordered and the data for one individual user is spread across many shards. How would you fix this problem?

Answer 16

For each record sent to Kinesis add a partition key that represents the identity of the user

Question 17

You are running an application that produces a large amount of real-time data that you want to load into S3 and Redshift. Also, these data need to be transformed before being delivered to their destination. What is the best architecture would you choose?

Answer 17

Kinesis Data Streams + Kinesis Data Firehose

Question 18

An e-commerce company is preparing for a big marketing promotion that will bring millions of transactions. Their website is hosted on EC2 instances in an Auto Scaling Group and they are using Amazon Aurora as their database. The Aurora database has a bottleneck and a lot of transactions have been failed in the last promotion they have made as they had a lot of transaction and the Aurora database wasn’t prepared to handle these too many transactions. What do you recommend to handle those transactions and prevent any failed transactions?

Answer 18

Use SQS as a buffer to write to Aurora

Question 19

A company is using Amazon Kinesis Data Streams to ingest clickstream data and then do some analytical processes on it. There is a campaign in the next few days and the traffic is unpredictable which might grow up to 100x. What Kinesis Data Stream capacity mode do you recommend?

Answer 19

On-demand mode since the traffic is unpredictable

Question 20

If you have multiple consumers retrieving data from a Kinesis Data Stream, which feature should you use so that each consumer receives its own 2MB/second pipe of read throughput per shard?

Answer 20

Kinesis Data Streams Enhanced Fanout

Question 21

Tool that allows you to reliably load streaming data into data lakes, data stores, and analytics tools, but not to applications

Answer 21

Kinesis Data Firehose

Question 22

In order to migrate from SQS Standard queues to FIFO queues with batching, what three steps would you have to take?

Answer 22

1. Delete the existing standard queue and recreate it as a FIFO queue
2. Make sure the name of the FIFO queue ends with the .fifo suffix
3. Make sure that the throughput for the target FIFO queue does not exceed 3,000 messages per second

Question 23

How many messages per second can a FIFO queue support if you enable batching?

Answer 23

3,000

Question 24

How many messages per second can a FIFO queue support if you disable batching?

Answer 24

300

Question 25

In Kinesis Data Streams, how many messages per second can you get per shard?

Answer 25

1000

Question 26

If you want to use an SQS FIFO queue that has multiple consumers, which attribute should you define for each message?

Answer 26

GroupID

Question 27

SQS feature that lets you postpone the delivery of new messages to a queue for several seconds, for example, when your consumer application needs additional time to process messages

Answer 27

Delay queues

Question 28

What are the four destinations where Amazon S3 notifications can publish events?

Answer 28

Amazon SNS topic
Amazon SQS queue (standard queue only!)
AWS Lambda

Question 29

This type of queue can be used as a target for messages that cannot be processed (consumed) successfully by other queues

Answer 29

Dead-letter queue