AWK Kinesis

Question 1

For Kinesis data streams, how does it work?

Answer 1

Kinesis data streams enable you to inject data from thousands of sources, Kinesis data streams scales based on the number of shards you create. Kinesis data streams buffer the data for 24hrs by default and enable one or more consumers to read form the stream.

Question 2

When you create a Kinesis stream, in what region are you creating the stream or is it a global service?

Answer 2

You are creating the stream in the region you have selected as Kinesis data stream is not a global service.

Question 3

What is Kinesis?

Answer 3

It is a family of products for data stream processing, this means injection, analysis/process and store.

Question 4

What is the Kinesis produce?

Answer 4

it is the entity that puts data into the stream,
- IOT device
_ Mobile device
- Application device
- EC2 device
- On-prem server

Question 5

What is a Kinesis consumer?

Answer 5

This is the entity that takes data out of the stream.

Question 6

Can I have multiple consumers?

Answer 6

Yes

Question 7

What types of Kinesis consumers can I have?

Answer 7

You cna have,
- EC2 using Kinesis customer library (KCL)
Lambda
Kinesis Firehose

Question 8

What types of streams can I have in Kinesis?

Answer 8

• Data streams

- Video streams

Question 9

How long is dat stored in a Kinesis stream?

Answer 9

24hrs (you cna increase this to 7day for an extra charge)

Question 10

How dose a Kinesis stream related to shards?

Answer 10

A kinesis stream is a collection of shards.

Question 11

What are the units associated with a single shard?

Answer 11

Read at 2mb per second

Write at 1mb per second

Question 12

What is the max number of shards?

Answer 12

500

Question 13

I require a Kinesis stream capable of 10mb write, how many shards do I need?

Answer 13

You need 10

Question 14

How many data records per second can a single shard in a Kinesis accept?

Answer 14

100 per shard

Question 15

How big can a single Kinesis data record be?

Answer 15

1MB

Question 16

What is the partition key used for in Kinesis?

Answer 16

It is used to select the shard to use when writing the data.

Question 17

We are using Kinesis and our org has a policy where all data in transit and at rest is encrypted, is it possible to have Kinesis encrypt the data at rest?

Answer 17

Yes 100%, you can use SSE-KMS with AWS keys or SSE-KMS encryption with client keys.

Question 18

How can I monitor the Kinesis stream metrics?

Answer 18

You can use cloud whatch to monitor shard level metrics like incoming bytes, outgoing bytes, etc

Question 19

I wnat to access Kinesis form my VPC without going on the internet, how cna I do this?

Answer 19

VPC endpoints.

Question 20

I have Lambda configured to operate in the vPC, how best cna I have lambda access Kinesis?

Answer 20

Through VPC endpoints

Question 21

What is an enhansed fan out in relation to Kinesis

Answer 21

It means that you select a consumer to be given more of the bandwidth.

Question 22

What is Kinesis Firehose?

Answer 22

It enables you to take data From Kinesis stream and push it to a datastore like
 Elasticsearch 
S3 
Redshift
Splunk

Question 23

For Kinesis what the two input sources you can have?

Answer 23

• Kinesis

- Direct, send records direct to Kinesis Firehose.

Question 24

I want to push CloudWatch events into a Kinesis Firehose, how can I do this?

Answer 24

Kinesis Firehose can take Direct input from these sources.

Question 25

I wnat to push CloudWatch Logs into a Kinesis Firehose, how can I do this?

Answer 25

Kinesis Firehose can take Direct input from these sources.

Question 26

I wnat to transform data at it is been wrote to S3 from Kinesis Firehose, how cna I do this?

Answer 26

Kinesis Firehost has the option to transform data using Lambda.

Question 27

For Kinesis can I compress and encrypt and encrypt data been sent to S3?

Answer 27

Yes you can take an input stream and when delivering it you can encrypt and compress it.

Question 28

How can I vire the main functions of what Kinesis dose?

Answer 28

Take an input stream, transforms if and stores it while opinalycompressing and encrypting it to a number of destinations like S3, Redshift, Redshift and Elastic search.

Question 29

What types of inputs can you have with Kinesis?

Answer 29

Direct PUTS from sources like IoT, etc

Kinesis

Question 30

If Kinesis is used as an input for Kinesis firehose and the Kinesis stream is already encrypted, will the firehose be automatically encrypted?

Answer 30

Yes.

Question 31

What are the products in Kinesis?

Answer 31

Kinesis streaming
Kinesis Firehose
Kinesis Analytics

Question 32

For Kinesis what are the Inputs we can have?

Answer 32

You cna have Kinesis Streams and Kinesis Firehose

Question 33

For Kinesis streams what are the Inputs we can have?

Answer 33

You cna have Kinesis Streams and Kinesis Firehose

Question 34

For Kinesis Analytics how can I perform preprocessing of the stream data?

Answer 34

Kinesis Analytics has the ability to use Lambda as a pre-processor.

Question 35

What can I output Kinesis Analytics too?

Answer 35

Kinesis Streams and Kinesis Firehose

Question 36

I wnat to add some reference data to the stream data in my Kinesis Analytics, how cna I do this?

Answer 36

You cna use the reference table to supply the reference data.

Question 37

What is the flow of data through Kinesis Analytics?

Answer 37

Input stream form Kinesis Streams or Firehose to Input table, select query and output to the application output stream and then data passed to Kinesis Streams or Firehost.