Important stuff_AWS Certification

Question 1

Sagemaker

Answer 1

Data usually comes from S3, but can also ingest from Athena, EMR, Redshift and Amazon Keyspaces DB

Cannot be deployed on an EMR cluster

Question 2

Kinesis Firehose data conversion capabilities

Answer 2

Kinesis Firehose has the ability to convert JSON data to Parquet or ORC format on the fly.

Question 3

Vanishing Gradient

Answer 3

A “vanishing gradient” results from multiplying together many small derivates of the sigmoid activation function in multiple layers. ReLU does not have a small derivative, and avoids this problem.

Question 4

Quicksight

Answer 4

can directly read from S3

Question 5

Kinesis Data Firehose

Answer 5

• Fully Managed Service, no administration
• Near Real Time (60 seconds latency minimum for non full batches)
• Data Ingestion into Redshift / Amazon S3 / ElasticSearch / Splunk, ie. Load data into these services
• Automatic scaling
• Supports many data formats
• Data Conversions from CSV / JSON to Parquet / ORC (only for S3)
• Data Transformation through AWS Lambda (ex: CSV => JSON)
• Supports compression when target is Amazon S3 (GZIP, ZIP, and SNAPPY)
• Pay for the amount of data going through Firehose

Question 6

convert to LibSVM

Answer 6

Neither Glue ETL nor Kinesis Analytics can convert to LibSVM format, and scikit-learn is not a distributed solution.

Question 7

Binning

Answer 7

Binning is the process of converting numeric data into categorical data.

Question 8

Kinesis Producer Library

Answer 8

The KPL is an easy-to-use, highly configurable library that helps you write to a Kinesis data stream. It acts as an intermediary between your producer application code and the Kinesis Data Streams API actions

The KPL can help build high-performance producers

Question 9

Lamda Functions

Answer 9

Not meant to handle ETL jobs

Question 10

Spark

Answer 10

not used for OLTP or batch processing jobs, more for transforming data as it comes in.