Athena, OpenSearch, EMR, QuickSight

Question 1

• Serverless query service to analyze data stored in Amazon S3
• Uses standard SQL language to query the files (built on Presto)
• SupportsCSV,JSON,ORC,Avro,andParquet
• Pricing: $5.00 per TB of data scanned
• Commonly used with Amazon Quicksight for repor ting/dashboards

Answer 1

Amazon Athena

Question 2

analyze data in S3 using serverless SQL

Answer 2

Athena

Question 3

Amazon Athena – Performance Improvement, Use __________ for cost-savings (less scan)

Answer 3

columnar data

Question 4

What is recommended when using columnar data for cost-savings?

Answer 4

Apache Parquet or ORC

Question 5

With Amazon Athena use ________ to convert your data to Parquet or ORC

Answer 5

Glue

Question 6

__________ datasets in S3 for easy querying on virtual columns

Answer 6

Partition

Question 7

What are 4 Performance Improvements for Athena

Answer 7

Use columnar data for cost-savings (less scan)
Compress data for smaller retrievals
Partition datasets in S3 for easy querying on virtual columns
Use larger files (> 128 MB) to minimize overhead

Question 8

• Allows you to run SQL queries across data stored in relational, non-relational, object, and custom data sources (AWS or on-premises)
• Uses Data Source Connectors that run on AWS Lambda to run Federated Queries (e.g., CloudWatch Logs, DynamoDB, RDS, …)
• Store the results back in Amazon S3

Answer 8

Amazon Athena – Federated Query

Question 9

• Based on PostgreSQL
• It’s OLAP – online analytical processing (analytics and data warehousing)
• 10x better performance than other data warehouses, scale to PBs of data
• Columnar storage of data (instead of row based) & parallel query engine
• Pay as you go based on the instances provisioned
• Has a SQL interface for performing the queries
• BI tools such as Amazon Quicksight or Tableau integrate with it
• vs Athena: faster queries / joins / aggregations thanks to indexes

Answer 9

Redshift

Question 10

2 types of nodes for Redshift Cluster

Answer 10

Leader Node
Compute Node

Question 11

Redshift Cluster node for query planning, results aggregation

Answer 11

Leader node

Question 12

Redshift Cluster node for performing the queries, send results to leader

Answer 12

Compute node

Question 13

Do you need to provision the node size in advance?

Answer 13

YES

Question 14

With Redshift Cluster, can you used Reserved Instances for cost saving

Answer 14

YES

Question 15

Redshift has “Multi-AZ” mode for ____________

Answer 15

some clusters

Question 16

Redshift Snapshots are __________ backups of a cluster, stored internally in __________

Answer 16

point-in-time
S3

Question 17

Redshift Snapshots are ____________

Answer 17

incremental
(only what has changed is saved)

Question 18

Can you restore a Redshift snapshot into a new cluster?

Answer 18

YES

Question 19

Automated: Redshift Snapshots

Answer 19

every 8 hours, every 5 GB, or on a schedule. Set retention between 1 to 35 days

Question 20

Manual: Redshift Snapshots

Answer 20

snapshot is retained until you delete it

Question 21

You can configure Amazon Redshift to ___________ copy snapshots (automated or manual) of a cluster to another AWS Region

Answer 21

automatically

Question 22

3 options when Loading data into Redshift

Answer 22

Amazon Kinesis Data Firehose
S3 using COPY command
EC2 Instance JDBC driver

Question 23

What is better when loading data into Redshift

Answer 23

Large inserts

Question 24

• Query data that is already in S3 without loading it
• Must have a Redshift cluster available to start the query

Answer 24

Redshift Spectrum

Question 25

• is successor to Amazon ElasticSearch
• In DynamoDB, queries only exist by primary key or indexes…
• you can search any field, even partially matches
• It’s common to use as a complement to another database
• Two modes: managed cluster or serverless cluster
• Does not natively support SQL (can be enabled via a plugin)
• Ingestion from Kinesis Data Firehose, AWS IoT, and CloudWatch Logs
• Security through Cognito & IAM, KMS encryption,TLS
• Comes with Dashboards (visualization)

Answer 25

OpenSearch

Question 26

What does Amazon EMR stand for??

Answer 26

Elastic MapReduce

Question 27

• helps creating Hadoop clusters (Big Data) to analyze and process vast amount of data
• The clusters can be made of hundreds of EC2 instances
• comes bundled with Apache Spark, HBase, Presto, Flink…
• takes care of all the provisioning and configuration
• Auto-scaling and integrated with Spot instances

Answer 27

Amazon EMR

Question 28

What are 4 use cases for EMR?

Answer 28

data processing
machine learning
web indexing
big data

Question 29

What are 3 node types for EMR?

Answer 29

Master Node
Core Node
Task Node

Question 30

Amazon EMR – Node types: Manage the cluster, coordinate, manage health – long running

Answer 30

Master Node

Question 31

Amazon EMR – Node types: Run tasks and store data – long running

Answer 31

Core Node

Question 32

Amazon EMR – Node types: Just to run tasks – usually Spot

Answer 32

Task Node

Question 33

3 EMR Purchasing Options

Answer 33

• On-demand: reliable, predictable, won’t be terminated
• Reserved (min 1 year): cost savings (EMR will automatically use if available)
• Spot Instances: cheaper, can be terminated, less reliable

Question 34

• Serverless machine learning-powered business intelligence service to create interactive dashboards
• Fast, automatically scalable, embeddable, with per-session pricing
• Integrated with RDS, Aurora, Athena, Redshift, S3…
• In-memory computation using SPICE engine if data is imported into QuickSight
• Enterprise edition: Possibility to setup Column-Level security (CLS)

Answer 34

Amazon QuickSight

Question 35

4 use cases for QuickSight

Answer 35

• Business analytics
• Building visualizations
• Perform ad-hoc analysis
• Get business insights using data