Brainscape's Knowledge GenomeTM

Browse over 1 million classes created by top students, professors, publishers, and experts.


See full index

AWS 102 > AWS Redshift > Flashcards

AWS Redshift Flashcards

1
Q

When you create a cluster, what do you get as a base configuration?

A

You get two nodes, leader and a data node, giving 160GB.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Do you get to select the disk size for RedShift?

A

No, you do not get to select the dist size. You do get to select the overall size of the Redshift cluster, through a slider in the console or parameter in CLI & API. AWS will then figure the number of disks in each data node.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

I need to add capacity to my redshift cluster, how can I do this?

A

You have two options, you can scale up or out. Scaling up means you can change the size of the instance or you can add more node by scaling out.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

What interfaces does RedShift support?

A
  • ODBC
  • JDBC
  • Postgres
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

What is RedShift built on?

A

AWS Postgress, AWS separated the storage from the query engine and then replaced the storage engine with a columnar database.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

What is RedShift used for?

A
  • Data Wherehouse

- Analytics

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

I have data in S3, is it possible to query this data from RedShift?

A

Yes, RedShift has a service called RedShift Spectrum, the data in S3 must be in a CVS format.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

What type of database is Redshift?

A

It is a columnar database, it is designed to scan columns of data fast. With columnar data, it is easy, to sum up, a column or find the min and max fast.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

What is the architecture of a RedShift cluster?

A

You have a leader node and data nodes, data nodes have slices and these slices are the storage where data is stored and searched.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

What is the purpose of the leader node?

A

The leader node distributes the query to the data nodes in the cluster, the leader node is the query planner node..

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Is RedShift an OLAP or OLTP?

A

It is OLAP (online analytic processing).

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

Is RedShift a regional, Global?

A

Redshift just lives in a single Subnet in a single AZ, the reason for this is the components need to be fast and keeping them together requires the components kept local.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

Is data compressed in Redshift?

A

You can have data compressed in Redshift, this is not blanket compression but is defined when you create a table and is defined per field in the table.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

Is Redshift a service or do you get a cluster of nodes?

A

You get a cluster of nodes, one leader and the rest are data nodes.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

Dose Redshift support encryption?

A

Yes, you can use KMW or CloudHSM, with KMW you can use AWS Managed CMK’s or you can use you own CMK

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

Can I resize a cluster?

A

You have two options, elastic resize and classic resize. Elastic resize makes a new cluster and copies from one node to another. Elastic resize just adds node and rebalance the data.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

I wnat to increase the size of the Redshift cluster nodes, how can I do this?

A

You have to use classic resize as it enables the resizing of nodes. A new cluster will be created and the data will be copied over to the new cluster.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

How is Redshift backed up?

A

When the cluster is created the default is, automatic backups, backup snapshots are taken of the Redshift cluster and you can also use manual snapshots. Snapshot data is stored in S3.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

What services can push or load data into Redshift?

A
  • Kinesis
  • S3
  • DataPipeline
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

How often does AWS take snapshots of the Redshift cluster?

A

every 6 - 8 hrs or every 5gb of data changes.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

Is it possible to take a manual snapshot of the Redshift cluster?

A

Yes, 100%, you also set how long you wnat the snapshot to be retained, -1 forever.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

I am concerned about DR for my Redshift, what options do I have?

A

You can configure to have the snapshots replicated to another region, you select the region and retention period.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

If I wnat to restore a table form a snapshot/backup, is this possible?

A

Yes, you can select the backup/snapshot and then the database and the table.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

I wnat to be able to restore my cluster in the event of a disaster, what options do I have?

A

You can have the Redshift cluster take snapshots/backups and then you will be able to restore.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
25
Q

What is the Max data the RedShift can manage?

A

2PB

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
26
Q

What type of database is RedShift

A

Colomer database

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
27
Q

Is Redshift an OLAP or OLTP?

A

OLTP

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
28
Q

I what to increase the amount of data in my Redshift cluster, how can I do this?

A

Increase the number of nodes as each node is a computer and storage unit.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
29
Q

What types of nodes do you get in a redshift cluster?

A

You get a leader node and data nodes

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
30
Q

For data nodes, are there different types of nodes?

A

Yes, you have two instance type options,

  • Instance DC2 (SSD)
  • Instance DS2 (Magnetic)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
31
Q

I have one large file (1TB), what should I do when loading into Redshift and why?

A

You need split the file into a smaller file so that each of the files will get loaded on to separate nodes in the RedShift cluster.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
32
Q

What are the two operations you perform on a Redshift cluster to get dat in and out?

A

load and unload

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
33
Q

Where is Redshift deployed to?

A

VPC

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
34
Q

Can you purchase reservations?

A

Yes

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
35
Q

I wnat to be able to store user information and update individual user data fields, is Redshift suitable, give reson?

A

Redshift is an OLAP (Colum DB) and not suitable for OLTP type data.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
36
Q

Can you make a redshift cluster public?

A

Yes

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
37
Q

How do backups work on Redshift?

A

You get to take snapshots manually and automatically, these are incremental and like other databases, you can restore to any point in time

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
38
Q

What are the AWS services that can put data into Redshift?

A
  • Datapipeline
  • Kinesis firehose
  • S3
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
39
Q

How can I increase the DR capabilities of Redshift?

A

Ensure snapshot are automatically take/configured, enable cross-regions snapshots to copy the s3 snapshot to another region.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
40
Q

Can I just restore a Table and not the whole database?

A

Yes, you have the ability to restore just a table.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
41
Q

What is RedShift?

A

Redshift is a fully managed, fast and powerful, petabyte-scale data warehouse service

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
42
Q

What is the smallest redshift cluster you can have?

A

1 one it acts are both the compute and lead node.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
43
Q

What is the purpose of the lead mode?

A

it is to distribute the incoming request to the leads and collect the result.

44
Q

In a redshift cluster, how may lead nodes will it take to store 1PB of data?

A

None, lead nodes do not store data, data nodes store data in redshift.

45
Q

How can you query data in a redshift cluster?

A

Using Postgres SQL.

46
Q

Can I select form a T2 micro and a T2 standard instance when creating a RedShift cluster?

A

No, there are only two instance types supported,

  • DC2 instance types
  • S2
47
Q

When we load data, what are we doing?

A

Putting data in the RedShift cluster.

48
Q

Where is data stored in the RedShift cluster?

A

Data is stored in slices in the data nodes, a data can cna either have 2 or 16 slices. Each slice will query its own data to get a result.

49
Q

I am using ODBC and I need to load data into RedShift, do I need a third party product to load that data?

A

No, ODBC is supported by RedShift

50
Q

I am using JDBC and I need to load data into RedShift, do I need a third party product to load that data?

A

No, JDBC is supported by RedShift

51
Q

As redshift is a managed service form AWS, I am concerned I will not be able to have RedShift deployed to my VPC, is this valid?

A

No, RS can be deployed to your VPC

52
Q

I wnat to have a RedShift cluster public-facing, how can i do this?

A

Yes, its an option, you deploy to you public VPC

53
Q

By default where is the RS cluster deployed?

A

To the default VPC

54
Q

I am architecting a solution, my org does not wnat any data in transit over the public internet, I have data in S3 to be loaded into redshift, how can I architect this solution so no data goes over the internet?

A

Put the RS cluster in a private VPC with VPC endpoint gateway for access to s3 data so we cna load the data without going over the public internet.

55
Q

I know I am going to be using my RS cluster for the next 3 years, I wnat to reduce the cost, how can I do this?

A

You can do a reservation for the nodes in RS, just like EC2 reservations and this will save you on cost.

56
Q

My org requires data at rest encryption, how can I implement this in RS?

A

Just like other AWS products/services, RS supports encryption of data, SSE with customer or AWS managed CMKs

57
Q

Can I resize RS?

A

Yes, two options,

  • Classic: Create a new cluster and copy data.
  • Elastic resize: You cna just change the number of node
58
Q

When you resize an RS clutter is there some disruption?

A

Yes

59
Q

What I am using RS to access S3 through a VPC endpoint, what option do I need to enable?

A

Enhanced routing

60
Q

How are backups created in RS?

A

Scheduled and manual snapshots

61
Q

How long are automatic snapshots retained for RS?

A

You set the retention period, afterwords the data is deleted.

62
Q

Can I take manual snapshots for RS?

A

Yes

63
Q

How long are manual snapshots retained for RS?

A

You set the retention period, afterwords the data is deleted.

64
Q

How can I load data into an RS cluster?

A
  • Data pipeline
65
Q

I have data in MySQL table and I wnat to load it into my RS cluster, how cna I do this?

A
  • Data pipeline has a template to load MySQL data into the RS cluster.
66
Q

I wnat to each day load my MYSQL table into my RS cluster, how cna I do this?

A
  • Data pipeline has a template for copying data and using a schedule.
67
Q

I wnat to copy data from S3 to my SR cluster several times a day, how cna I do this?

A

You can use the Datapipeline template to copy S3 data to RS and modify it so it uses a schedule.

68
Q

How cna I load and unload data from S3, would I use the datapipeline?

A

No, RS has this ability native.

69
Q

When using automated snapshots, when is the snapshot preformed?

A

every 6 - 8 hrs or after 5GB of data changes, whichever comes first.

70
Q

Where are backups stored?

A

S3

71
Q

Is it possible to exclude a table form backup processes?

A

Yes, there is a parameter to have ‘no backup’ on a per-table base.

72
Q

Can I take a manual snapshot?

A

Yes

73
Q

If I set a retention period for backup to -1 what will happen?

A

The backup will never expire and be deleted.

74
Q

I want to have a DR capability for my RS cluster, how can I do this?

A

Enable cross-region replication to have a copy of the data in another region.

75
Q

I have just deleted data from my table in RS, I keep daily backups (snapshots), do I have to do a full restore?

A

No, you have two options,

  • Full restore
  • Table restore
76
Q

From a high availability perspective for RS, is there only one copy of your data on each node?

A

No, each node also copies its data to another node in the cluster, you do not pay extra for this replicated data.

77
Q

Di I need to patch the Leader and Data node in my RS cluster?

A

No, RS is a managed service and patching is performed by AWS.

78
Q

What is the max retention period for backups?

A

35 days

79
Q

What is the min retention period for backups?

A

1 day

80
Q

How can you scale an RS cluster?

A

Up or out, you cna change the size of the instance or add more instances.

81
Q

When you change the size of the RS instances, when are changes applied?

A
  • Now if you select it

- or in the maintenance window.

82
Q

I want the high-level of security, where my RS encryption keys are meeting the high level of security, what options do I have?

A

You cna use the CloudHSM for key management.

83
Q

You have recently joined a startup company building sensors to measure street noise and air quality in urban areas. The company has been running a pilot deployment of around 100 sensors for 3 months. Each sensor uploads 1KB of sensor data every minute to a backend hosted on AWS. During the pilot, you measured a peak of 10 IOPS on the database, and you stored an average of 3GB of sensor data per month in the database. The current deployment consists of a load-balanced auto scaled Ingestion layer using EC2 instances and a PostgreSQL RDS database with 500GB standard storage. The pilot is considered a success and your CEO has managed to get the attention of some potential investors. The business plan requires a deployment of at least 100K sensors, which needs to be supported by the backend. You also need to store sensor data for at least two years to be able to compare year over year Improvements. To secure funding, you have to make sure that the platform meets these requirements and leaves room for further scaling. Which setup will meet the requirements?

A

Add an SQS queue to the ingestion layer to buffer writes to the RDS instance (RDS instance will not support data for 2 years)
Ingest data into a DynamoDB table and move old data to a Redshift cluster (Handle 10K IOPS ingestion and store data into Redshift for analysis)
Replace the RDS instance with a 6 node Redshift cluster with 96TB of storage (Does not handle the ingestion issue)
Keep the current architecture but upgrade RDS storage to 3TB and 10K provisioned IOPS (RDS instance will not support data for 2 years)

84
Q

Does RS provide automatic out of the box backup?

A

Yes, 100%. RS provides the ability to have you RS data backed up, this happens every 6-8 hrs or hewn you get a 5GB data change. Retention is settable for 1 - 35 days.

85
Q

How can I lower cost in RS?

A

Opt to use reserved instances for RS the is running for very long periods.

86
Q

I wnat to query my CVS data in S3 from RedShift, how cna I do this?

A

You can use RedShift spectrum.

87
Q

I have exabytes of CVS data in S3, I have an application using ODBC, how can I query it?

A

You can use RedShift spectrum, RSS can use ODBS just like redshift and can also query S3

88
Q

How do I configure and use spot instances with redshift?

A

You cant, sport instances can be taken back by AWS at andy point and can not be used with RedShift Leader or data nodes as they require always running instances.

89
Q

Where is RedShift deployed?

A

In a single region and in a single AZ.

90
Q

Can you select T1, M1? C1 instances?

A

No, with RedShift you can select from a limited number of instance types,

  • ra3.16xlarge (48 vCPU)
  • dc2.large (2 vCPU)
  • dc2.8xlarge ( 32 vCPU)
91
Q

Can you change the cluster VPC after it is created?

A

No, you can create a new cluster.

92
Q

What storage size do I get?

A

It depends, each node as an instance size and an amount of storage, there are 3 instances sizes and each has a different size of storage. You can scale up RS to 8PB storage by scaling out the number of data nodes. to 128, this is 128 nodes with 64TB each

93
Q

Can you make the RedShift cluster public?

A

Yes, 100%, it just in a VPC, so you cna add an INternetGateway and give it an EIP. All available through many network provisioning.

94
Q

I wnat to use Encryption and I need to understand what options I have for key management?

A

You can use,

  • KMS - AWS Managed CMKs
  • KMS - Customer managed CMK
  • CloudHSM
95
Q

What is the backup retention period?

A

1 - 35 days

96
Q

My ORG is concerned about having a DR available for the RedShift cluster, we want to ensure we can if needed DR to another location, what would be the best method?

A
  • User CloudFormation to recreate the RS cluster in another region if needed.
  • Use backups with regional replication enabled it to ensure backups are offloaded to another region and can be used to recreate the data.
97
Q

How are backups taken in RedShift?

A

RS has two types of backups,

  • Manual (You take them)
  • Automatic (Every 8hrs or 5GB per node of data change)
98
Q

I wnat to take snapshots of the RedShift cluster on my schedule, how can this be done?

A

You have to create a snapshot schedule, this schedule defines when you wnat snapshots created for your cluster. This schedule is attached to one or more clusters.

99
Q

Where are snapshots stored?

A

S3

100
Q

When you do a snapshot restore for RedShift, how is the data restored to the cluster?

A

It is not restored to the cluster, you will get a new cluster.

101
Q

When restoring a cluster, can I use it straight away or do I have to way until all the data is streamed over from the snapshot in S3?

A

You can use the cluster straight away, data is streamed as needed.

102
Q

Can you monitor the progress of snapshots?

A

Yes.

103
Q

Are backups charged extra?

A

Sort of, you get to backup using to the same size storage on the RS data nodes, after you snapshots go over thet you are charged at normal rate.

104
Q

I wnat to manually copy the RS snapshot to a new region, how do I select it to be copied to the new region?

A

RS snapshots are managed by AWS RS and not visible to you in an S3 bucket.

105
Q

Can you restore just a table form a snapshot?

A

Yes, you select the snapshot, database and table

106
Q

I have a VPC what do I need to create from a network perspective to create your RedShift cluster in your VPC?

A

You will need a subnet group and security group

AWS 102 (90 decks)

Brainscape helps you reach your goals faster, through stronger study habits.
© 2024 Bold Learning Solutions. Terms and Conditions