AWS Storage Extras Flashcards

1
Q

AWS Snow Family

A

Highly Secure portable devices.

They collect and process data at edge OR migrate data into and out of AWS

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Data Migration Snow devices

A

Snowcone
Snowball Edge
Snowmobile

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Edge computing

A

Snowcone
Snowball Edge

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Why would you want to use AWS Snow Family?

A

Because of the time to transfer huge amounts of data. Takes hours to days.
Perfect for data migration

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

How does AWS Snow Family work?

A

You order AWS Snowball online. It gets shipped to you. You add the data in, and then ship it to AWS. They import/export the data into your Amazon S3 bucket

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

SnowBall Edge (data transfers)

A

Move data in or out of AWS
Pay per data transfer job
Block storage and Amazon S3-compatible object storage

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

What are the 2 flavours of SnowBall Edge?

A

Storage Optimised - 80 TB of HDD

Compute Optimised - 42 TB of HDD or 28 TB of NVMe

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

SnowBall Edge use cases

A

Large data cloud migrations
Decommission Data Centre
Disaster Recovery

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

AWS Snowcone & Snowcone SSD

A

Small
Portable computing
rugged & secure
for harsh environments

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Snowcone use cases?

A

edge computing, storage, data transfer

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Snowcone size

A

8 TB of HDD

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

Snowcone SSD

A

14 TB of SSD

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

What type of constrains do you need to have to use snowcone instead of snowball?

A

Space constrains, this is tiny

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

What do you need to provide yourself for snowcone?

A

Battery / cables

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

How do you transfer data from snowcone to AWS?

A

By sending it offline (shipping)

OR

Connect to internet and use AWS DataSync to send data

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

AWS Snowmobile

A

For transferring exabytes
1 EB = 1000 PB = 1,000,000 TBs

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

What is the capacity of AWS Snowmobile?

A

100 PB (can use multiple in parallel)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

How is a snowmobile protected?

A

Temp controlled tuck
GPS
24/7 video surveillance

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

When would you choose Snowmobile over Snowball?

A

When you need to transfer more than 10 PB

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

How does data migration work with snowball devices?

A

Request snowball from AWS console

install snowball client or AWS OpsHub on your servers

connect to servers and copy using client

ship back device to AWS facility

data are loaded to S3 bucket

snowball is wiped completely

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

How does data migration work with snowball devices?

A

Request snowball from AWS console

install snowball client or AWS OpsHub on your servers

connect to servers and copy using client

ship back device to AWS facility

data are loaded to S3 bucket

snowball is wiped completely

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

How can you use snowball devices for Edge Computing?

A

Process data while created on edge location

Snowball edge / snowcone can do this

Perfect for limited / no internet access locations

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

Edge Computing use cases

A

Preprocess data

Machine learning at the edge

Transcoding media streams

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

What can you do if you need to with edge computing after you are done?

A

Can also send it back to AWS to data transfer

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
25
Q

When would you use edge computing?

A

If you are at a location that has no / limited internet access

limited / no computing power

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
26
Q

What are some Edge Computing examples?

A

Truck on road, ship on sea, mining station underground

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
27
Q

What are the deployment options of Edge computing?

A

1 or 3 year options discounted pricing

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
28
Q

AWS OpsHub

A

Software to install on PC or laptop, to manage snow family devices. Graphical interface

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
29
Q

How do you transfer data from Snowball into Glacier?

A

Order Snowball, add the data in, import it to amazon S3, create an S3 lifecycle policy that moves the data into glacier

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
30
Q

What is Amazon FSx?

A

Allows to launch 3d party-high performance file systems on AWS

As a fully managed service

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
31
Q

What are the 4 FSx types?

A

For Lustre
For Windows File Server
For NetApp ONTAP
For OpenZFS

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
32
Q

FSx for Windows (File Server)

A

fully managed windows file system share drive

supports SMB protocol & Windows NTFS
Microsoft AD integration, ACL, user quotas
Can be mounted on EC2 instances (Linux)
Supports Microsofts Distributed File Systems (DFS) Name spaces (group files across multiple FS)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
33
Q

Benefits of FSx for Windows?

A

scale up to 10s of GB/s, millions of IOPS, 100s PB of data

SSD & HDD

Can be accessed from on-prem infra (VPN or Direct Connect)
Can be multi-AZ (HA)
Data backed to S3 d aily

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
34
Q

Amazon FSx for Lustre

A

Linux & Cluster (derived)

Type of parallel distributed file system for large-scale computing

Used for ML, High Performance Computing (HPC)

Video processing, financial modeling, electronic design automation

SSD & HDD

Seamless Integration with S3
can read S3 as a file system through FSx
Can write output of the computations back to S3 (through FSx)

Can be used on-prem servers (VPN or Direct Connect)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
35
Q

2 FSx File System Deployment options (Lustre)

A

Scratch File System

Persistent FIle System

36
Q

Scratch File System (Lustre)

A

Temporary storage
Data not replicated (no persistence)
High burst
Usage: short term processing optimise costs

37
Q

Persistent File System (Lustre)

A

Long-term storage
Data is replicated within same AZ
Replace failed files within minutes
Usage: Long-term processing, sensitive data

38
Q

FSx for NetApp ONTAP

A

Managed NetApp ONTAP on AWS
FS compatible with NFS, SMB, iSCSI protocol
Move workloads running on ONTAP or NAS to AWS
Works with
Linux
Win
MacOS
VMware Cloud on AWS
Amazon Workspaces & AppStream 2.0
Amazon EC2, ECS, and EKS

Storage shrinks or grows auto (AS)
Snapshots, replication, low-cost, compression and data de-duplication

Point-in-time instantaneous cloning (helpful for testing new workloads

39
Q

Amazon FSx for OpenZFS

A

Managed fiel system on AWS
File system compatible with NFS (v3,v4,v4.1,v4.1)
Move workloads running on ZFS to AWS
Works with
Linux
Win
MacOS
VMware Cloud on AWS
Workspaces & Appstream 2.0
Amazon EC2, ECS, EKS

Up to 1,000,000 IOPS with <0.5ms latency
Snapshot, compression and low -cost
Point-in-time instantaneous cloning

40
Q

Hybrid Cloud Storage

A

On-prem & Cloud infrastructure

41
Q

How do you expose S3 to On-Prem?

A

AWS Storage Gateway

42
Q

What are the 2 Block storage for AWS?

A

Amazon EBS

EC2 Instance Store

43
Q

2 File Storage in AWS

A

Amazon EFS

Amazon FSx

44
Q

2 Object Storage in AWS

A

Amazon S3
Amazon Glacier

45
Q

What is AWS Storage Gateway?

A

Bridge between on-prem data and cloud data

46
Q

Use cases for AWS Storage Gateway?

A

disaster recovery
backup & restore
tiered storage
on-premise cache & low-latency file access

47
Q

Different Kinds of Storage Gateways

A

S3 File Gateway
FSx File Gateway
Volume Gateway
Tape Gateway

48
Q

S3 File Gateway architecture

A

1 Corporate Data centre & AWS Cloud

You have your app server on-prem and you add an S3 File Gateway.

In the cloud you have your bucket (s3 standard, standard IA, One Zone IA, INtelligent-Tiering) and a Lifecycle policy for S3 Glacier .

Then you transfer data through HTTPS from cloud and on-prem.

Protocol used is NFS or SMB

SMB protocol has integration with AD for user auth

Frequently accessed data are cached

49
Q

FSx File Gateway

A

Native access to Amazon FSx for Win File Server

Local Cache for frequently accessed data

Native compatibility with SMB, NTFS, AD

useful for group file shares and home directories

50
Q

FSx File Gateway Architecture

A

SMB client and FSx File Gateway on-prem. Amazon FSx for WIndows File Server in AWS Cloud.

51
Q

Main reason to use FSx File Gateway?

A

Local Cache for frequently accessed data

52
Q

Volume Gateway

A

Block storage using iSCSI protocol backed by S3

53
Q

What does Volume Gateway do?

A

Backed by EBS snapshots which can restore on-prem volumes

Cached Volumes - low latency access to most recent data

Stored Volumes - entire dataset is on prem, scheduled for backup to S3

54
Q

Volume Gateway architecture

A

App server in on prem data centre. You also have a Volume Gateway and connect both with iSCSI interface.

The gateway contacts via HTTPS the S3 Bucket in the cloud which also contacts the Amazon EBS Snapshots (all in the cloud)

55
Q

Why do you want to use Volume Gateway

A

To backup your on-prem volumes

56
Q

Tape Gateway

A

Backup for physical tapes in the cloud

57
Q

What is Tape Gateway using?

A

Virtual Tape Library (VTL) backed up by S3 and Glacier

58
Q

Tape Gateway Architecture

A

On prem - Backup server, iSCSI interface chooses media changer or tape drive. Then the tape gateway connects via HTTPS to the cloud.

Directly onto the S3 that stores Virtual TApes, and also the archived tapes stored in amazon glacier

59
Q

What is Storage Gateway - Hardware appliance?

A

Essentially a mini server that can be installed on prem and act as a file, volume, tape gateway.

Can be ordered if you do not own any physical gateways

60
Q

When is a Storage Gateway - Hardware Appliance useful?

A

For daily NFS backups in small data centres

61
Q

AWS Transfer Family

A

File transfers into and out of Amazon S3 or EFS using FTP (only)

62
Q

AWS Transfer Family protocols

A

FTP
SFTP
FTPS

63
Q

Benefits of Transfer Family

A

Managed infrastructure
Scalable
Reliable
HA (multi az)

Pay per endpoint per hour

store and manage users credentials within the service

64
Q

Transfer Family use cases

A

sharing files
public datasets
CRM
ERP

65
Q

AWS Transfer Family Architecture

A

User using FTP client goes through Route 53 (optional) to SFTP, FTPS, FTP (VPC only) and using an IAM role they can connect to S3 or EFS.

users can also be auth using LDAP or MS AD.

66
Q

AWS DataSync

A

Move large amounts of data to and from
- on prem or other cloud to AWS - needs agent
- AWS to AWS (no agent needed)

Can synchronise - S3, EFS, FSx (win, lustre, NetApp, OpenZFS)

Scheduled Replication (hourly, daily, weekly)

File permissions and metadata are preserved (NFS POSIX, SMB)

One agent can task 10Gbps, can have bandwidth limit

67
Q

DataSync Architecture

A

NFS or SMB server on prem. connects to DataSync Agent which allows connection over TLS to AWS DataSync in the cloud. Then from there you can transfer/sync data to any AWS Storage Resources. Can also transfer and sync data from AWS to on prem.

68
Q

DataSync - what happens if you want to use it but do not have the bandwidth?

A

You can use AWS Snowcone because it has the DataSync agent pre-installed. Upload the data, run the agent, ship it to AWS and the Sync will happen there.

69
Q

Can you use AWS DataSync for transferring between AWS storage devices?

A

Yes - you can transfer directly between S3, EFS, FSx. And keeps the metadata

70
Q

What can you use to preserve metadata and file permissions when you do a transfer between storage services?

A

AWS DataSync

71
Q

What do you need to run to be able to connect and transfer data to NFS or SMB server?

A

DataSync Agent

72
Q

S3

A

Object Storage

73
Q

S3 Glacier

A

Object Archival

74
Q

EBS Volume

A

Network Storage for one EC2 instance at a time

75
Q

Instance Storage

A

Physical storage for EC2 instance (high IOPS)

76
Q

EFS

A

Network File System for Linux instances, POSIX filesystem

77
Q

FSx for Windows

A

Network File System for Windows Servers

78
Q

FSx for Lustre

A

High performance Computing Linux file system

79
Q

FSx for NetApp ONTAP

A

High OS compatibility

80
Q

FSx for OpenZFS

A

Managed ZFS file system

81
Q

Storage Gateway

A

S3 & FSx File Gateway, Volume Gateway (cache & stored), Tape Gateway

81
Q

Storage Gateway

A

S3 & FSx File Gateway, Volume Gateway (cache & stored), Tape Gateway

82
Q

Storage Gateway

A

S3 & FSx File Gateway, Volume Gateway (cache & stored), Tape Gateway

83
Q

Transfer Family

A

FTP, FTPS, SFTP interface on top of Amazon S3 or Amazon EFS

84
Q

DataSync

A

Schedule data sync from on-premises to AWS, or AWS to AWS

85
Q

Snowcone/ / Snowball / Snowmobile

A

to move large amount of data to the cloud, physically

86
Q

Database

A

for specific workloads, usually with indexing and querying