Storage Extras Flashcards
What is the aws snow family?
Portable devices used to migrate data in and out of aws.
You order the snowcone or snowball devices, store your data, then send it back to aws, who will put it in your s3 bucket for you.
It’s an offline data transfer.
What is edge computing? (snowcone and snowball edge)
Process data while being created in an edge location, with a snow product.
For this you get a snowcone or a snowball. Snowball can be storage optimized or compute optimized.
How do you import data from snow to s3 glacier?
You can’t directly. First yo need to import to a normal s3 bucket and then with a lifecycle policy transfer it to glacier.
What is AWS FSx?
It’s a service for launching 3rd party file systems in aws, like windows file server, lustre, netapp ontap, or openzfs.
Can you mount FSx for windows file server in a linux instance?
YES
What is Lustre for? Which aws service lets you create a Lustre file system?
Its a file system for high scale computing.
Used for machine learning, high performance computing, video processing, etc.
With aws FSx
Which FSx has full integration with s3? What does it mean?
Lustre.
You can read S3 as a file system through FSx.
You can also write output of computations back to s3.
What are FSx deployment options?
Scratch file system: Temporary storage. No replication, but higher performance (x6 throughput).
Persistent file system: Long term storage. Data is replicated within same AZ (2 copies of data).
What are FSx Netapp Ontap features?
Compatible with NFS SMB or iSCSI.
You can move workloads running on netapp to aws.
It has a feature for point in time instantaneous cloning. Meaning you can clone your netapp file system. Useful for testing new workloads.
What are FSx OpenZFS File system features?
Managed OpenZFS on aws. Its only NFS protocol.
You can move workloads running on openzfs to aws
Which are the aws Fille System storage services?
EFS (NFS) and FSx (Windows, Lustre, OpenZFS, Netapp)
Which are the aws Block storage options?
EBS and Instance Store
Which are the aws Object Storage options?
S3
What is AWS Storage Gateway?
A service that acs as a bridge between your AWS data and your On-Premises data. (Hybrid).
What are storage gateway use cases?
Disaster Recovery: Back up your onpremises data to the cloud.
Backup and Restore: Migration to the cloud.
Tiered Storage: Extend your data to the cloud. Example: Hotter data stored on premises and Colder data stored in Cloud.
Cache on premises: Store most of your data in aws and use storage gateway to store a cache on premises for lower latency.
What are the different types of storage gateway?
S3 File Gateway: Conect your server to an S3 bucket through NFS or SMB.
S3 File Gateway
FSx File Gateway
Volume Gateway
TapeGateway
How does S3 File Gateway work?
It allows an on premises server to access an S3 bucket through the NFS or SMB protocol.
The server sees an NFS share for example but behind the scenes there is an S3 bucket where files are stored and read. Data is transfered through HTTPS behind the scenes.
Most recently used data is CACHED in the file gateway, this gives rapid access to the server.
It doesn’t work with Glacier. You can set up a lifecycle policy to your bucket so that objects are moved to glacier tiers after some time.
How do you use S3 File Gateway with glacier storage?
If you want to have an NFS or SMB storage that points to an S3 glacier bucket, you can’t directly. You have to set up a lifecycle policy to your bucket so that objects are moved to glacier tiers after some time.
What is a benefit of using S3 file gateway with SMB protocol?
It has integration with Active Directory for user authentication against s3 file gateway. (And therefore the s3 bucket).
What storage gateway feature gives users faster access to files?
It caches most recent files in file gateway and makes read times faster to users.
Amazon FSx for windows file server by itself lets you connect it to on premises servers. Why then is it useful to use Amazon FSx File Gateway (Storage Gateway)?
Because it caches frequently accessed data in the file gateway of your on premises data center.
Where and how can you deploy Storage Gateway?
On premises as a VM appliance in esxi, kvm, or hyper-v. As a hardware appliance, or as an EC2 instance in aws.
Which Storage Gateway option works with iscsi protocol?
Volume Gateway and Tape Gateway
Which Storage Gateway option works with NFS protocol?
S3 File Gateway
What are the 2 options for Volume Gateway?
Cache volumes: Low latency access to most recently used data
Stored Volumes: All data is on premises, with scheduled backups to s3
How does Tape Gateway work?
The tape gateway connected to the tape drive, uploads the backed up data to the aws cloud, into s3. or glacier.
Which Storage Gateway option works with SMB protocol?
S3 File Gateway and FSx File Gateway
How does Storage Gateway transfer data from onpremises to AWS in all cases?
Through HTTPS.
How does volume gateway work?
You mount iscsi volumes in your on premises servers through volume gateway, which will store data in s3, or just backups, depending on the mode selected.
How do EBS Volumes come in to play when talking about Volume Gateway?
Volume Gateway stores data in S3. But you can transform the S3 data into EBS Volume for disaster recovery or migration into EC2.
You can also configure regular ebs snapshots as backups of the volume gateway data.
What is the purpose of S3 File Gateway?
To have a local on premises cache of s3. Its files as objects.
What is the purpose of Volume Gateway?
You have 2 options. First is cached volumes, which is for having an on premises cache of your data.
Second is Stored volumes, which is for having your data on premises, but with the possibility of doing regular backups of such data into s3.
What is the purpose of tape Gateway?
To back up your tapes into s3 and glacier.
What is the purpose of FSx File Gateway?
To have a local on premises cache of FSx for windows file server.
What is AWS Transfer Family?
Its a service for transfering files in and out of S3 and EFS using FTP, SFTP, or FTPS.
You create a server with this service that will have the role of FTP Server.
What is DataSync?
A service for moving large amounts of data to and from:
on premises or other clouds, and aws.
It can use a variety of protocols for data transfers.
It needs an agent to run on premises/other clouds.
You can also move data (And Metadata) between aws services with this service. With no agent. (S3, EFS, FSx)
Data is syncronized in a schedule: daily, hourly, weekly.
Which service for moving data between locations is the only one that preserves metadata like the NFS Posix or SMB file permissions?
DataSync is the only option that preserves metadata.
What do you do when you want to run DataSync to move your data, but you dont have the network capacity to do so in your datacenter?
You should use AWS Snowcone which comes with the data sync agent pre installed. You can run snowcone to pull your data with datasync and then ship it to aws.
Which of these storage options does DataSync NOT support?
EFS
EBS
FSx
S3
EBS
