Section 16: AWS Storage Extras Flashcards
What is AWS Snow Family?
- Highly-secure, protable devices to collect and process data at the edge and migrate data into and out of AWS.
What different devices do you get for Snow family?
P170
1) Snowcone
- Smaller device than snowball device
- Stores 8 TB
- Can be send back to AWS offline or connect to internet and use AWS DataSync to send data.
2) Snowball Edge
- Large device(as big as a suitcase)
- Has two sizes. 80TB and 42 TB
3) Snowmobile
- Its a physical large truck.
- Each snowmobile has 100PB of storage
- High security
What is AWS OpsHub?
P170
- Its is software which you download onto your computer and it is used to connect to Snow devices, making it easier than the old method of using CLI(Command Line Interface).
Snowball into Glacier
P172
- Snowball cannot import to Glacier directly
- You must use Amazon S3 first, in combination with an S3 liefcycle policy.
What is Amazon FSx?
- Launch 3rd party high-performance file system on AWS
- Fully manage service
Amazon FSx for Windows File Server
- FSx for Windows is fulle managed Windows file system share drive
- Microsoft Active Directory integration,ACL
- Can be mounted on Linux EC2 instances
- Storage options: SSD and HDD
- Can be accessed from your on-premises infrastructure
- Can be configured to be Multi-AZ
What is Amazon FSx for Lustre?
- Lustre is a type of parallel distributed file system, large-scale computing
- The name Lustre is derived from “Linux” and “cluster”.
- Machine learning, High Performance Computing(HPC)
- Storage options: SSD,HDD
- Seamless integration with S3.
- Can “read S3” as a file system
- Can write the output of he computations back to S3 - Can be used from on-premises servers
FSx File System Deployment Options
- Scratch File System
FSx File System Deployment Options
1) Scratch File System
- Temporary storage
- Data is not replicated
- High burst
- Usage: short-term processing,optimize cost
2) Persistent File System
- Long-term storage
- Data is replicated within same AZ
- Replace failed files with minutes
- Usage: long-term processing,sensitve data
What is AWS Storage Gateway and name 3 types?
P175
- AWS Storage Gateway is a bridge between on-premises data and cloud data in S3.
- Use cases: disaster recovery,backup & rstore,tiered storage
- 3 types of Storage Gateway:
1) File Gateway
2) Volume Gaetwau
3) Tape Gateway
What is File Storage Gateway?
- Configured S3 buckets are accessible using the NFS and SMB protocol
- Supports S3 standard
- Bucket access using IAM roles
- Most recently used data is cached
- Can be mounted on many servers
What is Volume Storage Gateway?
P175
- Block storage using iSCSl protocol by S3.
- Backed by EBS snapshot which can help restore on-premises volumes
- Cached volumes: low latency access to most recent data
- Stored volumes: entire dataset is on premise, scheduled backup to S3.
What is Tape Storage Gateway?
- Some companies do backups on tapes
- With Tape Gateway, companies use the same processes but in the cloud.
- Virtual Tape Library(VTL) backed by Amazon S3 and Glacier.
What is AWS Transfer Family?
P178
- A fully managed service for file transfer in and out of AWS S3 and AWS EFS
- Supports Protocols:
- AWS Transfer for FTP(not encrypted)
- AWS Transfer for FTPS(Encrypted,Over SSL)
- AWS Transfer for SFTP(Secure File Transfer Protocol) - Store and manage users credentials within the service
- Usage:sharing files, public datasets,CRM
Storage Comparison
- S3: object Storage
- Glacer: Object Archival
- EFS: Network File System for Linux instances, POSIX filesystem
- FSx for Windows: Network File System for Windows servers
- FSx for Lustre: High Performance Computing Linux file system
- EBS volumes: Network storage for one EC2 instanse at a time.
- Instance Storage: physical storage for your EC2 instance(high IOPS)
- Storage Gateway: File Gateway, Volume Gateway(cache & stored) Tape Gateway
- Snowball/Snowmobile: to move large amount of data to the cloud,physically
- Database: for specific workloads,usually with indexing and querying.
