Storage Flashcards
Amazon S3 (Simple Storage Service)
A highly available object based storage service for the cloud
Objects (files) are stored in buckets(directories)
Essentially unlimited storage that can hold millions of objects per bucket
Objects can be public or private
You can upload objects via the console, cli, or programmatically from w/in code using sdks
You can set security at the bucket level, or individual object level using access control lists (ACLs), bucket policies, or access point policies
There are access logs to track access to buckets or objects
You can enable versioning to create multiple versions of your file in order to protect against accidental deletions and to keep older versions
S3 is a regional service but buckets must be globally uniquely named
Availability
Ability to access data quickly when you need it. S3 availability standard is 99.99%
This is a regional service that replicates data across the region. Cross region replication can be configured.
Durability
The safety of your objects from loss or or being compromised. S3 guarantees 11 9s of durability.
This is a regional service and it will replicate across the region. Cross region replication can be configured.
S3 Standard
General purpose storage, data is stored across multiple AZs. Has 11 9s durability 99.99 availability, with low latency and high throughput.
Recommended for frequently accessed data
S3 Intelligent Tier
Recommended for data with unknown or changing access patterns.
Automatically moves data too the most cost effective storage class.
Automatic cost savings.
S3 Standard Infrequent Access
Recommended for long lived data, that’s infrequently accessed, millisecond access where needed.
Data stored across multiple AZs
Cheaper than S3 standard, 1a 9s durability 99.9 availability
S3 One Zone Infrequent Access
Recommended for recreatable data, infrequently accessed with millisecond access, availability and durability not essential
Like S3 Standrd IA but data is stored in a single AZ
Costs 20% than S3 Standard IA
Data stored in this storage class can be lost
11 9s durability 99.5 availability
S3 Glacier
Recommended for long term backups & cheaper storage options
Data retrieval takes longer with 3 options: 1-5 minutes, 3-5 hours, or 5-12 hours
Data is stored across multiple AZs
Durability 11 9s
S3 Glacier Deep Archive
Recommended for long term data archival accessed once or twice a year, retaining data for regulatory compliance requirements.
Like S3 glacier but longer access times,
2 options - 12 hours and 48 hours
Cheapest of all S3 options
Data stored across multiple AZs with 11 9s durability
S3 Outposts
Recommended for data that needs to be kept local for demanding app performance needs
Use Case for S3: Static Websites
Deploy static websites to S3 & use cloud front for global distribution
Use Case for S3: Data Archive
Archive data using Glacier as a storage option for Amazon S3
Use Case S3: Analytics Systems
Store data in Amazon S3 for use w/ analytics services like redshift or athena
Use Case S3: Mobile Apps
Mobile apps users can upload files to an S3 bucket
EC2 Storage
Supports different storage solutions for instances.
EBS, EFS, Instance Stores, etc.
Amazon Elastic Block Store EBS
EBS is a storage device (called a volume) that can be attached to or removed from your instance.
Data persists when the instance is not running, but is tied to only one AZ.
Can only be attached to an instance in the same AZ
Recommended for quickly accessible data, running a DB on an instance, long term data storage
EC2 Instance Store
Local storage that is physically attached to the host computer and cannot be removed
Storage on disks physically attached to an instance
Faster w/ higher IO speeds
Storage is temporary as the data does not persist when the instance is turned off
Recommended for temp storage needs and data that needs to be replicated across multiple instances
Amazon Elastic File System EFS
EFS is a server-less network file system for sharing files
Only supports Linux file systems
More Expensive than EBS
Accessible across different AZs in the same region
Recommended for main directories for business critical apps & lift & shift existing enterprise apps
Storage Gateway
Hybrid storage service
Connect on-prem and cloud data
Recommended for moving backups to the cloud, reducing costs of hybrid cloud storage, low latency access to data
AWS Backups
Helps manage data backups across multiple AWS Services.
Integrates with resources like EC2, EBS, EFS, and more
Create a back up plan that includes frequency and retention
Content Delivery Network (CDN)
A CDN is a mechanism to deliver content quickly and efficiently based on Geographic Location
Amazon Cloudfront
A CDN that delivers data and apps globally with low latency.
You can make it only available locally by using location based restrictions.
Speeds up the delivery of static and dynamic web content
Uses edge locations to cache content for faster delivery
Amazon Global Accelerator
Global Accelerator sends your users through the AWS global network when accessing your content, speeding up delivery
Improves latency and availability of single region apps
Sends traffic through the AWS global network infrastructure
Gives a 60% performance boost
Automatically reroutes traffic to healthy available regional endpoints
Amazon S3 Transfer Acceleration
Improves content uploads & downloads to & from S3 buckets
Fast transfer of files over long distances
Uses Cloudfront globally distributed edge networks
Customers from around the world can upload to a central bucket
Snowcone
Smallest member of data transport devices
8 terabytes of usable storage
Offline shipping - can choose to ship offline
Online w/ data sync - essentially you have the option to use data sync
Snowball and Snowball Edge
Petabyte scale data transport solution
Transfer data in and out
Cheaper than internet transfer
Snowball edge supports EC2 and Lambda
Also has an edge computing device that allows you to run EC2 and lambda as it has local processing
Snowmobile
Multi-petabyte or exabyte scale
Data loaded to S3
Securely transported, GPS tracking, alarms, and 24x7 video monitoring
Data sync
Allows for online data transfer from on-prem to AWS storage services like S3 or EFS
Can copy data over direct connect or internet
Copy data between AWS storage services
Replicate data across region or account