S3 - Advanced Flashcards
How can you move objects between storage tiers in S3?
Use the Lifecycle Rules.
In which order can you move the obejcts in S3?
Standard -> Standard IA -> Glaciier / Glacier Deep Archive
Whats the 2 type of S3 Lifecycl Rules?
- Transition Actions – configure objects to transition to another storage class
- Move objects to Standard IA class 60 days after creation
- Move to Glacier for archiving after 6 months
- Expiration actions – configure objects to expire (delete) after some time
- Access log files can be set to delete after a 365 days
- Can be used to delete old versions of files (if versioning is enabled)
- Can be used to delete incomplete Multi-Part uploads
What are the 2 rule to match for S3 Lifecycle Rules you can configure?
- Certain prefix
- Certain object tags
What is S3 Analytics – Storage Class Analysis?
Tool to help decide when to transitaion objects to right storage class.
Recommendation for Standard and Standard IA.
Daily updated reports.
What are S3 event notifications?
Create custom S3 events for specific s3 actions. You can send notifications to SNS, SQS and Lambda about the events.
Use case: generate thumbnails of images
Why is Amazon Event Bridge used with S3 Event Notifications?
- Advanced filtering options with JSON rules (metadata, object size, name…)
- Multiple Destinations – ex Step Functions, Kinesis Streams / Firehose…
- EventBridge Capabilities – Archive, Replay Events, Reliable delivery
What is the baseline preformance of S3?
Each prefix can handle 5500 GET/HEAD request per second in a bucket.
Latency 100-200ms.
How to increase the upload into S3?
- Multi-Par upload:
- recomm. > 100MB
- parallellize uploads
- S3 Transfer Acceleration
- File in USA -> Edge Location uSA -> S3 bucket in Australia
- Compatible w Multi-Part uplaod
What is S3 Byte-Range Fetches?
- Parallellize GETS by requesting specific byte ranges
- Can be used to speed up downloads
- Can be user to retrive only partial data (head of the file)
What is S3 Select & Glacier Select?
- Retrive less data using SQL by performing server side filtering
- Less network transfer, lest cpu cost client side
What are S3 User-defined Object Metadas?
- When uploading an object, you can also assign metadata
- Name-value (key-value) pairs
- User-defined metadata names must begin with “x-amz-meta-”
- Amazon S3 stores user-defined metadata keys in lowercase
- Metadata can be retrieved while retrieving the object
What are S3 User-defined Object Tags?
- Key-value pairs for objects in Amazon S3
- Useful for fine-grained permissions (only access specific objects with specific tags)
- Useful for analytics purposes (using S3 Analytics to group by tags)
Can you search Object Metadata or object tags in S3?
No you cant. Instead you must use an external db as a search index.