Amazon Simple Storage Service (S3) | Amazon S3 Transfer Acceleration Flashcards
What is the pricing for CRR?
Amazon S3 Transfer Acceleration
Amazon Simple Storage Service (S3) | Storage
You pay the Amazon S3 charges for storage, copy requests, and inter-region data transfer for the replicated copy of data. Copy requests and inter-region data transfer are charged based on the source region. Storage for replicated data is charged based on the target region. For more information, please visit the S3 pricing page.
If the source object is uploaded using the multipart upload feature, then it is replicated using the same number of parts and part size. For example, a 100 GB object uploaded using the multipart upload feature (800 parts of 128 MB each) will incur request cost associated with 802 requests (800 Upload Part requests + 1 Initiate Multipart Upload request + 1 Complete Multipart Upload request) when replicated. You will incur a request charge of $0.00401 (802 requests x $0.005 per 1,000 requests) and a charge of $2.00 ($0.020 per GB transferred x 100 GB) for inter-region data transfer. After replication, the 100 GB will incur storage charges based on the destination region.
What is Transfer Acceleration?
Amazon S3 Transfer Acceleration
Amazon Simple Storage Service (S3) | Storage
Amazon S3 Transfer Acceleration enables fast, easy, and secure transfers of files over long distances between your client and your Amazon S3 bucket. Transfer Acceleration leverages Amazon CloudFront’s globally distributed AWS Edge Locations. As data arrives at an AWS Edge Location, data is routed to your Amazon S3 bucket over an optimized network path.
How do I get started with Transfer Acceleration?
Amazon S3 Transfer Acceleration
Amazon Simple Storage Service (S3) | Storage
It’s easy to get started with Transfer Acceleration. First, enable Transfer Acceleration on an S3 bucket using the Amazon S3 console, the Amazon S3 API, or the AWS CLI. After Transfer Acceleration is enabled, you can point your Amazon S3 PUT and GET requests to the s3-accelerate endpoint domain name. Your data transfer application must use one of the following two types of endpoints to access the bucket for faster data transfer: .s3-accelerate.amazonaws.com or .s3-accelerate.dualstack.amazonaws.com for the “dual-stack” endpoint. If you want to use standard data transfer, you can continue to use the regular endpoints.
There are certain restrictions on which bucket will work with transfer acceleration. For details, please refer the Amazon S3 developer guide here.
How fast is Transfer Acceleration?
Amazon S3 Transfer Acceleration
Amazon Simple Storage Service (S3) | Storage
Transfer Acceleration helps you fully utilize your bandwidth, minimize the effect of distance on throughput, and is designed to ensure consistently fast data transfer to Amazon S3 regardless of your client’s location. Acceleration primarily depends on your available bandwidth, the distance between the source and destination, and packet loss rates on the network path. Generally, you will see more acceleration when the source is farther from the destination, when there is more available bandwidth, and/or when the object size is bigger.
One customer measured a 50% reduction in their average time to ingest 300 MB files from a global user base spread across the US, Europe, and parts of Asia to a bucket in the Asia Pacific (Sydney) region. Another customer observed cases where performance improved in excess of 500% for users in South East Asia and Australia uploading 250 MB files (in parts of 50MB) to an S3 bucket in the US East (N. Virginia) region.
Try the speed comparison tool to get a preview of the performance benefit from your location!
Who should use Transfer Acceleration?
Amazon S3 Transfer Acceleration
Amazon Simple Storage Service (S3) | Storage
Transfer Acceleration is designed to optimize transfer speeds from across the world into S3 buckets. If you are uploading to a centralized bucket from geographically dispersed locations, or if you regularly transfer GBs or TBs of data across continents, you may save hours or days of data transfer time.
How secure is Transfer Acceleration?
Amazon S3 Transfer Acceleration
Amazon Simple Storage Service (S3) | Storage
Transfer Acceleration provides the same security as regular transfers to Amazon S3. All Amazon S3 security features, such as restricting access based on a client’s IP address, are supported as well. Transfer Acceleration communicates with clients over standard TCP and does not require firewall changes. No data is ever saved at AWS Edge Locations.
What if Transfer Acceleration isn’t faster?
Amazon S3 Transfer Acceleration
Amazon Simple Storage Service (S3) | Storage
Each time you use Transfer Acceleration to upload an object, we will check whether Transfer Acceleration is likely to be faster than a regular Amazon S3 transfer. If we determine that Transfer Acceleration is not likely to be faster than a regular Amazon S3 transfer of the same object to the same destination AWS region, we will not charge for that use of Transfer Acceleration for that transfer, and may bypass the Transfer Acceleration system for that upload.
Can I use Transfer Acceleration with multipart uploads?
Amazon S3 Transfer Acceleration
Amazon Simple Storage Service (S3) | Storage
Yes, Transfer Acceleration supports all bucket level features including multipart upload.
How should I choose between Transfer Acceleration and Amazon CloudFront’s PUT/POST?
Amazon S3 Transfer Acceleration
Amazon Simple Storage Service (S3) | Storage
Transfer Acceleration optimizes the TCP protocol and adds additional intelligence between the client and the S3 bucket, making Transfer Acceleration a better choice if a higher throughput is desired. If you have objects that are smaller than 1GB or if the data set is less than 1GB in size, you should consider using Amazon CloudFront’s PUT/POST commands for optimal performance.
How should I choose between Transfer Acceleration and AWS Snowball?
Amazon S3 Transfer Acceleration
Amazon Simple Storage Service (S3) | Storage
The AWS Import/Export Snowball is ideal for customers moving large batches of data at once. The AWS Snowball has a typical 5-7 days turnaround time. As a rule of thumb, Transfer Acceleration over a fully-utilized 1 Gbps line can transfer up to 75 TBs in the same time. In general, if it will take more than a week to transfer over the Internet, or there are recurring transfer jobs and there is more than 25Mbps of available bandwidth, Transfer Acceleration is a good option. Another option is to use both: perform initial heavy lift moves with an AWS Snowball (or series of AWS Snowballs) and then transfer incremental ongoing changes with Transfer Acceleration.
Can Transfer Acceleration complement AWS Direct Connect?
Amazon S3 Transfer Acceleration
Amazon Simple Storage Service (S3) | Storage
AWS Direct Connect is a good choice for customers with a private networking requirement or have access to AWS Direct Connect exchanges. Transfer Acceleration is best for submitting data from distributed client locations over the public Internet, or where variable network conditions make throughput poor. Some AWS Direct Connect customers use Transfer Acceleration to help with remote office transfers, where they may suffer from poor Internet performance.
Can Transfer Acceleration complement the AWS Storage Gateway or a 3rd party gateway?
Amazon S3 Transfer Acceleration
Amazon Simple Storage Service (S3) | Storage
If you can configure the bucket destination in your 3rd party gateway to use an S3 Transfer Acceleration endpoint domain name you will see the benefit.
Visit this File section of the Storage Gateway FAQ to learn more about the AWS implementation.
Can Transfer Acceleration complement 3rd party integrated software?
Amazon S3 Transfer Acceleration
Amazon Simple Storage Service (S3) | Storage
Yes. Software packages that connect directly into Amazon S3 (read more about storage partner solutions here) can take advantage of Transfer Acceleration when they send their jobs to Amazon S3.
