Storage | AWS Snowball Edge Flashcards
What is Snowball Edge?
General
AWS Snowball Edge | Storage
Snowball Edge is a 100TB data transfer device with on-board storage and compute power for select AWS capabilities. In addition to transferring data to AWS, Snowball Edge can undertake local processing and edge-computing workloads. Features include an S3-compatible end-point on the device, a file interface with NFS support, a cluster mode where multiple Snowball Edge devices can act as a single, scalable, storage and compute pool with increased durability, and the ability to run Lambda functions as data is copied to the device.
How does Snowball Edge work?
General
AWS Snowball Edge | Storage
You start by requesting one or more Snowball Edge devices in the AWS Management Console based on how much data you need to transfer or process. The buckets and Lambda functions you select are automatically configured, encrypted and preinstalled on your devices before they are shipped to you. Once a device arrives, connect it to your local network and set the IP address either manually or automatically with DHCP. The same is true for setting up a cluster. Then use the Snowball Edge client software, job manifest, and unlock code to verify the integrity of the Snowball Edge device or cluster, and unlock it for use. The manifest and unlock code are uniquely generated and crypto-logically bound to a designated Snowball Edge to help ensure that both cannot be used with any other devices. Data copied to Snowball Edge is automatically encrypted and stored in the buckets you specify.
All logistics and shipping is done by Amazon so when copying is complete and the device is ready to be returned, the E Ink shipping label will automatically update the return address to help ensure that the Snowball Edge device is delivered to the correct AWS facility. Once the device ships, you can receive tracking status via messages sent by Amazon Simple Notification Service (Amazon SNS), generated texts and emails, or directly from the console.
All of the management for your Snowball Edge resources can be performed in the AWS management console and these operations require no on-site system engineers.
Who should use Snowball Edge?
General
AWS Snowball Edge | Storage
Snowball Edge is the optimal data transfer choice if you need to securely and quickly transfer terabytes to petabytes of data to AWS. You can use Snowball Edge if you have a large backlog of data to transfer or if you frequently collect data that needs to be transferred to AWS and your storage is in an area where high-bandwidth Internet connections are not available or cost-prohibitive. You can also use Snowball Edge to run edge computing workloads such as performing local analysis of your data using Lambda functions, backed by a Snowball Edge cluster with increased durability and an S3-compatible endpoint. You can streamline it into existing workflows leveraging built-in capabilities such as the NFS file interface and migrate files to the device while maintaining file metadata. Snowball Edge can operate in remote locations or harsh operating environments, such as factory floors, oil & gas rigs, mining sites, hospitals, and on moving vehicles. Snowball Edge is pre-configured and does not have to be connected to the internet, so processing and data collection can take place within isolated operating environments. Snowball Edge allows you to run the same software at the edge and access select AWS capabilities as you do when you have full connectivity to AWS.
Can I use Snowball Edge to migrate data from one AWS region to another AWS region?
General
AWS Snowball Edge | Storage
No. Snowball Edge is intended to serve as a data transport solution for moving high volumes of data into and out of a designated AWS region. For use cases that require data transfer between AWS regions, we recommend using S3 Cross-Region Replication as an alternative.
How much data can I transfer using Snowball Edge?
General
AWS Snowball Edge | Storage
You can transfer virtually any amount of data with Snowball Edge, from a few terabytes to many petabytes. You can transfer up to 100TB with a single Snowball Edge and transfer larger data sets with multiple devices, either in parallel, or sequentially. For example, you can transfer 1PB of data with 10 Snowball Edge devices.
How long does it take to transfer my data?
General
AWS Snowball Edge | Storage
Data transfer speed is affected by a number of factors including local network speed, file size, and the speed at which data can be read from your local servers. The end-to-end time to transfer 100 TB of data into AWS with Snowball Edge is approximately a week, including the usual shipping and handling time in AWS data centers.
How long can I have a Snowball Edge for a specific job?
General
AWS Snowball Edge | Storage
Snowball Edge devices must be returned within 360 days of the Snowball Edge’s preparation.
What are the specifications of the Snowball Edge?
General
AWS Snowball Edge | Storage
Snowball Edge provides 100TB of storage in a ruggedized, rack mountable, shippable form factor. Additionally, it provides local compute capability that is approximately the equivalent of an EC2 m4.4xlarge instance that provides support for a number of additional functions. Check the Snowball Edge documentation page for a complete list of hardware specs, including network connections, thermal and power requirements, decibel output, and dimensions.
What network interfaces does Snowball Edge support?
General
AWS Snowball Edge | Storage
Snowball Edge includes a 10GBase-T network connection, 10/25Gb SFP28 and 40Gb QSFP+ copper, and optical networking for fast data transfer rates.
What is Snowball Edge default shipping option? Can I choose expedited shipping?
Regional Availability
AWS Snowball Edge | Storage
As a default, Snowball Edge uses two-day shipping by UPS. You can choose expedited shipping if your jobs are time-sensitive.
In what regions is Snowball Edge available?
Regional Availability
AWS Snowball Edge | Storage
Check the Regional Service Availability pages for the latest information.
We regret that we cannot provide the service at this time in all US states.
Can a Snowball Edge be shipped to an alternate AWS region?
Security
AWS Snowball Edge | Storage
No. Snowball Edge devices are designed to be requested and used within a single AWS region. It may not be requested from one region and returned to another. Snowball Edge devices used for imports or exports from an AWS region in the EU may be used with any of the 28 EU countries.
Does Snowball Edge encrypt my data?
Security
AWS Snowball Edge | Storage
Snowball Edge encrypts all data with 256-bit encryption. You manage your encryption keys by using the AWS Key Management Service (AWS KMS). Your keys are never stored on the device and all memory on a Snowball is erased when it is disconnected and to be returned to AWS.
How does Snowball Edge physically secure my data?
Security
AWS Snowball Edge | Storage
In addition to using a tamper-resistant enclosure, Snowball Edge uses industry-standard Trusted Platform Modules (TPM) designed to detect any unauthorized modifications to the hardware, firmware, or software. AWS visually and cryptographically inspects every device for any signs of tampering and to verify that no changes were detected by the TPM.
How does Snowball Edge help digitally secure my data?
Security
AWS Snowball Edge | Storage
Snowball Edge is designed with security in mind for the most sensitive data. All data is encrypted by keys provided by you through AWS Key Management Service (KMS). The keys are not permanently stored on the device and are erased after loss of power. Applications and Lambda functions run in a physically isolated environment and do not have access to storage. Lastly, after your data has been transferred to AWS, your data is erased from the device using standards defined by National Institute of Standards and Technology. Snowball Edge devices are hardened against attack and all configuration files are encrypted and signed with keys that are never present on the device.
Is there a way to easily track my data transfer jobs?
Import Data with Snowball Edge
AWS Snowball Edge | Storage
Snowball Edge uses an innovative, E Ink shipping label designed to ensure the device is automatically sent to the correct AWS facility. When you have completed your data transfer job, you can track it by using Amazon SNS generated text messages or emails, and the console.
How do I transfer my data to the Snowball Edge?
Import Data with Snowball Edge
AWS Snowball Edge | Storage
After you have connected and activated the Snowball Edge, you can transfer data from local sources to the device through the S3-compatible endpoint or the NFS file interface, both available on the device. You can also use the Snowball client to copy data. To learn more, please refer to the Snowball Edge documentation.
What do I do when the data has been transferred to the Snowball Edge?
Export Data with Snowball Edge
AWS Snowball Edge | Storage
When the data transfer job is complete, the E Ink display on the Snowball Edge automatically updates the return shipping label to indicate the correct AWS facility to ship to. Just drop off the Snowball Edge at the nearest UPS and you’re all set. You can track the status of your transfer job through Amazon SNS generated text messages or emails, or directly in the AWS Management Console.
What does it cost to export my data?
S3-compatible Endpoint
AWS Snowball Edge | Storage
In addition to the Snowball Export job fees detailed on our pricing page, you will also be charged all fees incurred to retrieve your data from Amazon S3.
What is the S3-compatible endpoint on Snowball Edge?
S3-compatible Endpoint
AWS Snowball Edge | Storage
The S3-compatible endpoint on Snowball Edge allows you to read and write data on the device using select S3 operations and client tools that support S3.
What S3 operations are supported by the S3-compatible endpoint on Snowball Edge?
S3-compatible Endpoint
AWS Snowball Edge | Storage
The S3-compatible endpoint supports the Get, Head, Put, Delete, List, and MultipartUpload operations of Amazon S3. You can execute these operations on the Snowball Edge as if you are accessing an S3 web service endpoint. In addition, you can point client tools that support S3 to the Snowball Edge to read and write data.
Why would I use the S3-compatible endpoint?
S3-compatible Endpoint
AWS Snowball Edge | Storage
The S3-compatible endpoint lets you transfer data programmatically using the S3 operations natively supported by the Snowball Edge. You can also seamlessly integrate Snowball Edge into your existing applications and workflows built for Amazon S3.
How is my data secured when I use the S3-compatible endpoint?
S3-compatible Endpoint
AWS Snowball Edge | Storage
Data transferred via the S3-compatible endpoint is protected by the same advanced security mechanism on the Snowball Edge, which encrypts all data with 256-bit encryption. You manage your encryption keys using the AWS Key Management Service (AWS KMS). Your keys are never stored on the device and all memory on the Snowball Edge is erased when it is unplugged.
Which programming languages does the S3-compatible endpoint support?
File Interface
AWS Snowball Edge | Storage
The S3-compatible endpoint supports the REST interface which is language-agnostic.
What is the file interface on Snowball Edge?
File Interface
AWS Snowball Edge | Storage
The file interface enables you to store and retrieve objects on Snowball Edge through standard file storage protocols. When the Snowball Edge is shipped back to AWS for data import, these objects will be ingested into Amazon S3, and can be accessed directly through S3 as normal. You can also access the objects as files, including the original file system metadata, through AWS Storage Gateway.
How do I use the file interface on Snowball Edge?
File Interface
AWS Snowball Edge | Storage
Once the Snowball Edge arrives at your site and has been unlocked, each of the S3 buckets is made available to your applications as an NFS export visible on the network to which the Snowball Edge is connected. You can use the local LCD display on the Snowball Edge to disable/enable the file interface. You can mount these NFS exports on your server, and your applications can read and write files as they would any other network shared file system. You can monitor the file interface status, and open a support channel through the LCD display.
What use cases does the file interface on Snowball Edge enable?
File Interface
AWS Snowball Edge | Storage
The file interface enables multiple use cases. It lets you ingest existing files into Amazon S3 as objects using a common file protocol (NFS), and preserves associated file metadata as object metadata. This offline bulk data transfer enables you to seed file data into S3, and use it for in-cloud workloads, such as Big Data processing. Alternatively, the transferred file data can be accessed from your sites for hybrid applications or workflows by using AWS Storage Gateway.
What are the benefits of the file interface on Snowball Edge?
File Interface
AWS Snowball Edge | Storage
The file interface on Snowball Edge enables your existing file-based applications, devices, and workflows to write data through standard file protocols, while also preserving metadata.
What file protocols are supported?
File Interface
AWS Snowball Edge | Storage
Snowball Edge supports clients connecting using NFS v3 and v4.1. Microsoft Windows clients that support NFS v3 can connect to Snowball Edge.
How are files stored on Snowball Edge?
File Interface
AWS Snowball Edge | Storage
Files are stored as objects in buckets on an AWS Snowball Edge appliance. File system metadata, such as permissions, ownership, and timestamps, is stored as user-defined object metadata. All data and metadata is encrypted when stored on the Snowball Edge.
How do I configure the file interface on the Snowball Edge?
File Interface
AWS Snowball Edge | Storage
You can use the local LCD display on the Snowball Edge to disable/enable the file interface, monitor the file interface status, and open a support channel.
Can I use both the file interface and the Amazon S3 Adapter for Snowball to write to a bucket on an AWS Snowball Edge appliance?
File Interface
AWS Snowball Edge | Storage
We recommend against writing to buckets on an AWS Snowball Edge appliance both directly and through the file interface. If you directly overwrite or update an object previously written by the file interface, it will result in undefined behavior when the object is accessed through the file interface. Concurrent modification of the same object (e.g. via the file interface and the Amazon S3 Adapter for Snowball) will lead to unpredictable results.