Technology - Migration, Transfer & Analytics Flashcards
DMS
Database Migration Service. Helps you migrate on-prem databases to or within AWS, supporting both homo and heterogeneous migrations.
Provides continuous data replication and virtually no downtime.
SMS
Server Migration Service. Allows to migrate on-prem servers to AWS.
Servers are saved as a new Amazon Machine Image (AMI). You can use AMI to launch servers as EC2 instances.
AWS Snow Family
Snowcone
Snowball
Snowmobile
Physical devices to facilitate data transfer and migration of large amounts of on-prem data where traditional internet transfers are not feasible or efficient.
Snowcone
Holds 8 terabytes of usable storage. Designed for edge computing and data transfer in remote or disconnected environments.
Snowball and Snowball Edge
Petabyte-scale transport solution. Transfers data in and out where high-speed internet may not be available or cost-effective.
Snowball Edge supports EC2 and Lambda. Used for data transfers but also edge computing - local processing to run apps when in a remote environment.
Snowmobile
Multi-petabyte or exabyte scale used to securely transfer entire datacentres to AWS. Data is loaded to S3.
DataSync
Allows for online data transfer from on-prem to AWS storage services like S3 or EFS.
You can copy data over Direct Connect or the internet, copy the data over AWS storage services or replicate cross-Region or cross-account.
Data warehouse
A data storage solution that aggregates massive amounts of historical data from disparate sources.
Redshift
A scalable data warehousing solution handling exabyte-scale data.
Redshift Use Cases
- Data consolidation - multiple data sources.
- Relational databases - run a database that doesn’t require real-time transaction processing.
Athena
A serverless query service for S3 using standard SQL. You pay per query.
Glue
An ETL service (extract, transform, load) that prepares data for analytics.
Kinesis
Allows you to analyse data and video streams in real time, supporting video, audio, apps logs, website clickstreams and IoT.
EMR
Elastic MapReduce. Helps to process large amount of data (data mining, ML etc.).
Works with Hadoop (clusters of computers) and other big data frameworks.
Data Pipeline
Helps to move data between compute and storage services running on AWS or on-prem.
Move data in intervals or based on conditions, and send notifications.