Migration, Machine Learning, and More Flashcards
Virtual Private Networks (VPN):
Virtual Private Networks (VPN):
- A virtual private network allows you to connect a VPC to an external network, such as a data center or office, via a secure connection that traverses the public internet
- VPN connections are encrypted
Direct Connect:
Direct Connect:
- Provides private network connectivity to your VPC and public services such as Amazon S3 and Glacier
- It does not provide internet access, so if you need it you still need an internet access
- Direct Connect operates using a dedicated link that operates at 1 or 10 Gbps - because of this it’s not subject to the high and unpredictable latency of a broadband internet connection
- These take time to setup, think months, so if you see a question says I need to move data quickly in the next week or days, this isn’t the option unless its already setup.
AWS Migration Hub:
AWS Migration Hub
Overall view that connects AWS Services together
AWS Database Migration Services (DMS)
AWS Database Migration Services (DMS)
-migrates across to a service such as Redshift, Amazon RDS, etc
- Sometimes data cannot be migrated ‘directly’ from one database to another b/c they have different schemas.
- —>Need to use the Schema Conversion Tool for heterogeneous migrations
AWS Server Migration Service (SMS)
AWS Server Migration Service (SMS)
- Migrates virtual machines and physical servers into Amazon EC2
- —>Ex: Vmware vSpherer, Microsoft Hyper-V/SCVMM, Azure
-AWS SMS Connector is installed in the data center (Vmware, Hyper-V) to connect you to the AWS Server Migration Service
AWS SMS CONNECTOR:
- —>Amazon machine image is created for each of your virtual machines or physical servers in your on-premises environment
- —>Automated process that is incremental and scheduled migrations
- Once servers are launched into Amazon Machine Image you can then launch EC2 instances form the AMI
- Datacenter with AWS SMC Connecter installed—>AWS Server Migration Service—>Amazon Machine Image—>EC2 Instances
AWS DataSync:
AWS DataSync
-Synchronizes data from ON-PREM STORAGE SYSTEM to the cloud (Amazon S3 and EFS)
- DataSync SOFTWARE AGENT connects to the storage system to enable AWS DataSync to synchronize storage into the cloud
- —>Data moving from AWS DataSync to the cloud is always encrypted in transit with TLS
-DataSync transfers can be scheduled and automated
- DataSync Agent can be installed on Snowcone
- —>Snowcone then connects to Datasync and synchronize your data into S3
AWS Snowball Family:
AWS Snowball Family:
- Uses secure storage devices for physical transportation
- Snowball Client is software that is installed on a local computer
- Used to identify, compress, encrypt, and transfer data
- Uses strong encryption algorithms (256-bit encryption) managed w/ the AWS KMS and tamper-resistant enclosures w/ TPM
AWS Snowball VS AWS Snowmobile VS Snowball Edge VS Snowcone
AWS Snowball
- HARDWARE appliance designed to move massive amounts of data between your site and the AWS Cloud in a short time
- Snowball and Snowball Edge are measured in petabyte scale (80TB) (50TB)
Snowmobile
- Large truck with a container on the back used for transferring data
- Snowmobile measured in exabyte scale w/ up to 100PB per Snowmobile
Snowball Edge
- Like a Snowball but offers a wider variety of features
- Snowball edge offers the same network connectivity options as Snowball BUT adds a QSFP+ port allowing you to achieve faster network speeds than Snowball.
- —>Can also run Lambda functions.
Snowball Edge Compute Optimized
- Provides block and object storage and optional GPU
- Used for:
- —>data collection
- —>machine learning and processing
- —>Storage in environments w/ intermittent connectivity (edge use cases)
Snowball Edge Storage Optimized
- Provides block storage and Amazon S3-compatible object storage
- Used for:
- —>Local storage
- —>Large-scale data transfer
Snowcone
- Small Device
- Less than 50TB (petabyte) of data
- Can transfer data offline or online w/ AWS DataSync agent
- Used for:
- —>edge computing
- —>Storage
- —>data transfer
AWS Rekognition:
AWS Rekognition
- Identify objects, people, text, scenes, and activities in images and videos
- Adds image and video analysis to your applications
- Processes videos stored in an Amazon S3 bucket
- Publish completion status to Amazon SNS Topic
- Upload to S3 triggers a Lamda function
- –>Lamda passes image to Amazon Rekognition to analyze the image
- ——>Amazon Rekognition publishes result to an SNS topic
- ———->Lamda function processes the results and creates an item in Dynamo DB
Amazon Transcribe:
Amazon Transcribe
- Adds speech to text capabilities to applications
- Recorded speech can be converted to text before it can be used in applications
- Uses a deep learning process called automatic speech recognition (ASR) to convert speech to text quickly and accurately
Amazon Translate:
Amazon Translate
- Neural machine translation service that delivers fast, high-quality, and affordable language translation
- Uses deep learning models to deliver more accurate and more natural sounding translation
- Localize content such as websites and applications for your diverse users
Amazon SageMaker
Amazon SageMaker
-Helps data scientists and developers to prepare, build, train, and deploy high-quality machine learning (ML) models
- ML development activities include:
- —>Data preparation
- —>Feature engineering
- —>Statistical bias detection
- —>Auto-ML
- —>Training and tuning
- —> Hosting
- —>Monitoring
- —>Workflows
Amazon Comprehend:
Amazon Comprehend
- Natural-language processing (NLP) service
- Uses machine learning to uncover information in unstructured data
- Can identify critical elements in data, including references to language, people, and places
- —>the text files can be categorized by relevant topics
-In real time, you can automatically and accurately detect customer sentiment in your content
Amazon Lex:
Amazon Lex
- Conversational AI for Chatbots
- Build conversational interfaces into application using voice and text
- Build bots to increase contact center productivity, automate simple tasks, and drive operational efficiencies across the enterprise
Amazon Polly:
Amazon Polly
- Turns text into lifelike speech
- Create applications that talk, and build entirely new categories of speech enabled products
- Text-to-Speech (TTS) services uses advanced deep learning technologies to synthesize natural sounding human speech