Compute | AWS Batch Flashcards
What is AWS Batch?
General Information
AWS Batch | Compute
AWS Batch is a set of batch management capabilities that enables developers, scientists, and engineers to easily and efficiently run hundreds of thousands of batch computing jobs on AWS. AWS Batch dynamically provisions the optimal quantity and type of compute resources (e.g., CPU or memory optimized instances) based on the volume and specific resource requirements of the batch jobs submitted. With AWS Batch, there is no need to install and manage batch computing software or server clusters, allowing you to instead focus on analyzing results and solving problems. AWS Batch plans, schedules, and executes your batch computing workloads using Amazon EC2 and Spot Instances.
What is Batch Computing?
General Information
AWS Batch | Compute
Batch computing is the execution of a series of programs (“jobs”) on one or more computers without manual intervention. Input parameters are pre-defined through scripts, command-line arguments, control files, or job control language. A given batch job may depend on the completion of preceding jobs, or on the availability of certain inputs, making the sequencing and scheduling of multiple jobs important, and incompatible with interactive processing.
What are the benefits of batch computing?
Why AWS Batch
AWS Batch | Compute
It can shift the time of job processing to periods when greater or less expensive capacity is available.
It avoids idling compute resources with frequent manual intervention and supervision.
It increases efficiency by driving higher utilization of compute resources.
It enables the prioritization of jobs, aligning resource allocation with business objectives.
Why should I use AWS Batch?
Why AWS Batch
AWS Batch | Compute
AWS Batch handles job execution and compute resource management, allowing you to focus on developing applications or analyzing results instead of setting up and managing infrastructure. If you are considering running or moving batch workloads to AWS, you should consider using AWS Batch.
What use cases is AWS Batch optimized for?
Features
AWS Batch | Compute
AWS Batch is optimized for batch computing and applications that scale through the execution of multiple jobs in parallel. Deep learning, genomics analysis, financial risk models, Monte Carlo simulations, animation rendering, media transcoding, image processing, and engineering simulations are all excellent examples of batch computing applications.
What are the key features of AWS Batch?
Features
AWS Batch | Compute
AWS Batch manages compute environments and job queues, allowing you to easily run thousands of jobs of any scale using Amazon EC2 and EC2 Spot. You simply define and submit your batch jobs to a queue. In response, AWS Batch chooses where to run the jobs, launching additional AWS capacity if needed. AWS Batch carefully monitors the progress of your jobs. When capacity is no longer needed, AWS Batch will remove it. AWS Batch also provides the ability to submit jobs that are part of a pipeline or workflow, enabling you to express any interdependencies that exist between them as you submit jobs.
What types of batch jobs does AWS Batch support?
Features
AWS Batch | Compute
AWS Batch supports any job that can executed as a Docker container. Jobs specify their memory requirements and number of vCPUs.
What is a Compute Resource?
Features
AWS Batch | Compute
An AWS Batch Compute Resource is an EC2 instance.
What is a Compute Environment?
Features
AWS Batch | Compute
An AWS Batch Compute Environment is a collection of compute resources on which jobs are executed. AWS Batch supports two types of Compute Environments; Managed Compute Environments which are provisioned and managed by AWS and Unmanaged Compute Environments which are managed by customers. Unmanaged Compute Environments provide a mechanism to leverage specialized resources such as Dedicated Hosts, larger storage configurations, and Amazon EFS.
What is a Job Definition?
Features
AWS Batch | Compute
A Job Definition describes the job to be executed, parameters, environmental variables, compute requirements, and other information that is used to optimize the execution of a job. Job Definitions are defined in advance of submitting a job and can be shared with others.
What is the Amazon ECS Agent and how is it used by AWS Batch?
Features
AWS Batch | Compute
AWS Batch uses Amazon ECS to execute containerized jobs and therefore requires the ECS Agent to be installed on compute resources within your AWS Batch Compute Environments. The ECS Agent is pre-installed in Managed Compute Environments.
How does AWS Batch make it easier to use EC2 Spot?
Pricing
AWS Batch | Compute
AWS Batch Compute Environments can be comprised of EC2 Spot instances. When creating a Managed Compute Environment, simplify specify that you would like to use EC2 Spot and provide a percentage of On Demand pricing that you would like to bid and AWS Batch will take care of the rest. Unmanaged Compute Environments can also include Spot instances that you launch, including those launched by EC2 Spot Fleet.
What is the pricing for AWS Batch?
Getting Started
AWS Batch | Compute
There is no additional charge for AWS Batch. You only pay for the AWS Resources (e.g. EC2 Instances) you create to store and run your batch jobs.
How do I get started?
Getting Started
AWS Batch | Compute
Follow the Getting Started Guide in our documentation to get started.
