EC2 HPC

Question 1

What are the 4 main areas in which AWS can best help you achieve HPC?

Answer 1

• Data Transfer
• Compute and Networking
• Storage
• Orchestration and Automation

Question 2

What are the services AWS offers to assist with Data Transfer for HPC?

Answer 2

• Snowball / Snowmobile (good for terabyltes / petabytes of data)
• AWS DataSync to store on S3, EFS, FSx for Windows, etc.
• AWS DirectConnect

Question 3

What are the services Amazon offers to assist with compute & networking for HPC?

Answer 3

• EC2 instances that are GPU- or CPU-optimized
• EC2 fleets (Spot Instances / Spot Fleets)
• Cluster Placement Groups
• EN (Enhansed Networking)
• ENA (Elastic Network Adapter)
• EFA (Elastic Fabric Adapter)

Question 4

What are the services AWS offers to assist with storage for HPC?

Answer 4

• Instance-attached storage:
  
  • EBS: Scale up to 64,000 IOPS with Provisioned IOPS
  • Instance Store: Scale to millions of IOPS; low latency
• Network Storage:
  
  • S3: Distributed Object-based storage; not a file system
  • EFS: Scale IOPS based on total size, or use provisioned IOPS
  • FSx for Lustre: HPC-optimized distributed file system; millions of IOPS, which is also backed by S3

Question 5

What are the services AWS offers to assist with Orchestration and Automation for HPC?

Answer 5

• AWS Batch
• AWS ParallelCluster