Amazon Elastic Compute Cloud
lastmod 2026-02-13created 2021-03-1212 edits
Amazon Elastic Compute Cloud forms the central part of Amazon Web Services, Amazon.com's cloud computing platform, and lets users rent virtual computers on which to run their own computer applications.
Categories
- EC2:GettingStarted - How to get started with EC2.
- EC2:InstanceType - How to check and estimate instance types
- AWS:Credit - Credits
- EC2 Computing Unit (ECU)
- AWS Management Console
GPU Instances
GPU instances suit most deep learning purposes. Training new models is faster on GPU instances than on CPU instances. You can scale sub-linearly when you have multiple GPU instances or when you use distributed training across many instances with GPUs.
| INFORMATION |
| Choose an instance with the size of your model in mind. If your model exceeds the instance's available RAM, choose a different instance type with enough memory for your application. |
- Amazon EC2 P6-B200 instances have up to 8 NVIDIA Blackwell B200 GPUs.
- Amazon EC2 P6e-GB200 instances have up to 4 NVIDIA Blackwell GB200 GPUs.
- Amazon EC2 P5e instances have up to 8 NVIDIA Tesla H200 GPUs.
- Amazon EC2 P5 instances have up to 8 NVIDIA Tesla H100 GPUs.
- Amazon EC2 P4 instances have up to 8 NVIDIA Tesla A100 GPUs.
- Amazon EC2 P3 instances have up to 8 NVIDIA Tesla V100 GPUs.
- Amazon EC2 G3 instances have up to 4 NVIDIA Tesla M60 GPUs.
- Amazon EC2 G4 instances have up to 4 NVIDIA T4 GPUs.
- Amazon EC2 G5 instances have up to 8 NVIDIA A10G GPUs.
- Amazon EC2 G6 instances have up to 8 NVIDIA L4 GPUs.
- Amazon EC2 G6e instances have up to 8 NVIDIA L40S Tensor Core GPUs.
- Amazon EC2 G5g instances are equipped with Arm64-based AWS Graviton2 processors.
See Nvidia:Tesla#Compare Table for a comparison of NVIDIA graphics cards.