A100 SXM Specifications
The A100 SXM is ideal for large-scale model training and inference, providing 80-90% of the capabilities of newer H100s for many workloads at a lower cost.
80 GB
HBM2e Memory
Run 70B+ parameter models on a single GPU.
600 GB/s
NVLink Bandwidth
Third-gen NVLink for multi-GPU scaling.
312
TFLOPS FP16
624 TFLOPS with sparsity enabled.
19.5
TFLOPS FP64
Double-precision hardware for scientific and HPC workloads.
NVIDIA B200 on Denvr AI Cloud
1T Parameter Training
Scale across 8-GPU NVLink nodes for 1,440 GB of total VRAM and 1.8 TB/s per-GPU interconnect.
Proven Ecosystem
The most widely supported data center GPU in the ML stack. Full compatibility with PyTorch, TensorFlow, JAX, vLLM, and every major training and serving framework.
Distributed Training
Multi-node scaling with InfiniBand for distributed workloads that don't require H100-class throughput.
Managed Storage
High-performance Weka filesystem and local NVMe available. No external storage to provision for datasets, checkpoints, or model artifacts.
Configurations
Per-minute billing with on-demand and reserved options. All configurations available as bare metal, VM, or model endpoints.
Platform
GPUs
On-Demand
VRAM
vCPUs
Memory
Local Storage
Interconnect
NVIDIA A100 SXM
8x
80 GB
208
1024 GB
6x 3.8TB NVMe
IB 1600G
$1.45 / GPU
NVIDIA A100 SXM
8x
40 GB
128
1024 GB
4x 3.8TB NVMe
IB 800G
$1.15 / GPU
NVIDIA A100 PCIe
4x
40 GB
64
512 GB
2x 3.8TB NVMe
-
$1.15 / GPU
NVIDIA A100 MIG
1x
20 GB
5
55 GB
-
-
$0.58 / GPU
NVIDIA A100 SXM
GPU COUNT
GPU VRAM
vCPUs
MEMORY
LOCAL STORAGE
INTERCONNECT
8x
80 GB
208
1024 GB
6x 3.8TB NVMe
IB 1600G
$1.45 / GPU
NVIDIA A100 SXM
GPU COUNT
GPU VRAM
vCPUs
MEMORY
LOCAL STORAGE
INTERCONNECT
8x
40 GB
128
1024 GB
4x 3.8TB NVMe
IB 800G
$1.15 / GPU
NVIDIA A100 PCIe
GPU COUNT
GPU VRAM
vCPUs
MEMORY
LOCAL STORAGE
INTERCONNECT
4x
40 GB
64
512 GB
2x 3.8TB NVMe
-
$1.15 / GPU
NVIDIA A100 MIG
GPU COUNT
GPU VRAM
vCPUs
MEMORY
LOCAL STORAGE
INTERCONNECT
1x
20 GB
5
55 GB
-
-
$0.58 / GPU
Related GPUs
Compare Denvr GPU options by workload and performance requirements.
Intel Gaudi 2
VRAM
VRAM
VRAM
VRAM
Memory Bandwidth
VRAM
VRAM
VRAM
FP64/FP32
VRAM
VRAM
VRAM
FP16
VRAM
VRAM
VRAM
FP8
VRAM
VRAM
VRAM
NVLink
VRAM
VRAM
VRAM
On-Demand Pricing
VRAM
VRAM
VRAM
PLATFORM
VRAM
BANDWIDTH
FP64/FP32
FP16
FP8
NVLINK
GPU Count
GPU VRAM
vCPUs
Memory
Local Storage
Interconnect
GPU Count
PLATFORM
VRAM
BANDWIDTH
FP64/FP32
FP16
FP8
NVLINK
GPU Count
GPU VRAM
vCPUs
Memory
Local Storage
Interconnect
GPU Count
PLATFORM
VRAM
BANDWIDTH
FP64/FP32
FP16
FP8
NVLINK
GPU Count
GPU VRAM
vCPUs
Memory
Local Storage
Interconnect
GPU Count
Infrastructure you can trust at scale
As an NVIDIA Cloud Partner we build and operate AI clusters following NVIDIA Reference Architectures. Your models and data are supported via strict privacy safeguards and SOC 2 Type 2 security practices.
