NVIDIA A100 40GB SXM
Data center GPU · Ampere
One of four A100 configurations, this GPU is well-suited to multi-GPU training or other workloads where GPU-to-GPU communication is important. The newer A100 SXM 80GB has twice as much VRAM as this GPU, and is generally more widely available.
Tech specs
Cloud rental prices
7 providers · available in 28 countries · lowest price per GPU, per hour
| Provider | On-demand | Reserved | Spot |
|---|---|---|---|
 AWS | $2.74 | $1.17 | — |
 Denvr | $1.15 | — | — |
| | $3.48 | $1.22 | $0.32 |
 Lambda | $1.99 | — | — |
 Oracle | $3.05 | — | — |
| | $1.54 | — | — |
 Verda | $1.29 | $1.19 | $0.45 |
Models that fit in VRAM
Open-weights models that fit in VRAM. Estimated using 🤗 accelerate, plus approximation for up to 8K context.
Media
Peak theoretical performance
Performance figures assume no sparsity; in cases where only sparse performance figures are published by the manufacturer, these are halved to give approximate dense performance.
Resources
Detailed documentation from the manufacturer.
Similar GPUs
Other accelerators you might compare.