NVIDIA A100 80GB PCIe
Data center GPU · Ampere
Summary
One of four A100 configurations. For multi-GPU training where interconnects are important, consider the A100 SXM 80GB or A100 SXM 40GB.
Launched
Q3 2021
VRAM
80 GB
Mem. bandwidth
1,935 GB/s
On-demand from
Tech specs
VRAM 80 GB HBM2e
Memory bandwidth 1,935 GB/s
Interface PCIe
CUDA cores 6,912
Tensor cores 432 (Gen 3)
TDP 300 W
Supported data types
FP64FP32FP16BF16INT8INT4
Cloud rental prices
11 providers · available in 18 countries · lowest price per GPU, per hour
On-demand
$1.03 – $3.67 /GPU/h
Reserved
$0.57 – $3.42 /GPU/h
Spot
$0.68 – $1.08 /GPU/h
| Provider | On-demand | Reserved | Spot |
|---|---|---|---|
| | $3.67 | $1.36 | $0.68 |
 Cirrascale | — | $2.60 | — |
 Crusoe | $2.00 | — | — |
 Hyperstack | $1.35 | $0.95 | $1.08 |
| | $1.49 | $1.27 | $0.89 |
 LeaderGPU | $1.03 | $0.57 | — |
 Leafcloud | $1.82 | — | — |
 Massed Compute | $1.35 | — | — |
 Runpod | $1.39 | — | — |
 Seeweb | $1.13 | $0.96 | — |
 Vultr | $2.40 | — | — |
Models that fit in VRAM
Open-weights models that fit in VRAM. Estimated using 🤗 accelerate, plus approximation for up to 8K context.
Peak theoretical performance
INT8 Tensor Core 624 TOPS
BF16 Tensor Core 312 TFLOPS
FP16 Tensor Core 312 TFLOPS
TF32 Tensor Core 156 TFLOPS
FP32 19.5 TFLOPS
FP64 9.7 TFLOPS
FP64 Tensor Core 19.5 TFLOPS
Performance figures assume no sparsity; in cases where only sparse performance figures are published by the manufacturer, these are halved to give approximate dense performance.
Resources
Detailed documentation from the manufacturer.
Similar GPUs
Other accelerators you might compare.