NVIDIA A30
Data center GPU · Ampere
Summary
The NVIDIA A30 is an Ampere-generation data centre GPU with 24GB of HBM2 and unusually high memory bandwidth for its capacity, aimed at inference and small-scale training. It sits between the NVIDIA A10 and the NVIDIA A100 in NVIDIA's Ampere line-up.
Tech specs
VRAM 24 GB HBM2
Memory bandwidth 933 GB/s
Interface PCIe
CUDA cores 3,804
Tensor cores 224 (Gen 3)
TDP 165 W
Supported data types
FP64FP32FP16BF16INT8INT4
Cloud rental prices
5 providers · available in 4 countries · lowest price per GPU, per hour
On-demand
$0.32 – $1.59 /GPU/h
Reserved
$0.28 – $0.98 /GPU/h
Spot
$0.29 /GPU/h
| Provider | On-demand | Reserved | Spot |
|---|---|---|---|
AceCloud | — | $0.66 | — |
| | $0.41 | $0.38 | $0.29 |
| | $0.68 | — | — |
Massed Compute | $0.35 | — | — |
Seeweb | $0.32 | $0.28 | — |
Models that fit in VRAM
Open-weights models that fit in VRAM. Estimated using 🤗 accelerate, plus approximation for up to 8K context.
Resources
Detailed documentation from the manufacturer.


