NVIDIA A30

Data center GPU · Ampere

Summary

The NVIDIA A30 is an Ampere-generation data centre GPU with 24GB of HBM2 and unusually high memory bandwidth for its capacity, aimed at inference and small-scale training. It sits between the NVIDIA A10 and the NVIDIA A100 in NVIDIA's Ampere line-up.

Launched
2022
VRAM
24 GB
Mem. bandwidth
933 GB/s
On-demand from
Compare prices from 5 providers →

Tech specs

VRAM 24 GB HBM2
Memory bandwidth 933 GB/s
Interface PCIe
CUDA cores 3,804
Tensor cores 224 (Gen 3)
TDP 165 W
Supported data types
FP64FP32FP16BF16INT8INT4

Cloud rental prices

5 providers · available in 4 countries · lowest price per GPU, per hour

Prices updated

On-demand
$0.32 – $1.59 /GPU/h
Reserved
$0.28 – $0.98 /GPU/h
Spot
$0.29 /GPU/h
Provider On-demand Reserved Spot
AceCloud ? — $0.66 —
Jarvislabs ✓ $0.41 $0.38 $0.29
Leafcloud ? $0.68 — —
Massed Compute ? $0.35 — —
Seeweb ? $0.32 $0.28 —
Compare all NVIDIA A30 cloud providers & configurations →

Models that fit in VRAM

Open-weights models that fit in VRAM. Estimated using 🤗 accelerate, plus approximation for up to 8K context.

Resources

Detailed documentation from the manufacturer.