NVIDIA A10
Data center GPU · Ampere
Summary
The NVIDIA A10 is an Ampere-generation data centre GPU with 24GB of GDDR6, aimed primarily at virtual desktops and graphics workloads. The NVIDIA A30 offers the same VRAM capacity with faster HBM2 memory, while NVIDIA's Ada-generation successor in this tier is the NVIDIA L4.
Tech specs
VRAM 24 GB GDDR6
Memory bandwidth 600 GB/s
Interface PCIe
CUDA cores 8,192
Tensor cores 288 (Gen 3)
TDP 150 W
Supported data types
FP64FP32FP16BF16INT8INT4
Cloud rental prices
6 providers · available in 26 countries · lowest price per GPU, per hour
On-demand
$1.01 – $3.20 /GPU/h
Reserved
$0.37 – $2.05 /GPU/h
Spot
$0.20 – $0.59 /GPU/h
| Provider | On-demand | Reserved | Spot |
|---|---|---|---|
 AWS | $1.01 | $0.43 | — |
| | $1.10 | $0.44 | $0.20 |
 Lambda | $1.29 | — | — |
 LeaderGPU | — | $0.37 | — |
 Oracle | $2.00 | — | — |
| | $1.42 | — | — |
Models that fit in VRAM
Open-weights models that fit in VRAM. Estimated using 🤗 accelerate, plus approximation for up to 8K context.
Resources
Detailed documentation from the manufacturer.