NVIDIA RTX A6000
Consumer GPU · Ampere
Summary
The RTX A6000 is an Ampere-generation workstation GPU with 48GB of GDDR6. It offers more memory bandwidth than the otherwise similar A40, and supports NVLink for pairing two cards. Its successor is the RTX 6000 Ada.
Tech specs
VRAM 48 GB GDDR6
Memory bandwidth 768 GB/s
Interface PCIe
CUDA cores 10,752
Tensor cores 336 (Gen 3)
TDP 300 W
Supported data types
FP64FP32TF32FP16BF16INT8INT4
Cloud rental prices
11 providers · available in 7 countries · lowest price per GPU, per hour
On-demand
$0.50 – $1.09 /GPU/h
Reserved
$0.31 – $1.57 /GPU/h
Spot
$0.39 – $0.56 /GPU/h
| Provider | On-demand | Reserved | Spot |
|---|---|---|---|
 AceCloud | — | $0.83 | — |
 Cirrascale | — | $0.90 | — |
 Hyperstack | $0.50 | $0.35 | — |
 Lambda | $1.09 | — | — |
 LeaderGPU | — | $0.31 | — |
 Massed Compute | $0.55 | — | — |
 Runpod | $0.59 | — | — |
 Seeweb | $0.83 | $0.71 | — |
| | $0.63 | — | — |
 Vast.ai | $0.87 | — | $0.56 |
 Verda | $0.78 | $0.72 | $0.39 |
Models that fit in VRAM
Open-weights models that fit in VRAM. Estimated using 🤗 accelerate, plus approximation for up to 8K context.
Resources
Detailed documentation from the manufacturer.