NVIDIA RTX 6000 Ada
Consumer GPU · Ada Lovelace
Summary
The RTX 6000 Ada is the Ada-generation successor to the RTX A6000, with the same 48GB of GDDR6 but 25% higher memory bandwidth, and significantly increased processing power. It is a capable workstation card for graphics, rendering and small-scale LLM inference. The closest same-generation data-centre card is the L40S. It is superseded by the newer RTX PRO 6000.
Launched
Q1 2023
VRAM
48 GB
Mem. bandwidth
960 GB/s
On-demand from
Tech specs
VRAM 48 GB GDDR6
Memory bandwidth 960 GB/s
Interface PCIe
CUDA cores 18,176
Tensor cores 568 (Gen 4)
TDP 300 W
Supported data types
FP64FP32TF32FP16BF16FP8INT8
Cloud rental prices
7 providers · available in 2 countries · lowest price per GPU, per hour
On-demand
$0.79 – $1.57 /GPU/h
Reserved
$0.63 – $1.84 /GPU/h
Spot
$0.70 /GPU/h
| Provider | On-demand | Reserved | Spot |
|---|---|---|---|
 AceCloud | — | $1.02 | — |
 DigitalOcean | $1.57 | — | — |
 LeaderGPU | $1.35 | $0.63 | — |
 Massed Compute | $0.79 | — | — |
 Runpod | $0.99 | — | — |
| | $1.07 | — | — |
 Verda | $1.40 | $1.29 | $0.70 |
Models that fit in VRAM
Open-weights models that fit in VRAM. Estimated using 🤗 accelerate, plus approximation for up to 8K context.
Resources
Detailed documentation from the manufacturer.