NVIDIA RTX PRO 6000
Consumer GPU · Blackwell · Server and Workstation editions
The RTX PRO 6000 is a versatile and powerful GPU, with applications from model training to LLM inference to graphics rendering. There are two separate editions available, built around the same chip but with different power/cooling configurations: RTX PRO 6000 Server and RTX PRO 6000 Workstation. The former is widely available among cloud providers, whereas the latter is generally only available on peer-to-peer/marketplace style providers.
Tech specs
| Spec | RTX Pro 6000 SE | RTX Pro 6000 WS |
|---|---|---|
| VRAM | 96 GB GDDR7 | 96 GB GDDR7 |
| Memory bandwidth | 1,597 GB/s | 1,792 GB/s |
| Interface | PCIe | PCIe |
| CUDA cores | 24,064 | 24,064 |
| Tensor cores | 752 (Gen 5) | 752 (Gen 5) |
| TDP | 600 W | 600 W |
Cloud rental prices
18 providers · available in 19 countries · lowest price per GPU, per hour
| Provider | On-demand | Reserved | Spot |
|---|---|---|---|
 AceCloud | — | $1.97 | — |
 AWS | $3.36 | — | — |
 Cirrascale | — | $1.37 | — |
 CoreWeave | $2.50 | — | $1.38 |
| | $4.50 | $1.98 | $1.80 |
 Hetzner | — | $2.19 | — |
 Hyperstack | $1.85 | $1.30 | $1.48 |
| | $1.89 | $1.29 | $0.99 |
 Latitude.sh | $6.00 | $2.10 | — |
 Leafcloud | $3.14 | — | — |
 Massed Compute | $2.19 | — | — |
 Nebius | $1.80 | — | $0.95 |
| | $0.96 | $0.72 | — |
 Runpod | $1.99 | — | — |
 Seeweb | $1.42 | $1.21 | — |
| | $2.41 | — | — |
 Vast.ai | $1.73 | — | $1.07 |
 Verda | $1.89 | $1.74 | $0.66 |
Models that fit in VRAM
Open-weights models that fit in VRAM. Estimated using 🤗 accelerate, plus approximation for up to 8K context.
Media
Peak theoretical performance
| Spec | RTX Pro 6000 SE | RTX Pro 6000 WS |
|---|---|---|
| FP4 Tensor Core | 2,000 TFLOPS | 2,000 TFLOPS |
| FP32 | 120 TFLOPS | 125 TFLOPS |
| RT Core | 355 TFLOPS | 380 TFLOPS |
Performance figures assume no sparsity; in cases where only sparse performance figures are published by the manufacturer, these are halved to give approximate dense performance.
Resources
Detailed documentation from the manufacturer.
Similar GPUs
Other accelerators you might compare.