NVIDIA RTX Pro 6000 SE
Consumer GPU · Blackwell
Summary
The RTX PRO 6000 Server Edition is a versatile and powerful GPU, with applications from model training to LLM inference to graphics rendering.
For large-scale multi-GPU training on NVIDIA Blackwell, consider the B200 instead.
Launched
Q2 2025
VRAM
96 GB
Mem. bandwidth
1,597 GB/s
On-demand from
Tech specs
VRAM 96 GB GDDR7
Memory bandwidth 1,597 GB/s
Interface PCIe
CUDA cores 24,064
Tensor cores 752 (Gen 5)
TDP 600 W
Supported data types
FP64FP32TF32FP16BF16FP8FP6FP4INT8
Cloud rental prices
18 providers · available in 18 countries · lowest price per GPU, per hour
On-demand
$0.96 – $8.18 /GPU/h
Reserved
$0.72 – $4.09 /GPU/h
Spot
$0.66 – $1.80 /GPU/h
| Provider | On-demand | Reserved | Spot |
|---|---|---|---|
 AceCloud | — | $1.97 | — |
 AWS | $3.36 | — | — |
 Cirrascale | — | $1.37 | — |
 CoreWeave | $2.50 | — | $1.38 |
| | $4.50 | $1.98 | $1.80 |
 Hetzner | — | $2.19 | — |
 Hyperstack | $1.85 | $1.30 | $1.48 |
| | $1.89 | $1.29 | $0.99 |
 Latitude.sh | $6.00 | $2.10 | — |
 Leafcloud | $3.14 | — | — |
 Massed Compute | $2.19 | — | — |
 Nebius | $1.80 | — | $0.95 |
| | $0.96 | $0.72 | — |
 Runpod | $1.99 | — | — |
 Seeweb | $1.42 | $1.21 | — |
| | $2.41 | — | — |
 Vast.ai | $1.73 | — | $1.07 |
 Verda | $1.89 | $1.74 | $0.66 |
Models that fit in VRAM
Open-weights models that fit in VRAM. Estimated using 🤗 accelerate, plus approximation for up to 8K context.
Media
CoreWeave Becomes the First AI Cloud Provider to Offer NVIDIA RTX PRO 6000 Blackwell GPU at Scale NVIDIA Blackwell Universal Data Center GPU Accelerates Demanding Enterprise Workloads Google Cloud G4 VMs power GM's photorealistic AV simulation and ElevenLabs' multimodal voice agents RTX PRO 6000 Blackwell Server Edition for single-GPU 70B inference
Peak theoretical performance
FP4 Tensor Core 2,000 TFLOPS
FP32 120 TFLOPS
RT Core 355 TFLOPS
Performance figures assume no sparsity; in cases where only sparse performance figures are published by the manufacturer, these are halved to give approximate dense performance.
Resources
Detailed documentation from the manufacturer.
Similar GPUs
Other accelerators you might compare.