NVIDIA B200

Data center GPU · Blackwell

Summary

Widely deployed, powerful, with lots of VRAM. The B200 is a great fit for large-scale training or inference workloads. While its FP4 performance is exceeded by the newer B300 GPU, the B200 wins when it comes to FP64 and INT8 operations.

The B200 is also available in its GB200 "Grace Blackwell" configuration, pairing B200 GPUs with NVIDIA's Grace CPU.

Launched
Q1 2025
VRAM
180 GB
Mem. bandwidth
7,700 - 8,000 GB/s
On-demand from
Compare prices from 14 providers →

Tech specs

VRAM 180 GB HBM3e
Memory bandwidth 8,000 GB/s
Interface SXM
CUDA cores 18,944
Tensor cores 592 (Gen 5)
TDP 1000 W
Supported data types
FP64FP32FP16BF16FP8FP6FP4INT8

Cloud rental prices

14 providers · available in 8 countries · lowest price per GPU, per hour

Prices updated

On-demand
$3.50 – $14.24 /GPU/h
Reserved
$4.79 – $11.12 /GPU/h
Spot
$2.14 – $6.25 /GPU/h
Compare all NVIDIA B200 cloud providers & configurations →

Models that fit in VRAM

Open-weights models that fit in VRAM. Estimated using 🤗 accelerate, plus approximation for up to 8K context.

Media

Peak theoretical performance

FP4 Tensor Core 9,000 TFLOPS
FP6 Tensor Core 4,500 TFLOPS
FP8 Tensor Core 4,500 TFLOPS
INT8 Tensor Core 4,500 TOPS
BF16 Tensor Core 2,250 TFLOPS
FP16 Tensor Core 2,250 TFLOPS
TF32 Tensor Core 1,100 TFLOPS
FP32 75 TFLOPS
FP64 37 TFLOPS

Performance figures assume no sparsity; in cases where only sparse performance figures are published by the manufacturer, these are halved to give approximate dense performance.

Resources

Detailed documentation from the manufacturer.

Similar GPUs

Other accelerators you might compare.