NVIDIA B300
Data center GPU · Blackwell · Ultra
The NVIDIA B300 is an evolution of the B200 GPU, and comes with significantly higher FP4 performance, making it a powerhouse for inference on quantised models. The amount of VRAM is configurable, and can vary between providers.
The B300 is also available in its GB300 "Grace Blackwell" configuration, pairing B300 GPUs with NVIDIA's Grace CPU.
Tech specs
Cloud rental prices
4 providers · available in 2 countries · lowest price per GPU, per hour
Models that fit in VRAM
Open-weights models that fit in VRAM. Estimated using 🤗 accelerate, plus approximation for up to 8K context.
Media
Peak theoretical performance
Performance figures assume no sparsity; in cases where only sparse performance figures are published by the manufacturer, these are halved to give approximate dense performance.
Resources
Detailed documentation from the manufacturer.
Similar GPUs
Other accelerators you might compare.