NVIDIA V100 32GB SXM

Data center GPU · Volta

Summary

The highest-memory variant of the NVIDIA V100, with 32GB of HBM2. Newer GPUs such as the A100, H100, and B200 are considerably faster.

Launched
2017
VRAM
32 GB
Mem. bandwidth
900 GB/s
On-demand from
Compare prices from 3 providers →

Tech specs

VRAM 32 GB HBM2
Memory bandwidth 900 GB/s
Interface PCIe
CUDA cores 5,120
Tensor cores 640 (Gen 1)
TDP 300 W
Supported data types
FP64FP32FP16INT8

Cloud rental prices

3 providers · available in 7 countries · lowest price per GPU, per hour

Prices updated

On-demand
$1.53 – $3.90 /GPU/h
Reserved
$1.30 – $2.40 /GPU/h
Spot
$0.28 /GPU/h
Provider On-demand Reserved Spot
AWS ? $3.90 $1.30 —
Azure ? $1.53 $1.35 $0.28
Sesterce ✓ $2.57 — —
Compare all NVIDIA V100 32GB SXM cloud providers & configurations →

Models that fit in VRAM

Open-weights models that fit in VRAM. Estimated using 🤗 accelerate, plus approximation for up to 8K context.

Resources

Detailed documentation from the manufacturer.