NVIDIA V100 32GB SXM
Data center GPU · Volta
Summary
The highest-memory variant of the NVIDIA V100, with 32GB of HBM2. Newer GPUs such as the A100, H100, and B200 are considerably faster.
Tech specs
VRAM 32 GB HBM2
Memory bandwidth 900 GB/s
Interface PCIe
CUDA cores 5,120
Tensor cores 640 (Gen 1)
TDP 300 W
Supported data types
FP64FP32FP16INT8
Cloud rental prices
3 providers · available in 7 countries · lowest price per GPU, per hour
Models that fit in VRAM
Open-weights models that fit in VRAM. Estimated using 🤗 accelerate, plus approximation for up to 8K context.
Resources
Detailed documentation from the manufacturer.