NVIDIA V100 16GB SXM
Data center GPU · Volta
Summary
One of three NVIDIA V100 variants, with 16GB of HBM2 in the SXM2 form factor. For twice the memory, see the V100 32GB SXM.
Tech specs
VRAM 16 GB HBM2
Memory bandwidth 900 GB/s
Interface SXM
CUDA cores 5,120
Tensor cores 640 (Gen 1)
TDP 300 W
Supported data types
FP64FP32FP16INT8
Cloud rental prices
3 providers · available in 11 countries · lowest price per GPU, per hour
Models that fit in VRAM
Open-weights models that fit in VRAM. Estimated using 🤗 accelerate, plus approximation for up to 8K context.
Resources
Detailed documentation from the manufacturer.