NVIDIA V100 16GB SXM

Data center GPU · Volta

Summary

One of three NVIDIA V100 variants, with 16GB of HBM2 in the SXM2 form factor. For twice the memory, see the V100 32GB SXM.

Launched
2017
VRAM
16 GB
Mem. bandwidth
900 GB/s
On-demand from
Compare prices from 3 providers →

Tech specs

VRAM 16 GB HBM2
Memory bandwidth 900 GB/s
Interface SXM
CUDA cores 5,120
Tensor cores 640 (Gen 1)
TDP 300 W
Supported data types
FP64FP32FP16INT8

Cloud rental prices

3 providers · available in 11 countries · lowest price per GPU, per hour

Prices updated

On-demand
$0.78 – $3.06 /GPU/h
Provider On-demand Reserved Spot
AWS ? $3.06 — —
Oracle ? $2.95 — —
OVHcloud ? $0.78 — —
Compare all NVIDIA V100 16GB SXM cloud providers & configurations →

Models that fit in VRAM

Open-weights models that fit in VRAM. Estimated using 🤗 accelerate, plus approximation for up to 8K context.

Resources

Detailed documentation from the manufacturer.