NVIDIA H100 SXM
Data center GPU · Hopper
Launched
Q4 2022
VRAM
80 GB
Mem. bandwidth
3,350 GB/s
On-demand from
Tech specs
VRAM 80 GB HBM3
Memory bandwidth 3,350 GB/s
Interface SXM
CUDA cores 16,896
Tensor cores 528 (Gen 4)
TDP 700 W
Supported data types
FP64FP32FP16BF16FP8INT8
Cloud rental prices
23 providers · available in 29 countries · lowest price per GPU, per hour
On-demand
$1.99 – $11.06 /GPU/h
Reserved
$1.84 – $7.67 /GPU/h
Spot
$1.13 – $2.46 /GPU/h
| Provider | On-demand | Reserved | Spot |
|---|---|---|---|
 AceCloud | — | $3.26 | — |
 AWS | $6.88 | $2.97 | — |
| | $11.06 | $4.86 | $2.04 |
 CoreWeave | $6.16 | — | $2.46 |
 Crusoe | $3.90 | — | — |
 Denvr | $2.30 | — | — |
| | $11.06 | $4.86 | $1.13 |
 Hyperstack | $3.20 | $2.72 | — |
| | $2.69 | $2.32 | $1.19 |
 Lambda | $3.99 | — | — |
 Leafcloud | $4.71 | — | — |
 Massed Compute | $3.14 | — | — |
 Nebius | $3.85 | — | $2.15 |
 Oracle | $10.00 | — | — |
 Runpod | $2.99 | — | — |
| | $3.62 | — | — |
 Seeweb | $2.16 | $1.84 | — |
| | $2.75 | — | — |
 Together AI | $3.99 | — | — |
 Vast.ai | $2.20 | — | $1.60 |
 Verda | $3.25 | $2.99 | $1.14 |
 Voltage Park | $1.99 | — | — |
 Vultr | $2.30 | — | — |
Models that fit in VRAM
Open-weights models that fit in VRAM. Estimated using 🤗 accelerate, plus approximation for up to 8K context.
Media
Drug Discovery, STAT! NVIDIA, Recursion Speed Pharma R&D With AI Supercomputer BNY First Global Bank to Deploy AI Supercomputer Powered by NVIDIA DGX SuperPOD With DGX H100 Building Meta's GenAI Infrastructure Tesla hedges Dojo bets with 10K Nvidia H100 GPU cluster Amazon EC2 P5 instances, optimized for generative AI and HPC, are generally available How xAI turned a factory shell into an AI 'Colossus' to power Grok
Peak theoretical performance
FP8 Tensor Core 1,979 TFLOPS
INT8 Tensor Core 1,979 TOPS
BF16 Tensor Core 990 TFLOPS
FP16 Tensor Core 990 TFLOPS
TF32 Tensor Core 494 TFLOPS
FP32 67 TFLOPS
FP64 34 TFLOPS
FP64 Tensor Core 67 TFLOPS
Performance figures assume no sparsity; in cases where only sparse performance figures are published by the manufacturer, these are halved to give approximate dense performance.
Resources
Detailed documentation from the manufacturer.
Similar GPUs
Other accelerators you might compare.