Hyperscaler GPU clouds

4 providers · AWS · Azure · Google Cloud · Oracle

Summary

The big hyperscaler clouds all offer NVIDIA GPU instances. They can be pricier than specialist GPU clouds, but bring broader product offerings, globally distributed data centres, generous initial credits through startup programs, and committed-use discounts. Compare prices →

Providers

4 providers in this group.

AWS Est. 2006 🇺🇸
SOC 2 Type I · SOC 2 Type II · ISO 27001 · ISO 27017 · ISO 27018 · ISO 27701 · ISO 22301 · BSI C5
GPU data centres in 23 countries
GPUs
B300 · RTX Pro 6000 SE · B200 · H200 SXM · L40S · L4 · H100 SXM · A10 · A100 80GB SXM · A100 40GB SXM · T4 · V100 16GB SXM · V100 32GB SXM
AI 100 Pro
Provisioning On-demand · Reserved

Amazon Web Services (AWS) is the largest and oldest hyperscaler cloud, offering NVIDIA GPU instances alongside Qualcomm accelerators, and its own custom Trainium and Inferentia accelerators.

View provider →
Azure Est. 2010 🇺🇸
SOC 2 Type I · SOC 2 Type II · ISO 22301 · ISO 27001 · ISO 27017 · ISO 27018 · ISO 27701 · BSI C5
GPU data centres in 27 countries
GPUs
H200 SXM · H100 NVL · H100 SXM · A10 · A100 80GB PCIe · A100 80GB SXM · T4 · V100 16GB PCIe · V100 32GB SXM
Provisioning On-demand · Reserved · Spot

Microsoft Azure is a hyperscaler offering NVIDIA GPU virtual machines.

View provider →
Google Cloud Est. 2008 🇺🇸
SOC 2 Type I · SOC 2 Type II · ISO 27001 · ISO 27017 · ISO 27018 · ISO 27701 · BSI C5
GPU data centres in 26 countries
GPUs
RTX Pro 6000 SE · B200 · H200 SXM · L4 · H100 SXM · A100 80GB SXM · A100 40GB SXM · T4 · V100 16GB PCIe · P100 16GB PCIe
Provisioning On-demand · Reserved · Spot

Google Cloud Platform (GCP) is a hyperscaler offering NVIDIA GPU instances alongside its own TPU machine learning accelerators.

View provider →
Oracle Est. 2016 🇺🇸
SOC 2 Type I · SOC 2 Type II · ISO 27001 · ISO 27017 · ISO 27018 · ISO 22301 · ISO 27701 · BSI C5
GPUs
B300 · GB300 · B200 · GB200 · H200 SXM · L40S · H100 SXM · A10 · A100 80GB SXM · A100 40GB SXM · V100 16GB SXM · P100 16GB PCIe
MI355X · MI300X
Provisioning On-demand

Oracle Cloud Infrastructure (OCI) is a hyperscaler offering NVIDIA and AMD GPU clusters.

View provider →

Other providers

Other relevant cloud GPU providers.