AMD MI250
Data center GPU · CDNA2
Summary
The AMD Instinct MI250 is a CDNA2-generation data centre GPU with 128GB of HBM2e and high memory bandwidth. It predates the more widely available MI300X, and is mainly of interest where its large memory capacity is available cheaply.
Tech specs
VRAM 128 GB HBM2e
Memory bandwidth 3,200 GB/s
Interface PCIe
TDP 500 W
Supported data types
FP64FP32FP16BF16INT8INT4
Cloud rental prices
1 provider · lowest price per GPU, per hour
Reserved
$1.28 – $1.60 /GPU/h
| Provider | On-demand | Reserved | Spot |
|---|---|---|---|
 Cirrascale | — | $1.28 | — |
Models that fit in VRAM
| Total VRAM | From | 16-bit inference | 8-bit inference | 4-bit inference | |
|---|---|---|---|---|---|
| 4× MI250 | 512 GB | $5.12/h | | | |
Open-weights models that fit in VRAM. Estimated using 🤗 accelerate, plus approximation for up to 8K context.
Resources
Detailed documentation from the manufacturer.