AMD MI350X
Data center GPU · CDNA4
The AMD MI355X is a powerful GPU. With similar VRAM and memory bandwidth to NVIDIA's flagship B300 GPU at lower cost, this GPU can be a capable alternative to NVIDIA options – though beware that software support is less mature in some cases than for NVIDIA's GPUs. For a slightly more powerful version of this GPU, see the AMD MI355X
Tech specs
Cloud rental prices
1 provider · lowest price per GPU, per hour
| Provider | On-demand | Reserved | Spot |
|---|---|---|---|
 DigitalOcean | $4.40 | — | — |
Models that fit in VRAM
| Total VRAM | From | 16-bit inference | 8-bit inference | 4-bit inference | |
|---|---|---|---|---|---|
| 1× MI350X | 288 GB | $4.40/h | | | |
| 8× MI350X | 2,304 GB | $35.20/h | | | |
Open-weights models that fit in VRAM. Estimated using 🤗 accelerate, plus approximation for up to 8K context.
Media
Peak theoretical performance
Performance figures assume no sparsity; in cases where only sparse performance figures are published by the manufacturer, these are halved to give approximate dense performance.
Resources
Detailed documentation from the manufacturer.
Similar GPUs
Other accelerators you might compare.