AMD MI355X
Data center GPU · CDNA4
The AMD MI355X is a powerful GPU. With similar VRAM and memory bandwidth to NVIDIA's flagship B300 GPU at lower cost, this GPU can be a capable alternative to NVIDIA options – though beware that software support is less mature in some cases than for NVIDIA's GPUs.
Tech specs
Cloud rental prices
2 providers · lowest price per GPU, per hour
Additional providers who may offer AMD MI355X without public pricing: TensorWave, Crusoe, Hot Aisle
Models that fit in VRAM
| Total VRAM | From | 16-bit inference | 8-bit inference | 4-bit inference | |
|---|---|---|---|---|---|
| 8× MI355X | 2,304 GB | $20.72/h | | | |
Open-weights models that fit in VRAM. Estimated using 🤗 accelerate, plus approximation for up to 8K context.
Media
Peak theoretical performance
Performance figures assume no sparsity; in cases where only sparse performance figures are published by the manufacturer, these are halved to give approximate dense performance.
Resources
Detailed documentation from the manufacturer.
Similar GPUs
Other accelerators you might compare.