Qualcomm AI 100 Pro
Data center GPU · Cloud AI 100
Summary
Qualcomm's AI 100 Pro accelerator is a low-power chip aimed at LLM inference.
For a more powerful accelerator with a similar architecture, see the Qualcomm AI 100 Ultra.
Tech specs
VRAM 32 GB LPDDR4x
Memory bandwidth 137 GB/s
Interface PCIe
TDP 75 W
Supported data types
FP16INT8
Cloud rental prices
2 providers · available in 2 countries · lowest price per GPU, per hour
On-demand
$1.11 /GPU/h
Reserved
$0.35 – $3.42 /GPU/h
| Provider | On-demand | Reserved | Spot |
|---|---|---|---|
| | $1.11 | $0.48 | — |
Cirrascale | — | $0.35 | — |
Models that fit in VRAM
Open-weights models that fit in VRAM. Estimated using 🤗 accelerate, plus approximation for up to 8K context.
Media
Resources
Detailed documentation from the manufacturer.
Similar GPUs
Other accelerators you might compare.
