Qualcomm AI 100 Pro

Data center GPU · Cloud AI 100

Summary

Qualcomm's AI 100 Pro accelerator is a low-power chip aimed at LLM inference.

For a more powerful accelerator with a similar architecture, see the Qualcomm AI 100 Ultra.

Launched
2024
VRAM
32 GB
Mem. bandwidth
137 GB/s
On-demand from
Compare prices from 2 providers →

Tech specs

VRAM 32 GB LPDDR4x
Memory bandwidth 137 GB/s
Interface PCIe
TDP 75 W
Supported data types
FP16INT8

Cloud rental prices

2 providers · available in 2 countries · lowest price per GPU, per hour

Prices updated

On-demand
$1.11 /GPU/h
Reserved
$0.35 – $3.42 /GPU/h
Provider On-demand Reserved Spot
AWS $1.11 $0.48
Cirrascale $0.35
Compare all Qualcomm AI 100 Pro cloud providers & configurations →

Models that fit in VRAM

Open-weights models that fit in VRAM. Estimated using 🤗 accelerate, plus approximation for up to 8K context.

Media

Resources

Detailed documentation from the manufacturer.

Similar GPUs

Other accelerators you might compare.