What GPU do you need to run Qwen2.5-72B-Instruct?

72.71B parameters (Hugging Face, accessed 2026-10-15). Q4_K_M GGUF: 47.42 GB (source).

Single GPU that fits	VRAM	Speed estimate	Price
Apple Mac Studio M5 Max (40-core GPU, 64 GB)	64 GB	~10 tok/s	check price
Apple Mac Studio M5 Ultra (64-core GPU, 96 GB)	96 GB	~19 tok/s	check price
Framework Desktop, AMD Ryzen AI Max+ PRO 495 (Strix Halo), 192 GB	192 GB	~4 tok/s	low $6,799 (new) source, 2026-10-16

Speed calculator estimate

GPU Count Model

Estimate = 0.76 × bandwidth ÷ GB read per token (Q4 file size, scaled by active/total parameters for MoE). Fit = file size + 1.5 GB headroom ≤ total VRAM. Multi-GPU: VRAM adds, speed uses one card's bandwidth (layer split). Short context only. How this works