Can the GeForce RTX 5090 run Qwen3.6-35B-A3B?
Yes. A new GeForce RTX 5090 ($6,500) runs Qwen3.6-35B-A3B at Q4 with room for its full 256K context, at about 189 tok/s estimate. That is $34 per tok/s, #4 of 5 priced GPUs that fit it; the GeForce RTX 3090 ranks first at $10.
Yes, with room for long context. On the NVIDIA GeForce RTX 5090 (32 GB) there is room for about its full 256K tokens of context with the default FP16 KV cacheestimate: what is left after the weights and a 1 GB runtime reserve. The Q4_K_M GGUF of Qwen3.6-35B-A3B is 22.29 GB (source); with our 1.5 GB allowance for the runtime and a short context it needs about 23.8 GB.
Qwen3.6-35B-A3B fits 5 of the 18 GPUs we have a dated price for; the smallest of them has 24 GB. The GeForce RTX 5090's 1792 GB/s of memory bandwidth makes it the fastest of the 5, at ~189 tok/s estimate. Only 3B of its 35.95B parameters are active per token, so the estimate reads 1.86 GB per token rather than the whole 22.29 GB file, plus a per-token routing and expert-gather cost calibrated to 45 measured llama.cpp benchmarks (2025–26). On the same card, the mixture-of-experts Recursive Flint 40B-A2.5B (2.5B of 39.8B active, 25.99 GB) estimates ~366 tok/s.
At $6,500 (new) it works out to $34 per tok/s, #4 of 5. The GeForce RTX 3090 is the cheapest per tok/s at $10 ($1,499, used). The cheapest complete build we priced that runs Qwen3.6-35B-A3B is our 24 GB: one used RTX 3090 build at $2,650.58.
Last updated Oct 16, 2026. Speed is a bandwidth-based estimate (1792 GB/s, NVIDIA), scaled by per-platform constants calibrated to 45 measured llama.cpp benchmarks (2025–26), not a benchmark of this pair. Max context is an estimate from the model's architecture for llama.cpp with flash attention.
Next size up: Ripple-65B Preview (38.8 GB at Q4_K_M) needs ~40.3 GB and does not fit on one NVIDIA GeForce RTX 5090. See what runs Ripple-65B Preview.
Every priced GPU that runs Qwen3.6-35B-A3B, by cost per token/sec
| GPU | VRAM | Speed estimate | Max context estimate | Low price | $ per tok/s |
|---|---|---|---|---|---|
| NVIDIA GeForce RTX 3090 | 24 GB | ~157 tok/s | 33K · 63K (8-bit) | $1,499 (used) | $10 |
| AMD Radeon RX 7900 XTX | 24 GB | ~137 tok/s | 33K · 63K (8-bit) | $1,350 (new) | $10 |
| NVIDIA GeForce RTX 4090 | 24 GB | ~161 tok/s | 33K · 63K (8-bit) | $2,910 (used) | $18 |
| NVIDIA GeForce RTX 5090 | 32 GB | ~189 tok/s | 256K (full) | $6,500 (new) | $34 |
| NVIDIA RTX A6000 | 48 GB | ~146 tok/s | 256K (full) | $8,363 (new) | $57 |
Prices: picksbycard.com, 2026-11-02; see how prices are sourced. Prices move daily. Bar length shows value: longer is cheaper per tok/s.