Can the RTX A6000 run Qwen3.6-35B-A3B?
Yes. A new RTX A6000 ($8,363) runs Qwen3.6-35B-A3B at Q4 with room for its full 256K context, at about 146 tok/s estimate. That is $57 per tok/s, #5 of 5 priced GPUs that fit it; the GeForce RTX 3090 ranks first at $10.
Yes, with room for long context. On the NVIDIA RTX A6000 (48 GB) there is room for about its full 256K tokens of context with the default FP16 KV cacheestimate: what is left after the weights and a 1 GB runtime reserve. The Q4_K_M GGUF of Qwen3.6-35B-A3B is 22.29 GB (source); with our 1.5 GB allowance for the runtime and a short context it needs about 23.8 GB.
Qwen3.6-35B-A3B fits 5 of the 18 GPUs we have a dated price for; the smallest of them has 24 GB. The RTX A6000's 768 GB/s gives ~146 tok/s estimate, 77% of the fastest card, the GeForce RTX 5090 at ~189 tok/s. Only 3B of its 35.95B parameters are active per token, so the estimate reads 1.86 GB per token rather than the whole 22.29 GB file, plus a per-token routing and expert-gather cost calibrated to 45 measured llama.cpp benchmarks (2025–26). On the same card, the dense Ripple-65B Preview (38.8 GB) estimates ~17 tok/s.
At $8,363 (new) it works out to $57 per tok/s, #5 of 5, the most expensive of them. The GeForce RTX 3090 is the cheapest per tok/s at $10 ($1,499, used). The cheapest complete build we priced that runs Qwen3.6-35B-A3B is our 24 GB: one used RTX 3090 build at $2,650.58.
Last updated Oct 16, 2026. Speed is a bandwidth-based estimate (768 GB/s, NVIDIA), scaled by per-platform constants calibrated to 45 measured llama.cpp benchmarks (2025–26), not a benchmark of this pair. Max context is an estimate from the model's architecture for llama.cpp with flash attention.
Next size up: Qwen3-Coder-Next (48.53 GB at Q4_K_M) needs ~50 GB and does not fit on one NVIDIA RTX A6000. See what runs Qwen3-Coder-Next.
Every priced GPU that runs Qwen3.6-35B-A3B, by cost per token/sec
| GPU | VRAM | Speed estimate | Max context estimate | Low price | $ per tok/s |
|---|---|---|---|---|---|
| NVIDIA GeForce RTX 3090 | 24 GB | ~157 tok/s | 33K · 63K (8-bit) | $1,499 (used) | $10 |
| AMD Radeon RX 7900 XTX | 24 GB | ~137 tok/s | 33K · 63K (8-bit) | $1,350 (new) | $10 |
| NVIDIA GeForce RTX 4090 | 24 GB | ~161 tok/s | 33K · 63K (8-bit) | $2,910 (used) | $18 |
| NVIDIA GeForce RTX 5090 | 32 GB | ~189 tok/s | 256K (full) | $6,500 (new) | $34 |
| NVIDIA RTX A6000 | 48 GB | ~146 tok/s | 256K (full) | $8,363 (new) | $57 |
Prices: gpuprix.com, 2026-11-02; see how prices are sourced. Prices move daily. Bar length shows value: longer is cheaper per tok/s.