What GPU do you need to run Gemma 4 31B?

Other places to get it

Checked Nov 14, 2026. We list only copies we opened and checked. Check file hashes for copies from other uploaders.

• ModelScope: Other uploaderAccount named Google; we found no Google page linking to it
• Ollama: Runs on your machine ollama pull gemma4:31b
• Kaggle

Single GPUs that fit, cheapest first

Every device that runs it

Graphics cards, Macs and mini PCs from the wider hardware list behind My rig, smallest usable memory first. Not sure about yours? Check your exact rig.

Multi-GPU: cards that need two or more

Measured on Macs with MLX (community)

MLX (measured, community): decode speeds people ran with MLX through oMLX and submitted to its public leaderboard. They are kept apart from this site's llama.cpp-style estimate, which is for a GGUF file in llama.cpp and is unchanged. The plain figure has no speculative decoding, at the shortest context the run used; runs with speculative decoding (MTP/DFlash) are shown separately, as a range, because their speed depends on how many drafted tokens are accepted, which varies with the prompt.

Long context: decode at the shortest and longest context of one run, and that run's prompt-processing (prefill) range. Agent jobs re-read long prompts, so prefill (prompt processing) speed matters as much as decode there. Community-submitted to oMLX, accessed 2026-10-26; each figure links its run(s). MLX 4-bit files, not the GGUF the estimate uses. About the MLX data

Related

• BuildBuild that fits it: 24 GB: one used RTX 3090
• BuildBuild that fits it: 32 GB: two Radeon RX 9070
• BuildBuild that fits it: 48 GB: dual used RTX 3090