RigPerDollar

What GPU do you need to run PLaMo 3 Translate 8B?

A used GeForce RTX 3060 12 GB ($305). It is the cheapest priced graphics card that holds PLaMo 3 Translate 8B (about 6.8 GB at Q4) with room for its full 32K context, at about 56 tok/s estimate; that is the card price only, and it requires a separate compatible PC. 139 of the 157 GPUs and systems we track fit it.

Translation only PLaMo 3 Translate 8B is a translation model, not a general chat assistant. The fits and speeds below say whether it runs on a machine, not that it is a good everyday chat model, so the site's automatic picks (the largest model a card runs, can-run pages) leave it out. License: PLaMo Community License.

Parameters8.53B
Q4_K_M GGUF5.28 GBsource
VRAM needed~6.8 GBfile + headroom
Single GPUs that fit139
ReleasedNov 5, 2026source
LicensePLaMo Community Licensesource
Context window32K tokens

8.53B parameters (Hugging Face, accessed 2026-11-10). Q4_K_M GGUF: 5.28 GB (source). Architecture config (Hugging Face config.json; 32 layers, window_size 2048, sliding_window_pattern 8: llama.cpp plamo3 (load_swa_pattern(ml, 8), LLAMA_SWA_TYPE_STANDARD) makes layer il sliding-window unless il % 8 == 7, so 4 full-attention + 28 sliding-window layers; the official GGUF metadata says the same (sliding_window 2048, sliding_window_pattern 8). max_ctx is the model card's 32,768-token training limit for input and output combined (the context field), not config.json's max_position_embeddings 262,144): 4 global attention layers × 4 KV heads × 128 head dim, plus 28 sliding-window layers (2048-token window), so about 8 KB of FP16 KV cache per token of context (how we estimate context).

Translation model, not a general chat assistant: it takes text in one language and returns a translation, through its own translation prompt format. Dense model, one of four PLaMo 3 Translate sizes. Context is 32,768 tokens because the model card says training used at most 32,768 tokens of input and output combined and asks you to split anything longer; config.json allows 262,144 positions, which this page does not treat as usable. Commercial use needs advance registration with Preferred Networks (see License below). Release date is the date of PFN's release blog post.

What we checked

Checked Nov 10, 2026. Official is the maker or the weight files. A vendor claim is that project's own documentation. A community claim is someone else's upload. Our check is a file or search we read. Unknown means we have no source, so it is not estimated. None of these rows is a speed we measured.

KindWhatDetailSource
OfficialModel cardPFN's card describes PLaMo 3 Translate as a translation-specialized model, tagged translation on Hugging Face, not a general chat or coding assistant. It uses a translation chat template (the PFML3 prompt format). The release blog covers four sizes (0.8B, 2B, 8B, 31B) and 53 languages, and says the model accepts surrounding context and glossaries and can write plain or polite Japanese. The card says the longest training sequence was 32,768 tokens for input and output combined and to split anything longer, so this page uses 32,768 as the context, not config.json's 262,144. Safetensors total 8,531,750,912 parameters (8.53B), BF16, dense. The repo is not gated.Model card, checked Nov 10, 2026
OfficialGGUF filesPFN publishes the GGUF build itself (pfnet/plamo-3-translate-8b-GGUF), one file per quant: Q4_K_M 5,280,445,728 bytes, Q3_K_M 4,310,218,016 bytes, Q2_K 3,450,746,144 bytes. This page's fit and speed estimates use the Q4_K_M file. The 31B card's example runs llama-server with -c 16384, --jinja and --no-prefill-assistant; 16,384 is only their example. We read the sizes from the Hugging Face file list and did not download them.GGUF repo, checked Nov 10, 2026
OfficialMLX 4-bit buildPFN also publishes an MLX 4-bit build for Apple silicon (pfnet/plamo-3-translate-8b-MLX-4bit), 6,066,104,664 bytes of safetensors. Its card says to run it with mlx-lm with trust_remote_code=True. Other official formats in the release are BF16, FP8, W4A16, W4AFP8 and NVFP4. We have not run the MLX build on a Mac, and no MLX speed is listed.MLX-4bit repo, checked Nov 10, 2026
OfficialLicense: commercial use needs registrationPLaMo Community License. Personal and non-commercial use, including academic use, is free with no registration. Commercial use is free only if you (with your affiliates) had revenue of JPY 1 billion or less in the most recent fiscal year AND you register with PFN in advance through its form (https://forms.gle/mTL8tBLrMYXKNZD56). Above JPY 1 billion you need a separate license agreement with PFN (https://translate.preferredai.jp/llm/contact/). This is a summary of the license, not legal advice.PLaMo Community License, checked Nov 10, 2026
Vendor claimPFN's benchmark claimsPFN's own claim: even the 0.8B model outperforms existing translation-specialized models (TranslateGemma, Hy-MT2) on Japanese-English and on Japanese to and from other languages, and PFN calls PLaMo 3 Translate the world's best translation-specialized LLM. Its benchmarks are PFTB and SaaS (PFN internal sets), WMT24++ (COMET-22) and FLORES+ (chrF++). PFN's card also says the Q2_K GGUF loses accuracy on some metrics while the other formats stay close to BF16. These are PFN's results; we have not reproduced any of them.PFN release blog, checked Nov 10, 2026
Our checkllama.cpp and mlx-lm supportllama.cpp master has a plamo3 architecture (src/models/plamo3.cpp), and the official GGUF header says general.architecture plamo3. With a sliding window set, llama.cpp loads a sliding-window pattern of 8: in each group of 8 layers, 7 use a 2,048-token sliding window and 1 uses full attention. For this size that is 4 full-attention and 28 sliding-window layers of 32, with 4 KV heads of size 128, which is what the context estimates use. mlx-lm master has mlx_lm/models/plamo3.py.llama.cpp plamo3.cpp, checked Nov 10, 2026
UnknownNot tested by usWe have not run any PLaMo 3 Translate model. No speed on this page is measured: tok/s figures are the site's bandwidth estimates. Translation quality is not tested by us, and the sizes are not compared with each other or with other models here.Model card does not give this, checked Nov 10, 2026

GGUF files and sizes

Exact sizes from Hugging Face, accessed 2026-11-10. The fit and context tables on this page use the Q4_K_M file (5.28 GB); a smaller file needs less memory by the difference. VRAM needed is the file + the same headroom.

FilePublished byBytesSizeVRAM neededSource
Q2_KPreferred Networks3,450,746,1443.45 GB~5 GBHugging Face
Q3_K_MPreferred Networks4,310,218,0164.31 GB~5.8 GBHugging Face
Q4_K_MPreferred Networks5,280,445,7285.28 GB~6.8 GBHugging Face

Other places to get it

Checked Nov 14, 2026. We list only copies we opened and checked. Check file hashes for copies from other uploaders.

Single GPUs that fit, cheapest first

Single GPU that fitsVRAMSpeed estimateMax context estimatePrice
NVIDIA GeForce RTX 3060 12 GB12 GB~56 tok/s32K (full)low $305avg $330 · used · source, 2026-11-02
Intel Arc B58012 GB~51 tok/s32K (full)low $330avg $446 · new · source, 2026-11-02
NVIDIA GeForce RTX 50608 GB~69 tok/s32K (full)low $410avg $550 · new · source, 2026-11-02
NVIDIA GeForce RTX 5060 Ti 8 GB8 GB~69 tok/s32K (full)low $450avg $809 · new · source, 2026-11-02
AMD Radeon RX 907016 GB~93 tok/s32K (full)low $570avg $1,052 · new · source, 2026-11-02
AMD Radeon RX 7800 XT16 GB~91 tok/s32K (full)low $599avg $834 · new · source, 2026-11-02
NVIDIA GeForce RTX 4070 SUPER12 GB~76 tok/s32K (full)low $620avg $689 · used · source, 2026-11-02
AMD Radeon RX 9060 XT 16 GB16 GB~47 tok/s32K (full)low $620avg $812 · new · source, 2026-11-02
NVIDIA GeForce RTX 5060 Ti 16 GB16 GB~69 tok/s32K (full)low $780avg $1,146 · new · source, 2026-11-02
NVIDIA GeForce RTX 507012 GB~99 tok/s32K (full)low $800avg $1,086 · new · source, 2026-11-02
AMD Radeon RX 9070 XT16 GB~93 tok/s32K (full)low $810avg $1,194 · new · source, 2026-11-02
NVIDIA GeForce RTX 5070 Ti16 GB~127 tok/s32K (full)low $1,120avg $1,792 · new · source, 2026-11-02
AMD Radeon RX 7900 XTX24 GB~140 tok/s32K (full)low $1,350avg $1,552 · new · source, 2026-11-02
NVIDIA GeForce RTX 309024 GB~131 tok/s32K (full)low $1,499avg $1,551 · used · source, 2026-11-02
NVIDIA GeForce RTX 508016 GB~134 tok/s32K (full)low $1,600avg $2,399 · new · source, 2026-11-02
Apple Mac Studio M5 Max (32-core GPU, 36 GB)36 GB (~24.1 usable)~68 tok/s32K (full)low $2,499new · source, 2026-10-16
NVIDIA GeForce RTX 409024 GB~140 tok/s32K (full)low $2,910avg $3,100 · used · source, 2026-11-02
NVIDIA DGX Spark (64GB)64 GB~43 tok/s32K (full)low $4,999new · source, 2026-11-13
Apple Mac Studio M5 Ultra (64-core GPU, 96 GB)96 GB (~72 usable)~146 tok/s32K (full)low $5,499new · source, 2026-10-23
NVIDIA GeForce RTX 509032 GB~220 tok/s32K (full)low $6,500avg $8,757 · new · source, 2026-11-02
Framework Desktop, AMD Ryzen AI Max+ PRO 495 (Strix Halo), 192 GB192 GB~40 tok/s32K (full)low $6,799new · source, 2026-10-16
NVIDIA DGX Spark (128GB)128 GB~43 tok/s32K (full)low $6,949.99new · source, 2026-10-23
NVIDIA RTX A600048 GB~111 tok/s32K (full)low $8,363new · source, 2026-11-02
AMD Radeon PRO W66008 GB~33 tok/s32K (full)No price yet
AMD Radeon PRO W74008 GB~25 tok/s32K (full)No price yet
AMD Radeon PRO W75008 GB~37 tok/s32K (full)No price yet
AMD Radeon PRO W76008 GB~42 tok/s32K (full)No price yet
AMD Radeon RX 6500 XT 8GB8 GB~21 tok/s32K (full)No price yet
AMD Radeon RX 66008 GB~33 tok/s32K (full)No price yet
AMD Radeon RX 6600 XT8 GB~37 tok/s32K (full)No price yet
AMD Radeon RX 6650 XT8 GB~41 tok/s32K (full)No price yet
AMD Radeon RX 74008 GB~25 tok/s32K (full)No price yet
AMD Radeon RX 76008 GB~42 tok/s32K (full)No price yet
AMD Radeon RX 90508 GB~42 tok/s32K (full)No price yet
AMD Radeon RX 90608 GB~42 tok/s32K (full)No price yet
AMD Radeon RX 9060 XT 8GB8 GB~47 tok/s32K (full)No price yet
Intel Arc A5808 GB~35 tok/s32K (full)No price yet
Intel Arc A7508 GB~35 tok/s32K (full)No price yet
Intel Arc A770 8GB8 GB~35 tok/s32K (full)No price yet
NVIDIA GeForce GTX 10708 GB~30 tok/s32K (full)No price yet
NVIDIA GeForce GTX 1070 Ti8 GB~30 tok/s32K (full)No price yet
NVIDIA GeForce GTX 10808 GB~38 tok/s32K (full)No price yet
NVIDIA GeForce RTX 2060 SUPER8 GB~69 tok/s32K (full)No price yet
NVIDIA GeForce RTX 20708 GB~69 tok/s32K (full)No price yet
NVIDIA GeForce RTX 2070 SUPER8 GB~69 tok/s32K (full)No price yet
NVIDIA GeForce RTX 20808 GB~69 tok/s32K (full)No price yet
NVIDIA GeForce RTX 2080 SUPER8 GB~75 tok/s32K (full)No price yet
NVIDIA GeForce RTX 30708 GB~69 tok/s32K (full)No price yet
NVIDIA GeForce RTX 3070 Ti8 GB~90 tok/s32K (full)No price yet
NVIDIA GeForce RTX 40608 GB~43 tok/s32K (full)No price yet
NVIDIA GeForce RTX 4060 Ti 8GB8 GB~45 tok/s32K (full)No price yet
NVIDIA GeForce RTX 50508 GB~50 tok/s32K (full)No price yet
NVIDIA RTX A10008 GB~31 tok/s32K (full)No price yet
NVIDIA T1000 8GB8 GB~26 tok/s32K (full)No price yet
AMD Radeon RX 670010 GB~47 tok/s32K (full)No price yet
Intel Arc B57010 GB~42 tok/s32K (full)No price yet
NVIDIA GeForce RTX 308010 GB~110 tok/s32K (full)No price yet
NVIDIA GeForce GTX 1080 Ti11 GB~56 tok/s32K (full)No price yet
NVIDIA GeForce RTX 2080 Ti11 GB~91 tok/s32K (full)No price yet
AMD Radeon RX 6700 XT12 GB~56 tok/s32K (full)No price yet
AMD Radeon RX 6750 XT12 GB~63 tok/s32K (full)No price yet
AMD Radeon RX 7700 XT12 GB~63 tok/s32K (full)No price yet
AMD Radeon RX 9070 GRE12 GB~63 tok/s32K (full)No price yet
Intel Arc Pro A6012 GB~26 tok/s32K (full)No price yet
NVIDIA GeForce RTX 3080 Ti12 GB~129 tok/s32K (full)No price yet
NVIDIA GeForce RTX 407012 GB~76 tok/s32K (full)No price yet
NVIDIA GeForce RTX 4070 Ti12 GB~76 tok/s32K (full)No price yet
NVIDIA RTX A2000 12GB12 GB~45 tok/s32K (full)No price yet
NVIDIA Tesla P100 PCIe 12GB12 GB~63 tok/s32K (full)No price yet
NVIDIA TITAN Xp12 GB~62 tok/s32K (full)No price yet
AMD Radeon PRO W770016 GB~84 tok/s32K (full)No price yet
AMD Radeon RX 680016 GB~75 tok/s32K (full)No price yet
AMD Radeon RX 6800 XT16 GB~75 tok/s32K (full)No price yet
AMD Radeon RX 6900 XT16 GB~75 tok/s32K (full)No price yet
AMD Radeon RX 6950 XT16 GB~84 tok/s32K (full)No price yet
AMD Radeon RX 7600 XT16 GB~42 tok/s32K (full)No price yet
AMD Radeon RX 770016 GB~91 tok/s32K (full)No price yet
AMD Radeon RX 7900 GRE16 GB~84 tok/s32K (full)No price yet
AMD Radeon RX 9060 XT LP16 GB~47 tok/s32K (full)No price yet
Intel Arc A770 16GB16 GB~38 tok/s32K (full)No price yet
Intel Arc Pro B5016 GB~25 tok/s32K (full)No price yet
NVIDIA GeForce RTX 4060 Ti 16 GB16 GB~45 tok/s32K (full)No price yet
NVIDIA GeForce RTX 4070 Ti SUPER16 GB~99 tok/s32K (full)No price yet
NVIDIA GeForce RTX 408016 GB~104 tok/s32K (full)No price yet
NVIDIA GeForce RTX 4080 SUPER16 GB~107 tok/s32K (full)No price yet
NVIDIA RTX 2000 Ada Generation16 GB~36 tok/s32K (full)No price yet
NVIDIA RTX A400016 GB~69 tok/s32K (full)No price yet
NVIDIA RTX PRO 2000 Blackwell16 GB~45 tok/s32K (full)No price yet
NVIDIA T416 GB~47 tok/s32K (full)No price yet
NVIDIA Tesla P100 PCIe 16GB16 GB~81 tok/s32K (full)No price yet
NVIDIA V100 PCIe 16GB16 GB~127 tok/s32K (full)No price yet
AMD Radeon RX 7900 XT20 GB~117 tok/s32K (full)No price yet
NVIDIA RTX 4000 Ada Generation20 GB~56 tok/s32K (full)No price yet
NVIDIA RTX 4000 SFF Ada Generation20 GB~44 tok/s32K (full)No price yet
NVIDIA RTX A450020 GB~95 tok/s32K (full)No price yet
Intel Arc Pro B6024 GB~51 tok/s32K (full)No price yet
NVIDIA A1024 GB~89 tok/s32K (full)No price yet
NVIDIA GeForce RTX 3090 Ti24 GB~140 tok/s32K (full)No price yet
NVIDIA L424 GB~47 tok/s32K (full)No price yet
NVIDIA Quadro RTX 600024 GB~99 tok/s32K (full)No price yet
NVIDIA RTX 4500 Ada Generation24 GB~66 tok/s32K (full)No price yet
NVIDIA RTX A500024 GB~111 tok/s32K (full)No price yet
NVIDIA RTX A550024 GB~111 tok/s32K (full)No price yet
NVIDIA RTX PRO 4000 Blackwell24 GB~99 tok/s32K (full)No price yet
NVIDIA RTX PRO 4000 SFF Blackwell24 GB~66 tok/s32K (full)No price yet
NVIDIA Tesla P4024 GB~41 tok/s32K (full)No price yet
NVIDIA TITAN RTX24 GB~99 tok/s32K (full)No price yet
AMD Radeon PRO V71028 GB~65 tok/s32K (full)No price yet
AMD Radeon AI PRO R960032 GB~93 tok/s32K (full)No price yet
AMD Radeon AI PRO R9600D32 GB~93 tok/s32K (full)No price yet
AMD Radeon AI PRO R970032 GB~93 tok/s32K (full)No price yet
AMD Radeon AI PRO R9700S32 GB~93 tok/s32K (full)No price yet
AMD Radeon PRO V62032 GB~75 tok/s32K (full)No price yet
AMD Radeon PRO W680032 GB~75 tok/s32K (full)No price yet
AMD Radeon PRO W7800 32GB32 GB~84 tok/s32K (full)No price yet
Intel Arc Pro B7032 GB~68 tok/s32K (full)No price yet
NVIDIA Quadro GV10032 GB~124 tok/s32K (full)No price yet
NVIDIA RTX 5000 Ada Generation32 GB~86 tok/s32K (full)No price yet
NVIDIA RTX PRO 4500 Blackwell32 GB~127 tok/s32K (full)No price yet
NVIDIA V100 PCIe 32GB32 GB~127 tok/s32K (full)No price yet
NVIDIA V100S PCIe 32GB32 GB~154 tok/s32K (full)No price yet
Apple M5 Pro 48GB48 GB (~36 usable)~47 tok/s32K (full)No price yet
NVIDIA A100 40GB PCIe40 GB~198 tok/s32K (full)No price yet
NVIDIA A800 40GB Active40 GB~198 tok/s32K (full)No price yet
AMD Radeon PRO W7800 48GB48 GB~126 tok/s32K (full)No price yet
AMD Radeon PRO W790048 GB~126 tok/s32K (full)No price yet
AMD Radeon PRO W7900 Dual Slot48 GB~126 tok/s32K (full)No price yet
Apple Mac Studio M5 Max (40-core GPU, 64 GB)64 GB (~48 usable)~86 tok/s32K (full)No price yet
NVIDIA A4048 GB~102 tok/s32K (full)No price yet
NVIDIA L4048 GB~123 tok/s32K (full)No price yet
NVIDIA L40S48 GB~123 tok/s32K (full)No price yet
NVIDIA Quadro RTX 800048 GB~99 tok/s32K (full)No price yet
NVIDIA RTX 6000 Ada Generation48 GB~134 tok/s32K (full)No price yet
NVIDIA RTX PRO 5000 Blackwell 48GB48 GB~177 tok/s32K (full)No price yet
NVIDIA RTX PRO 5000 Blackwell 72GB72 GB~177 tok/s32K (full)No price yet
NVIDIA A100 80GB PCIe80 GB~233 tok/s32K (full)No price yet
NVIDIA RTX PRO 6000 Blackwell Max-Q96 GB~220 tok/s32K (full)No price yet
NVIDIA RTX PRO 6000 Blackwell Server Edition96 GB~203 tok/s32K (full)No price yet
NVIDIA RTX PRO 6000 Blackwell Workstation Edition96 GB~220 tok/s32K (full)No price yet

Every device that runs it

Graphics cards, Macs and mini PCs from the wider hardware list behind My rig, smallest usable memory first. Not sure about yours? Check your exact rig.

Show all 204 devices that run it
DeviceTypeMemorySpeed estimateMax context estimatePrice
AMD Radeon PRO W6600Workstation GPU8 GB~33 tok/s32K (full)No price yet
AMD Radeon PRO W7400Workstation GPU8 GB~25 tok/s32K (full)No price yet
AMD Radeon PRO W7500Workstation GPU8 GB~37 tok/s32K (full)No price yet
AMD Radeon PRO W7600Workstation GPU8 GB~42 tok/s32K (full)No price yet
AMD Radeon RX 6500 XT 8GBGPU8 GB~21 tok/s32K (full)No price yet
AMD Radeon RX 6600GPU8 GB~33 tok/s32K (full)No price yet
AMD Radeon RX 6600 XTGPU8 GB~37 tok/s32K (full)No price yet
AMD Radeon RX 6650 XTGPU8 GB~41 tok/s32K (full)No price yet
AMD Radeon RX 7400GPU8 GB~25 tok/s32K (full)No price yet
AMD Radeon RX 7600GPU8 GB~42 tok/s32K (full)No price yet
AMD Radeon RX 9050GPU8 GB~42 tok/s32K (full)No price yet
AMD Radeon RX 9060GPU8 GB~42 tok/s32K (full)No price yet
AMD Radeon RX 9060 XT 8GBGPU8 GB~47 tok/s32K (full)No price yet
Intel Arc A580GPU8 GB~35 tok/s32K (full)No price yet
Intel Arc A750GPU8 GB~35 tok/s32K (full)No price yet
Intel Arc A770 8GBGPU8 GB~35 tok/s32K (full)No price yet
NVIDIA GeForce GTX 1070GPU8 GB~30 tok/s32K (full)No price yet
NVIDIA GeForce GTX 1070 TiGPU8 GB~30 tok/s32K (full)No price yet
NVIDIA GeForce GTX 1080GPU8 GB~38 tok/s32K (full)No price yet
NVIDIA GeForce RTX 2060 SUPERGPU8 GB~69 tok/s32K (full)No price yet
NVIDIA GeForce RTX 2070GPU8 GB~69 tok/s32K (full)No price yet
NVIDIA GeForce RTX 2070 SUPERGPU8 GB~69 tok/s32K (full)No price yet
NVIDIA GeForce RTX 2080GPU8 GB~69 tok/s32K (full)No price yet
NVIDIA GeForce RTX 2080 SUPERGPU8 GB~75 tok/s32K (full)No price yet
NVIDIA GeForce RTX 3070GPU8 GB~69 tok/s32K (full)No price yet
NVIDIA GeForce RTX 3070 TiGPU8 GB~90 tok/s32K (full)No price yet
NVIDIA GeForce RTX 4060GPU8 GB~43 tok/s32K (full)No price yet
NVIDIA GeForce RTX 4060 Ti 8GBGPU8 GB~45 tok/s32K (full)No price yet
NVIDIA GeForce RTX 5050GPU8 GB~50 tok/s32K (full)No price yet
NVIDIA GeForce RTX 5060GPU8 GB~69 tok/s32K (full)low $410avg $550 · new · source, 2026-11-02
NVIDIA GeForce RTX 5060 Ti 8 GBGPU8 GB~69 tok/s32K (full)low $450avg $809 · new · source, 2026-11-02
NVIDIA RTX A1000Workstation GPU8 GB~31 tok/s32K (full)No price yet
NVIDIA T1000 8GBWorkstation GPU8 GB~26 tok/s32K (full)No price yet
AMD Radeon RX 6700GPU10 GB~47 tok/s32K (full)No price yet
Intel Arc B570GPU10 GB~42 tok/s32K (full)No price yet
NVIDIA GeForce RTX 3080GPU10 GB~110 tok/s32K (full)No price yet
Apple M1 Pro 16GBMac16 GB (~10.7 usable)~32 tok/s32K (full)No price yet
Apple M2 16GBMac16 GB (~10.7 usable)~16 tok/s32K (full)No price yet
Apple M2 Pro 16GBMac16 GB (~10.7 usable)~32 tok/s32K (full)No price yet
Apple M3 16GBMac16 GB (~10.7 usable)~16 tok/s32K (full)No price yet
Apple M4 16GBMac16 GB (~10.7 usable)~19 tok/s32K (full)No price yet
Apple M5 16GBMac16 GB (~10.7 usable)~25 tok/s32K (full)No price yet
Apple M6 16GBMac16 GB (~10.7 usable)~25 tok/s32K (full)No price yet
NVIDIA GeForce GTX 1080 TiGPU11 GB~56 tok/s32K (full)No price yet
NVIDIA GeForce RTX 2080 TiGPU11 GB~91 tok/s32K (full)No price yet
AMD Radeon RX 6700 XTGPU12 GB~56 tok/s32K (full)No price yet
AMD Radeon RX 6750 XTGPU12 GB~63 tok/s32K (full)No price yet
AMD Radeon RX 7700 XTGPU12 GB~63 tok/s32K (full)No price yet
AMD Radeon RX 9070 GREGPU12 GB~63 tok/s32K (full)No price yet
Intel Arc B580GPU12 GB~51 tok/s32K (full)low $330avg $446 · new · source, 2026-11-02
Intel Arc Pro A60Workstation GPU12 GB~26 tok/s32K (full)No price yet
NVIDIA GeForce RTX 3060 12 GBGPU12 GB~56 tok/s32K (full)low $305avg $330 · used · source, 2026-11-02
NVIDIA GeForce RTX 3080 TiGPU12 GB~129 tok/s32K (full)No price yet
NVIDIA GeForce RTX 4070GPU12 GB~76 tok/s32K (full)No price yet
NVIDIA GeForce RTX 4070 SUPERGPU12 GB~76 tok/s32K (full)low $620avg $689 · used · source, 2026-11-02
NVIDIA GeForce RTX 4070 TiGPU12 GB~76 tok/s32K (full)No price yet
NVIDIA GeForce RTX 5070GPU12 GB~99 tok/s32K (full)low $800avg $1,086 · new · source, 2026-11-02
NVIDIA RTX A2000 12GBWorkstation GPU12 GB~45 tok/s32K (full)No price yet
NVIDIA Tesla P100 PCIe 12GBData center GPU12 GB~63 tok/s32K (full)No price yet
NVIDIA TITAN XpGPU12 GB~62 tok/s32K (full)No price yet
Apple M3 Pro 18GBMac18 GB (~12.1 usable)~24 tok/s32K (full)No price yet
AMD Radeon PRO W7700Workstation GPU16 GB~84 tok/s32K (full)No price yet
AMD Radeon RX 6800GPU16 GB~75 tok/s32K (full)No price yet
AMD Radeon RX 6800 XTGPU16 GB~75 tok/s32K (full)No price yet
AMD Radeon RX 6900 XTGPU16 GB~75 tok/s32K (full)No price yet
AMD Radeon RX 6950 XTGPU16 GB~84 tok/s32K (full)No price yet
AMD Radeon RX 7600 XTGPU16 GB~42 tok/s32K (full)No price yet
AMD Radeon RX 7700GPU16 GB~91 tok/s32K (full)No price yet
AMD Radeon RX 7800 XTGPU16 GB~91 tok/s32K (full)low $599avg $834 · new · source, 2026-11-02
AMD Radeon RX 7900 GREGPU16 GB~84 tok/s32K (full)No price yet
AMD Radeon RX 9060 XT 16 GBGPU16 GB~47 tok/s32K (full)low $620avg $812 · new · source, 2026-11-02
AMD Radeon RX 9060 XT LPGPU16 GB~47 tok/s32K (full)No price yet
AMD Radeon RX 9070GPU16 GB~93 tok/s32K (full)low $570avg $1,052 · new · source, 2026-11-02
AMD Radeon RX 9070 XTGPU16 GB~93 tok/s32K (full)low $810avg $1,194 · new · source, 2026-11-02
Intel Arc A770 16GBGPU16 GB~38 tok/s32K (full)No price yet
Intel Arc Pro B50Workstation GPU16 GB~25 tok/s32K (full)No price yet
NVIDIA GeForce RTX 4060 Ti 16 GBGPU16 GB~45 tok/s32K (full)No price yet
NVIDIA GeForce RTX 4070 Ti SUPERGPU16 GB~99 tok/s32K (full)No price yet
NVIDIA GeForce RTX 4080GPU16 GB~104 tok/s32K (full)No price yet
NVIDIA GeForce RTX 4080 SUPERGPU16 GB~107 tok/s32K (full)No price yet
NVIDIA GeForce RTX 5060 Ti 16 GBGPU16 GB~69 tok/s32K (full)low $780avg $1,146 · new · source, 2026-11-02
NVIDIA GeForce RTX 5070 TiGPU16 GB~127 tok/s32K (full)low $1,120avg $1,792 · new · source, 2026-11-02
NVIDIA GeForce RTX 5080GPU16 GB~134 tok/s32K (full)low $1,600avg $2,399 · new · source, 2026-11-02
NVIDIA RTX 2000 Ada GenerationWorkstation GPU16 GB~36 tok/s32K (full)No price yet
NVIDIA RTX A4000Workstation GPU16 GB~69 tok/s32K (full)No price yet
NVIDIA RTX PRO 2000 BlackwellWorkstation GPU16 GB~45 tok/s32K (full)No price yet
NVIDIA T4Data center GPU16 GB~47 tok/s32K (full)No price yet
NVIDIA Tesla P100 PCIe 16GBData center GPU16 GB~81 tok/s32K (full)No price yet
NVIDIA V100 PCIe 16GBData center GPU16 GB~127 tok/s32K (full)No price yet
Apple M2 24GBMac24 GB (~16.1 usable)~16 tok/s32K (full)No price yet
Apple M3 24GBMac24 GB (~16.1 usable)~16 tok/s32K (full)No price yet
Apple M4 24GBMac24 GB (~16.1 usable)~19 tok/s32K (full)No price yet
Apple M4 Pro 24GBMac24 GB (~16.1 usable)~42 tok/s32K (full)No price yet
Apple M5 24GBMac24 GB (~16.1 usable)~25 tok/s32K (full)No price yet
Apple M5 Pro 24GBMac24 GB (~16.1 usable)~47 tok/s32K (full)No price yet
Apple M6 24GBMac24 GB (~16.1 usable)~27 tok/s32K (full)No price yet
AMD Radeon RX 7900 XTGPU20 GB~117 tok/s32K (full)No price yet
NVIDIA RTX 4000 Ada GenerationWorkstation GPU20 GB~56 tok/s32K (full)No price yet
NVIDIA RTX 4000 SFF Ada GenerationWorkstation GPU20 GB~44 tok/s32K (full)No price yet
NVIDIA RTX A4500Workstation GPU20 GB~95 tok/s32K (full)No price yet
Apple M1 Max 32GBMac32 GB (~21.4 usable)~60 tok/s32K (full)No price yet
Apple M1 Pro 32GBMac32 GB (~21.4 usable)~32 tok/s32K (full)No price yet
Apple M2 Max (30-core GPU) 32GBMac32 GB (~21.4 usable)~60 tok/s32K (full)No price yet
Apple M2 Max (38-core GPU) 32GBMac32 GB (~21.4 usable)~60 tok/s32K (full)No price yet
Apple M2 Pro 32GBMac32 GB (~21.4 usable)~32 tok/s32K (full)No price yet
Apple M4 32GBMac32 GB (~21.4 usable)~19 tok/s32K (full)No price yet
Apple M5 32GBMac32 GB (~21.4 usable)~25 tok/s32K (full)No price yet
Apple M6 32GBMac32 GB (~21.4 usable)~27 tok/s32K (full)No price yet
AMD Radeon RX 7900 XTXGPU24 GB~140 tok/s32K (full)low $1,350avg $1,552 · new · source, 2026-11-02
Intel Arc Pro B60Workstation GPU24 GB~51 tok/s32K (full)No price yet
NVIDIA A10Data center GPU24 GB~89 tok/s32K (full)No price yet
NVIDIA GeForce RTX 3090GPU24 GB~131 tok/s32K (full)low $1,499avg $1,551 · used · source, 2026-11-02
NVIDIA GeForce RTX 3090 TiGPU24 GB~140 tok/s32K (full)No price yet
NVIDIA GeForce RTX 4090GPU24 GB~140 tok/s32K (full)low $2,910avg $3,100 · used · source, 2026-11-02
NVIDIA L4Data center GPU24 GB~47 tok/s32K (full)No price yet
NVIDIA Quadro RTX 6000Workstation GPU24 GB~99 tok/s32K (full)No price yet
NVIDIA RTX 4500 Ada GenerationWorkstation GPU24 GB~66 tok/s32K (full)No price yet
NVIDIA RTX A5000Workstation GPU24 GB~111 tok/s32K (full)No price yet
NVIDIA RTX A5500Workstation GPU24 GB~111 tok/s32K (full)No price yet
NVIDIA RTX PRO 4000 BlackwellWorkstation GPU24 GB~99 tok/s32K (full)No price yet
NVIDIA RTX PRO 4000 SFF BlackwellWorkstation GPU24 GB~66 tok/s32K (full)No price yet
NVIDIA RTX Spark N1X laptop (6144-core GPU, 24GB)Laptop24 GB~47 tok/s32K (full)No price yet
NVIDIA Tesla P40Data center GPU24 GB~41 tok/s32K (full)No price yet
NVIDIA TITAN RTXGPU24 GB~99 tok/s32K (full)No price yet
Apple M3 Max (30-core GPU) 36GBMac36 GB (~24.1 usable)~46 tok/s32K (full)No price yet
Apple M3 Pro 36GBMac36 GB (~24.1 usable)~24 tok/s32K (full)No price yet
Apple M4 Max (32-core GPU) 36GBMac36 GB (~24.1 usable)~61 tok/s32K (full)No price yet
Apple Mac Studio M5 Max (32-core GPU, 36 GB)Mac36 GB (~24.1 usable)~68 tok/s32K (full)low $2,499new · source, 2026-10-16
AMD Radeon PRO V710Data center GPU28 GB~65 tok/s32K (full)No price yet
AMD Radeon AI PRO R9600Workstation GPU32 GB~93 tok/s32K (full)No price yet
AMD Radeon AI PRO R9600DWorkstation GPU32 GB~93 tok/s32K (full)No price yet
AMD Radeon AI PRO R9700Workstation GPU32 GB~93 tok/s32K (full)No price yet
AMD Radeon AI PRO R9700SWorkstation GPU32 GB~93 tok/s32K (full)No price yet
AMD Radeon PRO V620Data center GPU32 GB~75 tok/s32K (full)No price yet
AMD Radeon PRO W6800Workstation GPU32 GB~75 tok/s32K (full)No price yet
AMD Radeon PRO W7800 32GBWorkstation GPU32 GB~84 tok/s32K (full)No price yet
AMD Ryzen AI Max 385 (32GB)Mini PC32 GB~37 tok/s32K (full)No price yet
AMD Ryzen AI Max 390 (32GB)Mini PC32 GB~37 tok/s32K (full)No price yet
AMD Ryzen AI Max+ 395 (32GB)Mini PC32 GB~37 tok/s32K (full)No price yet
Intel Arc Pro B70Workstation GPU32 GB~68 tok/s32K (full)No price yet
NVIDIA GeForce RTX 5090GPU32 GB~220 tok/s32K (full)low $6,500avg $8,757 · new · source, 2026-11-02
NVIDIA Quadro GV100Workstation GPU32 GB~124 tok/s32K (full)No price yet
NVIDIA RTX 5000 Ada GenerationWorkstation GPU32 GB~86 tok/s32K (full)No price yet
NVIDIA RTX PRO 4500 BlackwellWorkstation GPU32 GB~127 tok/s32K (full)No price yet
NVIDIA RTX Spark N1X laptop (6144-core GPU, 32GB)Laptop32 GB~47 tok/s32K (full)No price yet
NVIDIA V100 PCIe 32GBData center GPU32 GB~127 tok/s32K (full)No price yet
NVIDIA V100S PCIe 32GBData center GPU32 GB~154 tok/s32K (full)No price yet
Apple M3 Max (40-core GPU) 48GBMac48 GB (~36 usable)~60 tok/s32K (full)No price yet
Apple M4 Max (40-core GPU) 48GBMac48 GB (~36 usable)~78 tok/s32K (full)No price yet
Apple M4 Pro 48GBMac48 GB (~36 usable)~42 tok/s32K (full)No price yet
Apple M5 Max (40-core GPU) 48GBMac48 GB (~36 usable)~86 tok/s32K (full)No price yet
Apple M5 Pro 48GBMac48 GB (~36 usable)~47 tok/s32K (full)No price yet
NVIDIA A100 40GB PCIeData center GPU40 GB~198 tok/s32K (full)No price yet
NVIDIA A800 40GB ActiveWorkstation GPU40 GB~198 tok/s32K (full)No price yet
AMD Radeon PRO W7800 48GBWorkstation GPU48 GB~126 tok/s32K (full)No price yet
AMD Radeon PRO W7900Workstation GPU48 GB~126 tok/s32K (full)No price yet
AMD Radeon PRO W7900 Dual SlotWorkstation GPU48 GB~126 tok/s32K (full)No price yet
Apple M1 Max 64GBMac64 GB (~48 usable)~60 tok/s32K (full)No price yet
Apple M1 Ultra 64GBMac64 GB (~48 usable)~107 tok/s32K (full)No price yet
Apple M2 Max (30-core GPU) 64GBMac64 GB (~48 usable)~60 tok/s32K (full)No price yet
Apple M2 Max (38-core GPU) 64GBMac64 GB (~48 usable)~60 tok/s32K (full)No price yet
Apple M2 Ultra 64GBMac64 GB (~48 usable)~107 tok/s32K (full)No price yet
Apple M3 Max (40-core GPU) 64GBMac64 GB (~48 usable)~60 tok/s32K (full)No price yet
Apple M4 Max (40-core GPU) 64GBMac64 GB (~48 usable)~78 tok/s32K (full)No price yet
Apple M4 Pro 64GBMac64 GB (~48 usable)~42 tok/s32K (full)No price yet
Apple M5 Pro 64GBMac64 GB (~48 usable)~47 tok/s32K (full)No price yet
Apple Mac Studio M5 Max (40-core GPU, 64 GB)Mac64 GB (~48 usable)~86 tok/s32K (full)No price yet
NVIDIA A40Data center GPU48 GB~102 tok/s32K (full)No price yet
NVIDIA L40Data center GPU48 GB~123 tok/s32K (full)No price yet
NVIDIA L40SData center GPU48 GB~123 tok/s32K (full)No price yet
NVIDIA Quadro RTX 8000Workstation GPU48 GB~99 tok/s32K (full)No price yet
NVIDIA RTX 6000 Ada GenerationWorkstation GPU48 GB~134 tok/s32K (full)No price yet
NVIDIA RTX A6000Workstation GPU48 GB~111 tok/s32K (full)low $8,363new · source, 2026-11-02
NVIDIA RTX PRO 5000 Blackwell 48GBWorkstation GPU48 GB~177 tok/s32K (full)No price yet
NVIDIA RTX Spark N1X laptop (6144-core GPU, 48GB)Laptop48 GB~47 tok/s32K (full)No price yet
AMD Ryzen AI Max 385 (64GB)Mini PC64 GB~37 tok/s32K (full)No price yet
AMD Ryzen AI Max 390 (64GB)Mini PC64 GB~37 tok/s32K (full)No price yet
AMD Ryzen AI Max+ 395 (64GB)Mini PC64 GB~37 tok/s32K (full)low $2,199.99new · source, 2026-11-13
NVIDIA DGX Spark (64GB)Mini PC64 GB~43 tok/s32K (full)low $4,999new · source, 2026-11-13
NVIDIA RTX Spark N1X laptop (6144-core GPU, 64GB)Laptop64 GB~47 tok/s32K (full)No price yet
Apple M2 Max (38-core GPU) 96GBMac96 GB (~72 usable)~60 tok/s32K (full)No price yet
Apple M3 Max (30-core GPU) 96GBMac96 GB (~72 usable)~46 tok/s32K (full)No price yet
Apple M3 Ultra 96GBMac96 GB (~72 usable)~109 tok/s32K (full)No price yet
Apple Mac Studio M5 Ultra (64-core GPU, 96 GB)Mac96 GB (~72 usable)~146 tok/s32K (full)low $5,499new · source, 2026-10-23
NVIDIA RTX PRO 5000 Blackwell 72GBWorkstation GPU72 GB~177 tok/s32K (full)No price yet
NVIDIA A100 80GB PCIeData center GPU80 GB~233 tok/s32K (full)No price yet
Apple M1 Ultra 128GBMac128 GB (~96 usable)~107 tok/s32K (full)No price yet
Apple M2 Ultra 128GBMac128 GB (~96 usable)~107 tok/s32K (full)No price yet
Apple M3 Max (40-core GPU) 128GBMac128 GB (~96 usable)~60 tok/s32K (full)No price yet
Apple M4 Max (40-core GPU) 128GBMac128 GB (~96 usable)~78 tok/s32K (full)No price yet
Apple M5 Max (40-core GPU) 128GBMac128 GB (~96 usable)~86 tok/s32K (full)No price yet
NVIDIA RTX PRO 6000 Blackwell Max-QWorkstation GPU96 GB~220 tok/s32K (full)No price yet
NVIDIA RTX PRO 6000 Blackwell Server EditionData center GPU96 GB~203 tok/s32K (full)No price yet
NVIDIA RTX PRO 6000 Blackwell Workstation EditionWorkstation GPU96 GB~220 tok/s32K (full)No price yet
AMD Ryzen AI Max 385 (128GB)Mini PC128 GB~37 tok/s32K (full)No price yet
AMD Ryzen AI Max 390 (128GB)Mini PC128 GB~37 tok/s32K (full)No price yet
AMD Ryzen AI Max+ 395 (128GB)Mini PC128 GB~37 tok/s32K (full)low $3,499.99new · source, 2026-11-13
NVIDIA DGX Spark (128GB)Mini PC128 GB~43 tok/s32K (full)low $6,949.99new · source, 2026-10-23
NVIDIA RTX Spark N1X laptop (6144-core GPU, 128GB)Laptop128 GB~47 tok/s32K (full)No price yet
Apple M2 Ultra 192GBMac192 GB (~144 usable)~107 tok/s32K (full)No price yet
Apple M3 Ultra 256GBMac256 GB (~192 usable)~109 tok/s32K (full)No price yet
Apple M5 Ultra 256GBMac256 GB (~192 usable)~146 tok/s32K (full)No price yet
Framework Desktop, AMD Ryzen AI Max+ PRO 495 (Strix Halo), 192 GBMini PC192 GB~40 tok/s32K (full)low $6,799new · source, 2026-10-16
Apple M5 Ultra 512GBMac512 GB (~384 usable)~146 tok/s32K (full)No price yet

Speed calculator

estimate

Estimate = bandwidth ÷ GB read per token (the model's listed GGUF file: Q4_K_M for most models, otherwise the quant named in the list; scaled by active/total parameters for MoE), scaled by a per-platform efficiency and fixed per-token costs calibrated to 45 measured llama.cpp benchmarks (2025–26). Fit = file size + 1.5 GB headroom ≤ total VRAM (on Macs, the part of unified memory macOS lets the GPU use by default), and room for at least 4K tokens of context with an 8-bit KV cache. For a model with no KV cache data, only the file and headroom are checked, so a fit says nothing about context. Multi-GPU: VRAM adds, speed stays one card's (a layer split runs the cards in turn); max context uses the total. Speed is for short context. Max context = what is left after the file and a 1 GB runtime reserve ÷ KV cache bytes per token, default FP16 and 8-bit (q8_0) cache. How speed works · how context works

Related