RigPerDollar

What GPU do you need to run PLaMo 3 Translate 2B?

A used GeForce RTX 3060 12 GB ($305). It is the cheapest priced graphics card that holds PLaMo 3 Translate 2B (about 3.3 GB at Q4) with room for its full 32K context, at about 145 tok/s estimate; that is the card price only, and it requires a separate compatible PC. 157 of the 157 GPUs and systems we track fit it.

Translation only PLaMo 3 Translate 2B is a translation model, not a general chat assistant. The fits and speeds below say whether it runs on a machine, not that it is a good everyday chat model, so the site's automatic picks (the largest model a card runs, can-run pages) leave it out. License: PLaMo Community License.

Parameters2.88B
Q4_K_M GGUF1.81 GBsource
VRAM needed~3.3 GBfile + headroom
Single GPUs that fit157
ReleasedNov 5, 2026source
LicensePLaMo Community Licensesource
Context window32K tokens

2.88B parameters (Hugging Face, accessed 2026-11-10). Q4_K_M GGUF: 1.81 GB (source). Architecture config (Hugging Face config.json; 24 layers, window_size 2048, sliding_window_pattern 8: llama.cpp plamo3 (load_swa_pattern(ml, 8), LLAMA_SWA_TYPE_STANDARD) makes layer il sliding-window unless il % 8 == 7, so 3 full-attention + 21 sliding-window layers; the official GGUF metadata says the same (sliding_window 2048, sliding_window_pattern 8). max_ctx is the model card's 32,768-token training limit for input and output combined (the context field), not config.json's max_position_embeddings 262,144): 3 global attention layers × 4 KV heads × 128 head dim, plus 21 sliding-window layers (2048-token window), so about 6 KB of FP16 KV cache per token of context (how we estimate context).

Translation model, not a general chat assistant: it takes text in one language and returns a translation, through its own translation prompt format. Dense model, one of four PLaMo 3 Translate sizes. Context is 32,768 tokens because the model card says training used at most 32,768 tokens of input and output combined and asks you to split anything longer; config.json allows 262,144 positions, which this page does not treat as usable. Commercial use needs advance registration with Preferred Networks (see License below). Release date is the date of PFN's release blog post.

What we checked

Checked Nov 10, 2026. Official is the maker or the weight files. A vendor claim is that project's own documentation. A community claim is someone else's upload. Our check is a file or search we read. Unknown means we have no source, so it is not estimated. None of these rows is a speed we measured.

KindWhatDetailSource
OfficialModel cardPFN's card describes PLaMo 3 Translate as a translation-specialized model, tagged translation on Hugging Face, not a general chat or coding assistant. It uses a translation chat template (the PFML3 prompt format). The release blog covers four sizes (0.8B, 2B, 8B, 31B) and 53 languages, and says the model accepts surrounding context and glossaries and can write plain or polite Japanese. The card says the longest training sequence was 32,768 tokens for input and output combined and to split anything longer, so this page uses 32,768 as the context, not config.json's 262,144. Safetensors total 2,878,595,584 parameters (2.88B), BF16, dense. The repo is not gated.Model card, checked Nov 10, 2026
OfficialGGUF filesPFN publishes the GGUF build itself (pfnet/plamo-3-translate-2b-GGUF), one file per quant: Q4_K_M 1,807,203,040 bytes, Q4_0 1,698,577,120 bytes, Q3_K_M 1,495,886,560 bytes, Q2_K 1,225,612,000 bytes. This page's fit and speed estimates use the Q4_K_M file. The 31B card's example runs llama-server with -c 16384, --jinja and --no-prefill-assistant; 16,384 is only their example. We read the sizes from the Hugging Face file list and did not download them.GGUF repo, checked Nov 10, 2026
OfficialMLX 4-bit buildPFN also publishes an MLX 4-bit build for Apple silicon (pfnet/plamo-3-translate-2b-MLX-4bit), 2,410,973,952 bytes of safetensors. Its card says to run it with mlx-lm with trust_remote_code=True. Other official formats in the release are BF16, FP8, W4A16, W4AFP8 and NVFP4. We have not run the MLX build on a Mac, and no MLX speed is listed.MLX-4bit repo, checked Nov 10, 2026
OfficialLicense: commercial use needs registrationPLaMo Community License. Personal and non-commercial use, including academic use, is free with no registration. Commercial use is free only if you (with your affiliates) had revenue of JPY 1 billion or less in the most recent fiscal year AND you register with PFN in advance through its form (https://forms.gle/mTL8tBLrMYXKNZD56). Above JPY 1 billion you need a separate license agreement with PFN (https://translate.preferredai.jp/llm/contact/). This is a summary of the license, not legal advice.PLaMo Community License, checked Nov 10, 2026
Vendor claimPFN's benchmark claimsPFN's own claim: even the 0.8B model outperforms existing translation-specialized models (TranslateGemma, Hy-MT2) on Japanese-English and on Japanese to and from other languages, and PFN calls PLaMo 3 Translate the world's best translation-specialized LLM. Its benchmarks are PFTB and SaaS (PFN internal sets), WMT24++ (COMET-22) and FLORES+ (chrF++). PFN's card also says the Q2_K GGUF loses accuracy on some metrics while the other formats stay close to BF16. These are PFN's results; we have not reproduced any of them.PFN release blog, checked Nov 10, 2026
Our checkllama.cpp and mlx-lm supportllama.cpp master has a plamo3 architecture (src/models/plamo3.cpp), and the official GGUF header says general.architecture plamo3. With a sliding window set, llama.cpp loads a sliding-window pattern of 8: in each group of 8 layers, 7 use a 2,048-token sliding window and 1 uses full attention. For this size that is 3 full-attention and 21 sliding-window layers of 24, with 4 KV heads of size 128, which is what the context estimates use. mlx-lm master has mlx_lm/models/plamo3.py.llama.cpp plamo3.cpp, checked Nov 10, 2026
UnknownNot tested by usWe have not run any PLaMo 3 Translate model. No speed on this page is measured: tok/s figures are the site's bandwidth estimates. Translation quality is not tested by us, and the sizes are not compared with each other or with other models here.Model card does not give this, checked Nov 10, 2026

GGUF files and sizes

Exact sizes from Hugging Face, accessed 2026-11-10. The fit and context tables on this page use the Q4_K_M file (1.81 GB); a smaller file needs less memory by the difference. VRAM needed is the file + the same headroom.

FilePublished byBytesSizeVRAM neededSource
Q2_KPreferred Networks1,225,612,0001.23 GB~2.7 GBHugging Face
Q3_K_MPreferred Networks1,495,886,5601.5 GB~3 GBHugging Face
Q4_0Preferred Networks1,698,577,1201.7 GB~3.2 GBHugging Face
Q4_K_MPreferred Networks1,807,203,0401.81 GB~3.3 GBHugging Face

Other places to get it

Checked Nov 14, 2026. We list only copies we opened and checked. Check file hashes for copies from other uploaders.

Single GPUs that fit, cheapest first

Single GPU that fitsVRAMSpeed estimateMax context estimatePrice
NVIDIA GeForce RTX 3060 12 GB12 GB~145 tok/s32K (full)low $305avg $330 · used · source, 2026-11-02
Intel Arc B58012 GB~149 tok/s32K (full)low $330avg $446 · new · source, 2026-11-02
NVIDIA GeForce RTX 50608 GB~173 tok/s32K (full)low $410avg $550 · new · source, 2026-11-02
NVIDIA GeForce RTX 5060 Ti 8 GB8 GB~173 tok/s32K (full)low $450avg $809 · new · source, 2026-11-02
AMD Radeon RX 907016 GB~272 tok/s32K (full)low $570avg $1,052 · new · source, 2026-11-02
AMD Radeon RX 7800 XT16 GB~265 tok/s32K (full)low $599avg $834 · new · source, 2026-11-02
NVIDIA GeForce RTX 4070 SUPER12 GB~189 tok/s32K (full)low $620avg $689 · used · source, 2026-11-02
AMD Radeon RX 9060 XT 16 GB16 GB~136 tok/s32K (full)low $620avg $812 · new · source, 2026-11-02
NVIDIA GeForce RTX 5060 Ti 16 GB16 GB~173 tok/s32K (full)low $780avg $1,146 · new · source, 2026-11-02
NVIDIA GeForce RTX 507012 GB~235 tok/s32K (full)low $800avg $1,086 · new · source, 2026-11-02
AMD Radeon RX 9070 XT16 GB~272 tok/s32K (full)low $810avg $1,194 · new · source, 2026-11-02
NVIDIA GeForce RTX 5070 Ti16 GB~286 tok/s32K (full)low $1,120avg $1,792 · new · source, 2026-11-02
AMD Radeon RX 7900 XTX24 GB~408 tok/s32K (full)low $1,350avg $1,552 · new · source, 2026-11-02
NVIDIA GeForce RTX 309024 GB~294 tok/s32K (full)low $1,499avg $1,551 · used · source, 2026-11-02
NVIDIA GeForce RTX 508016 GB~299 tok/s32K (full)low $1,600avg $2,399 · new · source, 2026-11-02
Apple Mac Studio M5 Max (32-core GPU, 36 GB)36 GB (~24.1 usable)~158 tok/s32K (full)low $2,499new · source, 2026-10-16
NVIDIA GeForce RTX 409024 GB~309 tok/s32K (full)low $2,910avg $3,100 · used · source, 2026-11-02
NVIDIA DGX Spark (64GB)64 GB~114 tok/s32K (full)low $4,999new · source, 2026-11-13
Apple Mac Studio M5 Ultra (64-core GPU, 96 GB)96 GB (~72 usable)~278 tok/s32K (full)low $5,499new · source, 2026-10-23
NVIDIA GeForce RTX 509032 GB~426 tok/s32K (full)low $6,500avg $8,757 · new · source, 2026-11-02
Framework Desktop, AMD Ryzen AI Max+ PRO 495 (Strix Halo), 192 GB192 GB~116 tok/s32K (full)low $6,799new · source, 2026-10-16
NVIDIA DGX Spark (128GB)128 GB~114 tok/s32K (full)low $6,949.99new · source, 2026-10-23
NVIDIA RTX A600048 GB~258 tok/s32K (full)low $8,363new · source, 2026-11-02
AMD Radeon PRO W64004 GB~54 tok/s32K (full)No price yet
AMD Radeon RX 64004 GB~54 tok/s32K (full)No price yet
AMD Radeon RX 6500 XT 4GB4 GB~61 tok/s32K (full)No price yet
AMD Radeon RX 9050 4GB4 GB~61 tok/s32K (full)No price yet
Intel Arc A3104 GB~25 tok/s32K (full)No price yet
NVIDIA GeForce GTX 1050 Ti4 GB~38 tok/s32K (full)No price yet
NVIDIA GeForce GTX 1650 (GDDR5)4 GB~58 tok/s32K (full)No price yet
NVIDIA GeForce GTX 1650 (GDDR6)4 GB~84 tok/s32K (full)No price yet
NVIDIA RTX A4004 GB~44 tok/s32K (full)No price yet
Intel Arc A3806 GB~37 tok/s32K (full)No price yet
Intel Arc Pro A406 GB~38 tok/s32K (full)No price yet
Intel Arc Pro A506 GB~38 tok/s32K (full)No price yet
NVIDIA GeForce GTX 1060 6GB6 GB~64 tok/s32K (full)No price yet
NVIDIA GeForce GTX 16606 GB~84 tok/s32K (full)No price yet
NVIDIA GeForce GTX 1660 SUPER6 GB~137 tok/s32K (full)No price yet
NVIDIA GeForce GTX 1660 Ti6 GB~120 tok/s32K (full)No price yet
NVIDIA GeForce RTX 2060 6GB6 GB~137 tok/s32K (full)No price yet
NVIDIA RTX A2000 6GB6 GB~120 tok/s32K (full)No price yet
AMD Radeon PRO W66008 GB~95 tok/s32K (full)No price yet
AMD Radeon PRO W74008 GB~74 tok/s32K (full)No price yet
AMD Radeon PRO W75008 GB~109 tok/s32K (full)No price yet
AMD Radeon PRO W76008 GB~123 tok/s32K (full)No price yet
AMD Radeon RX 6500 XT 8GB8 GB~61 tok/s32K (full)No price yet
AMD Radeon RX 66008 GB~95 tok/s32K (full)No price yet
AMD Radeon RX 6600 XT8 GB~109 tok/s32K (full)No price yet
AMD Radeon RX 6650 XT8 GB~119 tok/s32K (full)No price yet
AMD Radeon RX 74008 GB~74 tok/s32K (full)No price yet
AMD Radeon RX 76008 GB~123 tok/s32K (full)No price yet
AMD Radeon RX 90508 GB~123 tok/s32K (full)No price yet
AMD Radeon RX 90608 GB~123 tok/s32K (full)No price yet
AMD Radeon RX 9060 XT 8GB8 GB~136 tok/s32K (full)No price yet
Intel Arc A5808 GB~102 tok/s32K (full)No price yet
Intel Arc A7508 GB~102 tok/s32K (full)No price yet
Intel Arc A770 8GB8 GB~102 tok/s32K (full)No price yet
NVIDIA GeForce GTX 10708 GB~83 tok/s32K (full)No price yet
NVIDIA GeForce GTX 1070 Ti8 GB~83 tok/s32K (full)No price yet
NVIDIA GeForce GTX 10808 GB~101 tok/s32K (full)No price yet
NVIDIA GeForce RTX 2060 SUPER8 GB~173 tok/s32K (full)No price yet
NVIDIA GeForce RTX 20708 GB~173 tok/s32K (full)No price yet
NVIDIA GeForce RTX 2070 SUPER8 GB~173 tok/s32K (full)No price yet
NVIDIA GeForce RTX 20808 GB~173 tok/s32K (full)No price yet
NVIDIA GeForce RTX 2080 SUPER8 GB~187 tok/s32K (full)No price yet
NVIDIA GeForce RTX 30708 GB~173 tok/s32K (full)No price yet
NVIDIA GeForce RTX 3070 Ti8 GB~218 tok/s32K (full)No price yet
NVIDIA GeForce RTX 40608 GB~114 tok/s32K (full)No price yet
NVIDIA GeForce RTX 4060 Ti 8GB8 GB~120 tok/s32K (full)No price yet
NVIDIA GeForce RTX 50508 GB~131 tok/s32K (full)No price yet
NVIDIA RTX A10008 GB~84 tok/s32K (full)No price yet
NVIDIA T1000 8GB8 GB~71 tok/s32K (full)No price yet
AMD Radeon RX 670010 GB~136 tok/s32K (full)No price yet
Intel Arc B57010 GB~124 tok/s32K (full)No price yet
NVIDIA GeForce RTX 308010 GB~256 tok/s32K (full)No price yet
NVIDIA GeForce GTX 1080 Ti11 GB~144 tok/s32K (full)No price yet
NVIDIA GeForce RTX 2080 Ti11 GB~220 tok/s32K (full)No price yet
AMD Radeon RX 6700 XT12 GB~163 tok/s32K (full)No price yet
AMD Radeon RX 6750 XT12 GB~184 tok/s32K (full)No price yet
AMD Radeon RX 7700 XT12 GB~184 tok/s32K (full)No price yet
AMD Radeon RX 9070 GRE12 GB~184 tok/s32K (full)No price yet
Intel Arc Pro A6012 GB~76 tok/s32K (full)No price yet
NVIDIA GeForce RTX 3080 Ti12 GB~289 tok/s32K (full)No price yet
NVIDIA GeForce RTX 407012 GB~189 tok/s32K (full)No price yet
NVIDIA GeForce RTX 4070 Ti12 GB~189 tok/s32K (full)No price yet
NVIDIA RTX A2000 12GB12 GB~120 tok/s32K (full)No price yet
NVIDIA Tesla P100 PCIe 12GB12 GB~159 tok/s32K (full)No price yet
NVIDIA TITAN Xp12 GB~159 tok/s32K (full)No price yet
AMD Radeon PRO W770016 GB~245 tok/s32K (full)No price yet
AMD Radeon RX 680016 GB~218 tok/s32K (full)No price yet
AMD Radeon RX 6800 XT16 GB~218 tok/s32K (full)No price yet
AMD Radeon RX 6900 XT16 GB~218 tok/s32K (full)No price yet
AMD Radeon RX 6950 XT16 GB~245 tok/s32K (full)No price yet
AMD Radeon RX 7600 XT16 GB~123 tok/s32K (full)No price yet
AMD Radeon RX 770016 GB~265 tok/s32K (full)No price yet
AMD Radeon RX 7900 GRE16 GB~245 tok/s32K (full)No price yet
AMD Radeon RX 9060 XT LP16 GB~136 tok/s32K (full)No price yet
Intel Arc A770 16GB16 GB~111 tok/s32K (full)No price yet
Intel Arc Pro B5016 GB~73 tok/s32K (full)No price yet
NVIDIA GeForce RTX 4060 Ti 16 GB16 GB~120 tok/s32K (full)No price yet
NVIDIA GeForce RTX 4070 Ti SUPER16 GB~235 tok/s32K (full)No price yet
NVIDIA GeForce RTX 408016 GB~246 tok/s32K (full)No price yet
NVIDIA GeForce RTX 4080 SUPER16 GB~250 tok/s32K (full)No price yet
NVIDIA RTX 2000 Ada Generation16 GB~96 tok/s32K (full)No price yet
NVIDIA RTX A400016 GB~173 tok/s32K (full)No price yet
NVIDIA RTX PRO 2000 Blackwell16 GB~120 tok/s32K (full)No price yet
NVIDIA T416 GB~124 tok/s32K (full)No price yet
NVIDIA Tesla P100 PCIe 16GB16 GB~200 tok/s32K (full)No price yet
NVIDIA V100 PCIe 16GB16 GB~287 tok/s32K (full)No price yet
AMD Radeon RX 7900 XT20 GB~340 tok/s32K (full)No price yet
NVIDIA RTX 4000 Ada Generation20 GB~145 tok/s32K (full)No price yet
NVIDIA RTX 4000 SFF Ada Generation20 GB~117 tok/s32K (full)No price yet
NVIDIA RTX A450020 GB~227 tok/s32K (full)No price yet
Intel Arc Pro B6024 GB~149 tok/s32K (full)No price yet
NVIDIA A1024 GB~216 tok/s32K (full)No price yet
NVIDIA GeForce RTX 3090 Ti24 GB~309 tok/s32K (full)No price yet
NVIDIA L424 GB~124 tok/s32K (full)No price yet
NVIDIA Quadro RTX 600024 GB~235 tok/s32K (full)No price yet
NVIDIA RTX 4500 Ada Generation24 GB~168 tok/s32K (full)No price yet
NVIDIA RTX A500024 GB~258 tok/s32K (full)No price yet
NVIDIA RTX A550024 GB~258 tok/s32K (full)No price yet
NVIDIA RTX PRO 4000 Blackwell24 GB~235 tok/s32K (full)No price yet
NVIDIA RTX PRO 4000 SFF Blackwell24 GB~168 tok/s32K (full)No price yet
NVIDIA Tesla P4024 GB~108 tok/s32K (full)No price yet
NVIDIA TITAN RTX24 GB~235 tok/s32K (full)No price yet
AMD Radeon PRO V71028 GB~191 tok/s32K (full)No price yet
AMD Radeon AI PRO R960032 GB~272 tok/s32K (full)No price yet
AMD Radeon AI PRO R9600D32 GB~272 tok/s32K (full)No price yet
AMD Radeon AI PRO R970032 GB~272 tok/s32K (full)No price yet
AMD Radeon AI PRO R9700S32 GB~272 tok/s32K (full)No price yet
AMD Radeon PRO V62032 GB~218 tok/s32K (full)No price yet
AMD Radeon PRO W680032 GB~218 tok/s32K (full)No price yet
AMD Radeon PRO W7800 32GB32 GB~245 tok/s32K (full)No price yet
Intel Arc Pro B7032 GB~198 tok/s32K (full)No price yet
NVIDIA Quadro GV10032 GB~281 tok/s32K (full)No price yet
NVIDIA RTX 5000 Ada Generation32 GB~210 tok/s32K (full)No price yet
NVIDIA RTX PRO 4500 Blackwell32 GB~286 tok/s32K (full)No price yet
NVIDIA V100 PCIe 32GB32 GB~287 tok/s32K (full)No price yet
NVIDIA V100S PCIe 32GB32 GB~332 tok/s32K (full)No price yet
Apple M5 Pro 48GB48 GB (~36 usable)~117 tok/s32K (full)No price yet
NVIDIA A100 40GB PCIe40 GB~396 tok/s32K (full)No price yet
NVIDIA A800 40GB Active40 GB~396 tok/s32K (full)No price yet
AMD Radeon PRO W7800 48GB48 GB~368 tok/s32K (full)No price yet
AMD Radeon PRO W790048 GB~368 tok/s32K (full)No price yet
AMD Radeon PRO W7900 Dual Slot48 GB~368 tok/s32K (full)No price yet
Apple Mac Studio M5 Max (40-core GPU, 64 GB)64 GB (~48 usable)~192 tok/s32K (full)No price yet
NVIDIA A4048 GB~241 tok/s32K (full)No price yet
NVIDIA L4048 GB~279 tok/s32K (full)No price yet
NVIDIA L40S48 GB~279 tok/s32K (full)No price yet
NVIDIA Quadro RTX 800048 GB~235 tok/s32K (full)No price yet
NVIDIA RTX 6000 Ada Generation48 GB~299 tok/s32K (full)No price yet
NVIDIA RTX PRO 5000 Blackwell 48GB48 GB~366 tok/s32K (full)No price yet
NVIDIA RTX PRO 5000 Blackwell 72GB72 GB~366 tok/s32K (full)No price yet
NVIDIA A100 80GB PCIe80 GB~442 tok/s32K (full)No price yet
NVIDIA RTX PRO 6000 Blackwell Max-Q96 GB~426 tok/s32K (full)No price yet
NVIDIA RTX PRO 6000 Blackwell Server Edition96 GB~404 tok/s32K (full)No price yet
NVIDIA RTX PRO 6000 Blackwell Workstation Edition96 GB~426 tok/s32K (full)No price yet

Every device that runs it

Graphics cards, Macs and mini PCs from the wider hardware list behind My rig, smallest usable memory first. Not sure about yours? Check your exact rig.

Show all 224 devices that run it
DeviceTypeMemorySpeed estimateMax context estimatePrice
AMD Radeon PRO W6400Workstation GPU4 GB~54 tok/s32K (full)No price yet
AMD Radeon RX 6400GPU4 GB~54 tok/s32K (full)No price yet
AMD Radeon RX 6500 XT 4GBGPU4 GB~61 tok/s32K (full)No price yet
AMD Radeon RX 9050 4GBGPU4 GB~61 tok/s32K (full)No price yet
Intel Arc A310GPU4 GB~25 tok/s32K (full)No price yet
NVIDIA GeForce GTX 1050 TiGPU4 GB~38 tok/s32K (full)No price yet
NVIDIA GeForce GTX 1650 (GDDR5)GPU4 GB~58 tok/s32K (full)No price yet
NVIDIA GeForce GTX 1650 (GDDR6)GPU4 GB~84 tok/s32K (full)No price yet
NVIDIA RTX A400Workstation GPU4 GB~44 tok/s32K (full)No price yet
Apple M2 8GBMac8 GB (~5.4 usable)~45 tok/s32K (full)No price yet
Apple M3 8GBMac8 GB (~5.4 usable)~45 tok/s32K (full)No price yet
Intel Arc A380GPU6 GB~37 tok/s32K (full)No price yet
Intel Arc Pro A40Workstation GPU6 GB~38 tok/s32K (full)No price yet
Intel Arc Pro A50Workstation GPU6 GB~38 tok/s32K (full)No price yet
NVIDIA GeForce GTX 1060 6GBGPU6 GB~64 tok/s32K (full)No price yet
NVIDIA GeForce GTX 1660GPU6 GB~84 tok/s32K (full)No price yet
NVIDIA GeForce GTX 1660 SUPERGPU6 GB~137 tok/s32K (full)No price yet
NVIDIA GeForce GTX 1660 TiGPU6 GB~120 tok/s32K (full)No price yet
NVIDIA GeForce RTX 2060 6GBGPU6 GB~137 tok/s32K (full)No price yet
NVIDIA RTX A2000 6GBWorkstation GPU6 GB~120 tok/s32K (full)No price yet
AMD Radeon PRO W6600Workstation GPU8 GB~95 tok/s32K (full)No price yet
AMD Radeon PRO W7400Workstation GPU8 GB~74 tok/s32K (full)No price yet
AMD Radeon PRO W7500Workstation GPU8 GB~109 tok/s32K (full)No price yet
AMD Radeon PRO W7600Workstation GPU8 GB~123 tok/s32K (full)No price yet
AMD Radeon RX 6500 XT 8GBGPU8 GB~61 tok/s32K (full)No price yet
AMD Radeon RX 6600GPU8 GB~95 tok/s32K (full)No price yet
AMD Radeon RX 6600 XTGPU8 GB~109 tok/s32K (full)No price yet
AMD Radeon RX 6650 XTGPU8 GB~119 tok/s32K (full)No price yet
AMD Radeon RX 7400GPU8 GB~74 tok/s32K (full)No price yet
AMD Radeon RX 7600GPU8 GB~123 tok/s32K (full)No price yet
AMD Radeon RX 9050GPU8 GB~123 tok/s32K (full)No price yet
AMD Radeon RX 9060GPU8 GB~123 tok/s32K (full)No price yet
AMD Radeon RX 9060 XT 8GBGPU8 GB~136 tok/s32K (full)No price yet
Intel Arc A580GPU8 GB~102 tok/s32K (full)No price yet
Intel Arc A750GPU8 GB~102 tok/s32K (full)No price yet
Intel Arc A770 8GBGPU8 GB~102 tok/s32K (full)No price yet
NVIDIA GeForce GTX 1070GPU8 GB~83 tok/s32K (full)No price yet
NVIDIA GeForce GTX 1070 TiGPU8 GB~83 tok/s32K (full)No price yet
NVIDIA GeForce GTX 1080GPU8 GB~101 tok/s32K (full)No price yet
NVIDIA GeForce RTX 2060 SUPERGPU8 GB~173 tok/s32K (full)No price yet
NVIDIA GeForce RTX 2070GPU8 GB~173 tok/s32K (full)No price yet
NVIDIA GeForce RTX 2070 SUPERGPU8 GB~173 tok/s32K (full)No price yet
NVIDIA GeForce RTX 2080GPU8 GB~173 tok/s32K (full)No price yet
NVIDIA GeForce RTX 2080 SUPERGPU8 GB~187 tok/s32K (full)No price yet
NVIDIA GeForce RTX 3070GPU8 GB~173 tok/s32K (full)No price yet
NVIDIA GeForce RTX 3070 TiGPU8 GB~218 tok/s32K (full)No price yet
NVIDIA GeForce RTX 4060GPU8 GB~114 tok/s32K (full)No price yet
NVIDIA GeForce RTX 4060 Ti 8GBGPU8 GB~120 tok/s32K (full)No price yet
NVIDIA GeForce RTX 5050GPU8 GB~131 tok/s32K (full)No price yet
NVIDIA GeForce RTX 5060GPU8 GB~173 tok/s32K (full)low $410avg $550 · new · source, 2026-11-02
NVIDIA GeForce RTX 5060 Ti 8 GBGPU8 GB~173 tok/s32K (full)low $450avg $809 · new · source, 2026-11-02
NVIDIA RTX A1000Workstation GPU8 GB~84 tok/s32K (full)No price yet
NVIDIA T1000 8GBWorkstation GPU8 GB~71 tok/s32K (full)No price yet
AMD Radeon RX 6700GPU10 GB~136 tok/s32K (full)No price yet
Intel Arc B570GPU10 GB~124 tok/s32K (full)No price yet
NVIDIA GeForce RTX 3080GPU10 GB~256 tok/s32K (full)No price yet
Apple M1 Pro 16GBMac16 GB (~10.7 usable)~83 tok/s32K (full)No price yet
Apple M2 16GBMac16 GB (~10.7 usable)~45 tok/s32K (full)No price yet
Apple M2 Pro 16GBMac16 GB (~10.7 usable)~83 tok/s32K (full)No price yet
Apple M3 16GBMac16 GB (~10.7 usable)~45 tok/s32K (full)No price yet
Apple M4 16GBMac16 GB (~10.7 usable)~53 tok/s32K (full)No price yet
Apple M5 16GBMac16 GB (~10.7 usable)~66 tok/s32K (full)No price yet
Apple M6 16GBMac16 GB (~10.7 usable)~66 tok/s32K (full)No price yet
NVIDIA GeForce GTX 1080 TiGPU11 GB~144 tok/s32K (full)No price yet
NVIDIA GeForce RTX 2080 TiGPU11 GB~220 tok/s32K (full)No price yet
AMD Radeon RX 6700 XTGPU12 GB~163 tok/s32K (full)No price yet
AMD Radeon RX 6750 XTGPU12 GB~184 tok/s32K (full)No price yet
AMD Radeon RX 7700 XTGPU12 GB~184 tok/s32K (full)No price yet
AMD Radeon RX 9070 GREGPU12 GB~184 tok/s32K (full)No price yet
Intel Arc B580GPU12 GB~149 tok/s32K (full)low $330avg $446 · new · source, 2026-11-02
Intel Arc Pro A60Workstation GPU12 GB~76 tok/s32K (full)No price yet
NVIDIA GeForce RTX 3060 12 GBGPU12 GB~145 tok/s32K (full)low $305avg $330 · used · source, 2026-11-02
NVIDIA GeForce RTX 3080 TiGPU12 GB~289 tok/s32K (full)No price yet
NVIDIA GeForce RTX 4070GPU12 GB~189 tok/s32K (full)No price yet
NVIDIA GeForce RTX 4070 SUPERGPU12 GB~189 tok/s32K (full)low $620avg $689 · used · source, 2026-11-02
NVIDIA GeForce RTX 4070 TiGPU12 GB~189 tok/s32K (full)No price yet
NVIDIA GeForce RTX 5070GPU12 GB~235 tok/s32K (full)low $800avg $1,086 · new · source, 2026-11-02
NVIDIA RTX A2000 12GBWorkstation GPU12 GB~120 tok/s32K (full)No price yet
NVIDIA Tesla P100 PCIe 12GBData center GPU12 GB~159 tok/s32K (full)No price yet
NVIDIA TITAN XpGPU12 GB~159 tok/s32K (full)No price yet
Apple M3 Pro 18GBMac18 GB (~12.1 usable)~65 tok/s32K (full)No price yet
AMD Radeon PRO W7700Workstation GPU16 GB~245 tok/s32K (full)No price yet
AMD Radeon RX 6800GPU16 GB~218 tok/s32K (full)No price yet
AMD Radeon RX 6800 XTGPU16 GB~218 tok/s32K (full)No price yet
AMD Radeon RX 6900 XTGPU16 GB~218 tok/s32K (full)No price yet
AMD Radeon RX 6950 XTGPU16 GB~245 tok/s32K (full)No price yet
AMD Radeon RX 7600 XTGPU16 GB~123 tok/s32K (full)No price yet
AMD Radeon RX 7700GPU16 GB~265 tok/s32K (full)No price yet
AMD Radeon RX 7800 XTGPU16 GB~265 tok/s32K (full)low $599avg $834 · new · source, 2026-11-02
AMD Radeon RX 7900 GREGPU16 GB~245 tok/s32K (full)No price yet
AMD Radeon RX 9060 XT 16 GBGPU16 GB~136 tok/s32K (full)low $620avg $812 · new · source, 2026-11-02
AMD Radeon RX 9060 XT LPGPU16 GB~136 tok/s32K (full)No price yet
AMD Radeon RX 9070GPU16 GB~272 tok/s32K (full)low $570avg $1,052 · new · source, 2026-11-02
AMD Radeon RX 9070 XTGPU16 GB~272 tok/s32K (full)low $810avg $1,194 · new · source, 2026-11-02
Intel Arc A770 16GBGPU16 GB~111 tok/s32K (full)No price yet
Intel Arc Pro B50Workstation GPU16 GB~73 tok/s32K (full)No price yet
NVIDIA GeForce RTX 4060 Ti 16 GBGPU16 GB~120 tok/s32K (full)No price yet
NVIDIA GeForce RTX 4070 Ti SUPERGPU16 GB~235 tok/s32K (full)No price yet
NVIDIA GeForce RTX 4080GPU16 GB~246 tok/s32K (full)No price yet
NVIDIA GeForce RTX 4080 SUPERGPU16 GB~250 tok/s32K (full)No price yet
NVIDIA GeForce RTX 5060 Ti 16 GBGPU16 GB~173 tok/s32K (full)low $780avg $1,146 · new · source, 2026-11-02
NVIDIA GeForce RTX 5070 TiGPU16 GB~286 tok/s32K (full)low $1,120avg $1,792 · new · source, 2026-11-02
NVIDIA GeForce RTX 5080GPU16 GB~299 tok/s32K (full)low $1,600avg $2,399 · new · source, 2026-11-02
NVIDIA RTX 2000 Ada GenerationWorkstation GPU16 GB~96 tok/s32K (full)No price yet
NVIDIA RTX A4000Workstation GPU16 GB~173 tok/s32K (full)No price yet
NVIDIA RTX PRO 2000 BlackwellWorkstation GPU16 GB~120 tok/s32K (full)No price yet
NVIDIA T4Data center GPU16 GB~124 tok/s32K (full)No price yet
NVIDIA Tesla P100 PCIe 16GBData center GPU16 GB~200 tok/s32K (full)No price yet
NVIDIA V100 PCIe 16GBData center GPU16 GB~287 tok/s32K (full)No price yet
Apple M2 24GBMac24 GB (~16.1 usable)~45 tok/s32K (full)No price yet
Apple M3 24GBMac24 GB (~16.1 usable)~45 tok/s32K (full)No price yet
Apple M4 24GBMac24 GB (~16.1 usable)~53 tok/s32K (full)No price yet
Apple M4 Pro 24GBMac24 GB (~16.1 usable)~107 tok/s32K (full)No price yet
Apple M5 24GBMac24 GB (~16.1 usable)~66 tok/s32K (full)No price yet
Apple M5 Pro 24GBMac24 GB (~16.1 usable)~117 tok/s32K (full)No price yet
Apple M6 24GBMac24 GB (~16.1 usable)~72 tok/s32K (full)No price yet
AMD Radeon RX 7900 XTGPU20 GB~340 tok/s32K (full)No price yet
NVIDIA RTX 4000 Ada GenerationWorkstation GPU20 GB~145 tok/s32K (full)No price yet
NVIDIA RTX 4000 SFF Ada GenerationWorkstation GPU20 GB~117 tok/s32K (full)No price yet
NVIDIA RTX A4500Workstation GPU20 GB~227 tok/s32K (full)No price yet
Apple M1 Max 32GBMac32 GB (~21.4 usable)~143 tok/s32K (full)No price yet
Apple M1 Pro 32GBMac32 GB (~21.4 usable)~83 tok/s32K (full)No price yet
Apple M2 Max (30-core GPU) 32GBMac32 GB (~21.4 usable)~143 tok/s32K (full)No price yet
Apple M2 Max (38-core GPU) 32GBMac32 GB (~21.4 usable)~143 tok/s32K (full)No price yet
Apple M2 Pro 32GBMac32 GB (~21.4 usable)~83 tok/s32K (full)No price yet
Apple M4 32GBMac32 GB (~21.4 usable)~53 tok/s32K (full)No price yet
Apple M5 32GBMac32 GB (~21.4 usable)~66 tok/s32K (full)No price yet
Apple M6 32GBMac32 GB (~21.4 usable)~72 tok/s32K (full)No price yet
AMD Radeon RX 7900 XTXGPU24 GB~408 tok/s32K (full)low $1,350avg $1,552 · new · source, 2026-11-02
Intel Arc Pro B60Workstation GPU24 GB~149 tok/s32K (full)No price yet
NVIDIA A10Data center GPU24 GB~216 tok/s32K (full)No price yet
NVIDIA GeForce RTX 3090GPU24 GB~294 tok/s32K (full)low $1,499avg $1,551 · used · source, 2026-11-02
NVIDIA GeForce RTX 3090 TiGPU24 GB~309 tok/s32K (full)No price yet
NVIDIA GeForce RTX 4090GPU24 GB~309 tok/s32K (full)low $2,910avg $3,100 · used · source, 2026-11-02
NVIDIA L4Data center GPU24 GB~124 tok/s32K (full)No price yet
NVIDIA Quadro RTX 6000Workstation GPU24 GB~235 tok/s32K (full)No price yet
NVIDIA RTX 4500 Ada GenerationWorkstation GPU24 GB~168 tok/s32K (full)No price yet
NVIDIA RTX A5000Workstation GPU24 GB~258 tok/s32K (full)No price yet
NVIDIA RTX A5500Workstation GPU24 GB~258 tok/s32K (full)No price yet
NVIDIA RTX PRO 4000 BlackwellWorkstation GPU24 GB~235 tok/s32K (full)No price yet
NVIDIA RTX PRO 4000 SFF BlackwellWorkstation GPU24 GB~168 tok/s32K (full)No price yet
NVIDIA RTX Spark N1X laptop (6144-core GPU, 24GB)Laptop24 GB~124 tok/s32K (full)No price yet
NVIDIA Tesla P40Data center GPU24 GB~108 tok/s32K (full)No price yet
NVIDIA TITAN RTXGPU24 GB~235 tok/s32K (full)No price yet
Apple M3 Max (30-core GPU) 36GBMac36 GB (~24.1 usable)~115 tok/s32K (full)No price yet
Apple M3 Pro 36GBMac36 GB (~24.1 usable)~65 tok/s32K (full)No price yet
Apple M4 Max (32-core GPU) 36GBMac36 GB (~24.1 usable)~146 tok/s32K (full)No price yet
Apple Mac Studio M5 Max (32-core GPU, 36 GB)Mac36 GB (~24.1 usable)~158 tok/s32K (full)low $2,499new · source, 2026-10-16
AMD Radeon PRO V710Data center GPU28 GB~191 tok/s32K (full)No price yet
AMD Radeon AI PRO R9600Workstation GPU32 GB~272 tok/s32K (full)No price yet
AMD Radeon AI PRO R9600DWorkstation GPU32 GB~272 tok/s32K (full)No price yet
AMD Radeon AI PRO R9700Workstation GPU32 GB~272 tok/s32K (full)No price yet
AMD Radeon AI PRO R9700SWorkstation GPU32 GB~272 tok/s32K (full)No price yet
AMD Radeon PRO V620Data center GPU32 GB~218 tok/s32K (full)No price yet
AMD Radeon PRO W6800Workstation GPU32 GB~218 tok/s32K (full)No price yet
AMD Radeon PRO W7800 32GBWorkstation GPU32 GB~245 tok/s32K (full)No price yet
AMD Ryzen AI Max 385 (32GB)Mini PC32 GB~109 tok/s32K (full)No price yet
AMD Ryzen AI Max 390 (32GB)Mini PC32 GB~109 tok/s32K (full)No price yet
AMD Ryzen AI Max+ 395 (32GB)Mini PC32 GB~109 tok/s32K (full)No price yet
Intel Arc Pro B70Workstation GPU32 GB~198 tok/s32K (full)No price yet
NVIDIA GeForce RTX 5090GPU32 GB~426 tok/s32K (full)low $6,500avg $8,757 · new · source, 2026-11-02
NVIDIA Quadro GV100Workstation GPU32 GB~281 tok/s32K (full)No price yet
NVIDIA RTX 5000 Ada GenerationWorkstation GPU32 GB~210 tok/s32K (full)No price yet
NVIDIA RTX PRO 4500 BlackwellWorkstation GPU32 GB~286 tok/s32K (full)No price yet
NVIDIA RTX Spark N1X laptop (6144-core GPU, 32GB)Laptop32 GB~124 tok/s32K (full)No price yet
NVIDIA V100 PCIe 32GBData center GPU32 GB~287 tok/s32K (full)No price yet
NVIDIA V100S PCIe 32GBData center GPU32 GB~332 tok/s32K (full)No price yet
Apple M3 Max (40-core GPU) 48GBMac48 GB (~36 usable)~143 tok/s32K (full)No price yet
Apple M4 Max (40-core GPU) 48GBMac48 GB (~36 usable)~178 tok/s32K (full)No price yet
Apple M4 Pro 48GBMac48 GB (~36 usable)~107 tok/s32K (full)No price yet
Apple M5 Max (40-core GPU) 48GBMac48 GB (~36 usable)~192 tok/s32K (full)No price yet
Apple M5 Pro 48GBMac48 GB (~36 usable)~117 tok/s32K (full)No price yet
NVIDIA A100 40GB PCIeData center GPU40 GB~396 tok/s32K (full)No price yet
NVIDIA A800 40GB ActiveWorkstation GPU40 GB~396 tok/s32K (full)No price yet
AMD Radeon PRO W7800 48GBWorkstation GPU48 GB~368 tok/s32K (full)No price yet
AMD Radeon PRO W7900Workstation GPU48 GB~368 tok/s32K (full)No price yet
AMD Radeon PRO W7900 Dual SlotWorkstation GPU48 GB~368 tok/s32K (full)No price yet
Apple M1 Max 64GBMac64 GB (~48 usable)~143 tok/s32K (full)No price yet
Apple M1 Ultra 64GBMac64 GB (~48 usable)~225 tok/s32K (full)No price yet
Apple M2 Max (30-core GPU) 64GBMac64 GB (~48 usable)~143 tok/s32K (full)No price yet
Apple M2 Max (38-core GPU) 64GBMac64 GB (~48 usable)~143 tok/s32K (full)No price yet
Apple M2 Ultra 64GBMac64 GB (~48 usable)~225 tok/s32K (full)No price yet
Apple M3 Max (40-core GPU) 64GBMac64 GB (~48 usable)~143 tok/s32K (full)No price yet
Apple M4 Max (40-core GPU) 64GBMac64 GB (~48 usable)~178 tok/s32K (full)No price yet
Apple M4 Pro 64GBMac64 GB (~48 usable)~107 tok/s32K (full)No price yet
Apple M5 Pro 64GBMac64 GB (~48 usable)~117 tok/s32K (full)No price yet
Apple Mac Studio M5 Max (40-core GPU, 64 GB)Mac64 GB (~48 usable)~192 tok/s32K (full)No price yet
NVIDIA A40Data center GPU48 GB~241 tok/s32K (full)No price yet
NVIDIA L40Data center GPU48 GB~279 tok/s32K (full)No price yet
NVIDIA L40SData center GPU48 GB~279 tok/s32K (full)No price yet
NVIDIA Quadro RTX 8000Workstation GPU48 GB~235 tok/s32K (full)No price yet
NVIDIA RTX 6000 Ada GenerationWorkstation GPU48 GB~299 tok/s32K (full)No price yet
NVIDIA RTX A6000Workstation GPU48 GB~258 tok/s32K (full)low $8,363new · source, 2026-11-02
NVIDIA RTX PRO 5000 Blackwell 48GBWorkstation GPU48 GB~366 tok/s32K (full)No price yet
NVIDIA RTX Spark N1X laptop (6144-core GPU, 48GB)Laptop48 GB~124 tok/s32K (full)No price yet
AMD Ryzen AI Max 385 (64GB)Mini PC64 GB~109 tok/s32K (full)No price yet
AMD Ryzen AI Max 390 (64GB)Mini PC64 GB~109 tok/s32K (full)No price yet
AMD Ryzen AI Max+ 395 (64GB)Mini PC64 GB~109 tok/s32K (full)low $2,199.99new · source, 2026-11-13
NVIDIA DGX Spark (64GB)Mini PC64 GB~114 tok/s32K (full)low $4,999new · source, 2026-11-13
NVIDIA RTX Spark N1X laptop (6144-core GPU, 64GB)Laptop64 GB~124 tok/s32K (full)No price yet
Apple M2 Max (38-core GPU) 96GBMac96 GB (~72 usable)~143 tok/s32K (full)No price yet
Apple M3 Max (30-core GPU) 96GBMac96 GB (~72 usable)~115 tok/s32K (full)No price yet
Apple M3 Ultra 96GBMac96 GB (~72 usable)~228 tok/s32K (full)No price yet
Apple Mac Studio M5 Ultra (64-core GPU, 96 GB)Mac96 GB (~72 usable)~278 tok/s32K (full)low $5,499new · source, 2026-10-23
NVIDIA RTX PRO 5000 Blackwell 72GBWorkstation GPU72 GB~366 tok/s32K (full)No price yet
NVIDIA A100 80GB PCIeData center GPU80 GB~442 tok/s32K (full)No price yet
Apple M1 Ultra 128GBMac128 GB (~96 usable)~225 tok/s32K (full)No price yet
Apple M2 Ultra 128GBMac128 GB (~96 usable)~225 tok/s32K (full)No price yet
Apple M3 Max (40-core GPU) 128GBMac128 GB (~96 usable)~143 tok/s32K (full)No price yet
Apple M4 Max (40-core GPU) 128GBMac128 GB (~96 usable)~178 tok/s32K (full)No price yet
Apple M5 Max (40-core GPU) 128GBMac128 GB (~96 usable)~192 tok/s32K (full)No price yet
NVIDIA RTX PRO 6000 Blackwell Max-QWorkstation GPU96 GB~426 tok/s32K (full)No price yet
NVIDIA RTX PRO 6000 Blackwell Server EditionData center GPU96 GB~404 tok/s32K (full)No price yet
NVIDIA RTX PRO 6000 Blackwell Workstation EditionWorkstation GPU96 GB~426 tok/s32K (full)No price yet
AMD Ryzen AI Max 385 (128GB)Mini PC128 GB~109 tok/s32K (full)No price yet
AMD Ryzen AI Max 390 (128GB)Mini PC128 GB~109 tok/s32K (full)No price yet
AMD Ryzen AI Max+ 395 (128GB)Mini PC128 GB~109 tok/s32K (full)low $3,499.99new · source, 2026-11-13
NVIDIA DGX Spark (128GB)Mini PC128 GB~114 tok/s32K (full)low $6,949.99new · source, 2026-10-23
NVIDIA RTX Spark N1X laptop (6144-core GPU, 128GB)Laptop128 GB~124 tok/s32K (full)No price yet
Apple M2 Ultra 192GBMac192 GB (~144 usable)~225 tok/s32K (full)No price yet
Apple M3 Ultra 256GBMac256 GB (~192 usable)~228 tok/s32K (full)No price yet
Apple M5 Ultra 256GBMac256 GB (~192 usable)~278 tok/s32K (full)No price yet
Framework Desktop, AMD Ryzen AI Max+ PRO 495 (Strix Halo), 192 GBMini PC192 GB~116 tok/s32K (full)low $6,799new · source, 2026-10-16
Apple M5 Ultra 512GBMac512 GB (~384 usable)~278 tok/s32K (full)No price yet

Speed calculator

estimate

Estimate = bandwidth ÷ GB read per token (the model's listed GGUF file: Q4_K_M for most models, otherwise the quant named in the list; scaled by active/total parameters for MoE), scaled by a per-platform efficiency and fixed per-token costs calibrated to 45 measured llama.cpp benchmarks (2025–26). Fit = file size + 1.5 GB headroom ≤ total VRAM (on Macs, the part of unified memory macOS lets the GPU use by default), and room for at least 4K tokens of context with an 8-bit KV cache. For a model with no KV cache data, only the file and headroom are checked, so a fit says nothing about context. Multi-GPU: VRAM adds, speed stays one card's (a layer split runs the cards in turn); max context uses the total. Speed is for short context. Max context = what is left after the file and a 1 GB runtime reserve ÷ KV cache bytes per token, default FP16 and 8-bit (q8_0) cache. How speed works · how context works

Related