RigPerDollar

What GPU do you need to run LFM3-VL-2B?

A used GeForce RTX 3060 12 GB ($305). It is the cheapest priced graphics card that holds LFM3-VL-2B (about 2.6 GB at Q4) with room for its full 128K context, at about 141 tok/s estimate; that is the card price only, and it requires a separate compatible PC. 157 of the 157 GPUs and systems we track fit it.

Parameters1.92B
Q4_K_M GGUF1.1 GBsource
VRAM needed~2.6 GBfile + headroom
Single GPUs that fit157
ReleasedOct 27, 2026source
LicenseLFM Open License 1.0
Context window128K tokens

1.92B parameters (Hugging Face, accessed 2026-10-27). Q4_K_M GGUF: 1.1 GB (source). Architecture config (Hugging Face config.json; text_config layer_types: 6 full_attention + 5 sliding_attention (256) + 13 conv layers. The conv layers keep a small fixed-size state and no KV (arch hybrid, so the speed estimate adds the recurrent-state cost); llama.cpp lfm3 puts the attention layers in its iSWA cache (src/models/lfm3.cpp, llama-memory-hybrid-iswa). The vision encoder adds no KV cache): 6 attention layers (the rest are recurrent) × 4 KV heads × 128 head dim, plus 5 sliding-window layers (256-token window), so about 12 KB of FP16 KV cache per token of context (how we estimate context).

Liquid AI vision-language model (text, image and video in). 1.92B is Hugging Face's safetensors total of 1,918,181,888; the card splits it into a 1.73B language model, a 164M vision encoder and a 25M projector. The language model is the same 24-layer LFM3 layout as LFM3-1.7B (13 short convolutions, 5 sliding-window, 6 global attention layers) with a 128K context. Q4_K_M is Liquid AI's official GGUF (LFM3-VL-2B-Q4_K_M.gguf, 1,099,627,808 bytes, language model only); every size is in the table below. Fit ignores the vision projector (mmproj-F16 378,996,032 bytes, mmproj-Q8_0 203,031,872 bytes), which is extra if you send images. llama.cpp support (lfm3 architecture) was merged on Oct 27, 2026 (ggml-org/llama.cpp PR #31252) and is in tagged releases v0.9.0 (Nov 4, 2026) and v1.0.0 (Nov 13, 2026). The GGUF card says llama.cpp has no video input for now. Liquid's MLX builds wait on an MLX-VLM release with LFM3-VL support (in progress, per the card). LFM Open License v1.0: commercial use is licensed only while you (with your affiliates) stay under $10M annual revenue; above that, commercial use is not licensed under it. The cap does not apply to qualifying non-profits doing non-commercial or research work. Release date is Liquid's announcement; the Hugging Face repo was created Oct 19.

GGUF files and sizes

Exact sizes from Hugging Face, accessed 2026-10-27. The fit and context tables on this page use the Q4_K_M file (1.1 GB); a smaller file needs less memory by the difference. VRAM needed is the file + the same headroom.

FilePublished byBytesSizeVRAM neededSource
QAD-Q4_0Liquid AI1,049,615,6481.05 GB~2.5 GBHugging Face
Q4_K_MLiquid AI1,099,627,8081.1 GB~2.6 GBHugging Face
Q5_K_MLiquid AI1,258,663,2001.26 GB~2.8 GBHugging Face
Q6_KLiquid AI1,427,638,3041.43 GB~2.9 GBHugging Face
Q8_0Liquid AI1,846,238,4961.85 GB~3.4 GBHugging Face
BF16Liquid AI3,466,626,3363.47 GB~5 GBHugging Face
F16Liquid AI3,466,626,3363.47 GB~5 GBHugging Face
mmproj-Q8_0 Vision projector, extraLiquid AI203,031,8720.2 GB—Hugging Face
mmproj-F16 Vision projector, extraLiquid AI378,996,0320.38 GB—Hugging Face
mmproj-BF16 Vision projector, extraLiquid AI378,996,0320.38 GB—Hugging Face

Other places to get it

Checked Nov 14, 2026. We list only copies we opened and checked. Check file hashes for copies from other uploaders.

Single GPUs that fit, cheapest first

Single GPU that fitsVRAMSpeed estimateMax context estimatePrice
NVIDIA GeForce RTX 3060 12 GB12 GB~141 tok/s128K (full)low $305avg $330 · used · source, 2026-11-02
Intel Arc B58012 GB~154 tok/s128K (full)low $330avg $446 · new · source, 2026-11-02
NVIDIA GeForce RTX 50608 GB~156 tok/s128K (full)low $410avg $550 · new · source, 2026-11-02
NVIDIA GeForce RTX 5060 Ti 8 GB8 GB~156 tok/s128K (full)low $450avg $809 · new · source, 2026-11-02
AMD Radeon RX 907016 GB~216 tok/s128K (full)low $570avg $1,052 · new · source, 2026-11-02
AMD Radeon RX 7800 XT16 GB~213 tok/s128K (full)low $599avg $834 · new · source, 2026-11-02
NVIDIA GeForce RTX 4070 SUPER12 GB~164 tok/s128K (full)low $620avg $689 · used · source, 2026-11-02
AMD Radeon RX 9060 XT 16 GB16 GB~146 tok/s128K (full)low $620avg $812 · new · source, 2026-11-02
NVIDIA GeForce RTX 5060 Ti 16 GB16 GB~156 tok/s128K (full)low $780avg $1,146 · new · source, 2026-11-02
NVIDIA GeForce RTX 507012 GB~183 tok/s128K (full)low $800avg $1,086 · new · source, 2026-11-02
AMD Radeon RX 9070 XT16 GB~216 tok/s128K (full)low $810avg $1,194 · new · source, 2026-11-02
NVIDIA GeForce RTX 5070 Ti16 GB~200 tok/s128K (full)low $1,120avg $1,792 · new · source, 2026-11-02
AMD Radeon RX 7900 XTX24 GB~257 tok/s128K (full)low $1,350avg $1,552 · new · source, 2026-11-02
NVIDIA GeForce RTX 309024 GB~203 tok/s128K (full)low $1,499avg $1,551 · used · source, 2026-11-02
NVIDIA GeForce RTX 508016 GB~204 tok/s128K (full)low $1,600avg $2,399 · new · source, 2026-11-02
Apple Mac Studio M5 Max (32-core GPU, 36 GB)36 GB (~24.1 usable)~143 tok/s128K (full)low $2,499new · source, 2026-10-16
NVIDIA GeForce RTX 409024 GB~207 tok/s128K (full)low $2,910avg $3,100 · used · source, 2026-11-02
NVIDIA DGX Spark (64GB)64 GB~122 tok/s128K (full)low $4,999new · source, 2026-11-13
Apple Mac Studio M5 Ultra (64-core GPU, 96 GB)96 GB (~72 usable)~188 tok/s128K (full)low $5,499new · source, 2026-10-23
NVIDIA GeForce RTX 509032 GB~233 tok/s128K (full)low $6,500avg $8,757 · new · source, 2026-11-02
Framework Desktop, AMD Ryzen AI Max+ PRO 495 (Strix Halo), 192 GB192 GB~131 tok/s128K (full)low $6,799new · source, 2026-10-16
NVIDIA DGX Spark (128GB)128 GB~122 tok/s128K (full)low $6,949.99new · source, 2026-10-23
NVIDIA RTX A600048 GB~191 tok/s128K (full)low $8,363new · source, 2026-11-02
AMD Radeon PRO W64004 GB~74 tok/s128K (full)No price yet
AMD Radeon RX 64004 GB~74 tok/s128K (full)No price yet
AMD Radeon RX 6500 XT 4GB4 GB~81 tok/s128K (full)No price yet
AMD Radeon RX 9050 4GB4 GB~81 tok/s128K (full)No price yet
Intel Arc A3104 GB~37 tok/s128K (full)No price yet
NVIDIA GeForce GTX 1050 Ti4 GB~53 tok/s128K (full)No price yet
NVIDIA GeForce GTX 1650 (GDDR5)4 GB~75 tok/s128K (full)No price yet
NVIDIA GeForce GTX 1650 (GDDR6)4 GB~99 tok/s128K (full)No price yet
NVIDIA RTX A4004 GB~60 tok/s128K (full)No price yet
Intel Arc A3806 GB~53 tok/s128K (full)No price yet
Intel Arc Pro A406 GB~55 tok/s128K (full)No price yet
Intel Arc Pro A506 GB~55 tok/s128K (full)No price yet
NVIDIA GeForce GTX 1060 6GB6 GB~81 tok/s128K (full)No price yet
NVIDIA GeForce GTX 16606 GB~99 tok/s128K (full)No price yet
NVIDIA GeForce GTX 1660 SUPER6 GB~137 tok/s128K (full)No price yet
NVIDIA GeForce GTX 1660 Ti6 GB~126 tok/s128K (full)No price yet
NVIDIA GeForce RTX 2060 6GB6 GB~137 tok/s128K (full)No price yet
NVIDIA RTX A2000 6GB6 GB~126 tok/s128K (full)No price yet
AMD Radeon PRO W66008 GB~114 tok/s128K (full)No price yet
AMD Radeon PRO W74008 GB~94 tok/s128K (full)No price yet
AMD Radeon PRO W75008 GB~125 tok/s128K (full)No price yet
AMD Radeon PRO W76008 GB~136 tok/s128K (full)No price yet
AMD Radeon RX 6500 XT 8GB8 GB~81 tok/s128K (full)No price yet
AMD Radeon RX 66008 GB~114 tok/s128K (full)No price yet
AMD Radeon RX 6600 XT8 GB~125 tok/s128K (full)No price yet
AMD Radeon RX 6650 XT8 GB~133 tok/s128K (full)No price yet
AMD Radeon RX 74008 GB~94 tok/s128K (full)No price yet
AMD Radeon RX 76008 GB~136 tok/s128K (full)No price yet
AMD Radeon RX 90508 GB~136 tok/s128K (full)No price yet
AMD Radeon RX 90608 GB~136 tok/s128K (full)No price yet
AMD Radeon RX 9060 XT 8GB8 GB~146 tok/s128K (full)No price yet
Intel Arc A5808 GB~120 tok/s128K (full)No price yet
Intel Arc A7508 GB~120 tok/s128K (full)No price yet
Intel Arc A770 8GB8 GB~120 tok/s128K (full)No price yet
NVIDIA GeForce GTX 10708 GB~98 tok/s128K (full)No price yet
NVIDIA GeForce GTX 1070 Ti8 GB~98 tok/s128K (full)No price yet
NVIDIA GeForce GTX 10808 GB~113 tok/s128K (full)No price yet
NVIDIA GeForce RTX 2060 SUPER8 GB~156 tok/s128K (full)No price yet
NVIDIA GeForce RTX 20708 GB~156 tok/s128K (full)No price yet
NVIDIA GeForce RTX 2070 SUPER8 GB~156 tok/s128K (full)No price yet
NVIDIA GeForce RTX 20808 GB~156 tok/s128K (full)No price yet
NVIDIA GeForce RTX 2080 SUPER8 GB~163 tok/s128K (full)No price yet
NVIDIA GeForce RTX 30708 GB~156 tok/s128K (full)No price yet
NVIDIA GeForce RTX 3070 Ti8 GB~177 tok/s128K (full)No price yet
NVIDIA GeForce RTX 40608 GB~122 tok/s128K (full)No price yet
NVIDIA GeForce RTX 4060 Ti 8GB8 GB~126 tok/s128K (full)No price yet
NVIDIA GeForce RTX 50508 GB~133 tok/s128K (full)No price yet
NVIDIA RTX A10008 GB~99 tok/s128K (full)No price yet
NVIDIA T1000 8GB8 GB~88 tok/s128K (full)No price yet
AMD Radeon RX 670010 GB~146 tok/s128K (full)No price yet
Intel Arc B57010 GB~137 tok/s128K (full)No price yet
NVIDIA GeForce RTX 308010 GB~191 tok/s128K (full)No price yet
NVIDIA GeForce GTX 1080 Ti11 GB~141 tok/s128K (full)No price yet
NVIDIA GeForce RTX 2080 Ti11 GB~178 tok/s128K (full)No price yet
AMD Radeon RX 6700 XT12 GB~163 tok/s128K (full)No price yet
AMD Radeon RX 6750 XT12 GB~175 tok/s128K (full)No price yet
AMD Radeon RX 7700 XT12 GB~175 tok/s128K (full)No price yet
AMD Radeon RX 9070 GRE12 GB~175 tok/s128K (full)No price yet
Intel Arc Pro A6012 GB~97 tok/s128K (full)No price yet
NVIDIA GeForce RTX 3080 Ti12 GB~201 tok/s128K (full)No price yet
NVIDIA GeForce RTX 407012 GB~164 tok/s128K (full)No price yet
NVIDIA GeForce RTX 4070 Ti12 GB~164 tok/s128K (full)No price yet
NVIDIA RTX A2000 12GB12 GB~126 tok/s128K (full)No price yet
NVIDIA Tesla P100 PCIe 12GB12 GB~150 tok/s128K (full)No price yet
NVIDIA TITAN Xp12 GB~149 tok/s128K (full)No price yet
AMD Radeon PRO W770016 GB~205 tok/s128K (full)No price yet
AMD Radeon RX 680016 GB~193 tok/s128K (full)No price yet
AMD Radeon RX 6800 XT16 GB~193 tok/s128K (full)No price yet
AMD Radeon RX 6900 XT16 GB~193 tok/s128K (full)No price yet
AMD Radeon RX 6950 XT16 GB~205 tok/s128K (full)No price yet
AMD Radeon RX 7600 XT16 GB~136 tok/s128K (full)No price yet
AMD Radeon RX 770016 GB~213 tok/s128K (full)No price yet
AMD Radeon RX 7900 GRE16 GB~205 tok/s128K (full)No price yet
AMD Radeon RX 9060 XT LP16 GB~146 tok/s128K (full)No price yet
Intel Arc A770 16GB16 GB~127 tok/s128K (full)No price yet
Intel Arc Pro B5016 GB~93 tok/s128K (full)No price yet
NVIDIA GeForce RTX 4060 Ti 16 GB16 GB~126 tok/s128K (full)No price yet
NVIDIA GeForce RTX 4070 Ti SUPER16 GB~183 tok/s128K (full)No price yet
NVIDIA GeForce RTX 408016 GB~187 tok/s128K (full)No price yet
NVIDIA GeForce RTX 4080 SUPER16 GB~189 tok/s128K (full)No price yet
NVIDIA RTX 2000 Ada Generation16 GB~109 tok/s128K (full)No price yet
NVIDIA RTX A400016 GB~156 tok/s128K (full)No price yet
NVIDIA RTX PRO 2000 Blackwell16 GB~126 tok/s128K (full)No price yet
NVIDIA T416 GB~129 tok/s128K (full)No price yet
NVIDIA Tesla P100 PCIe 16GB16 GB~169 tok/s128K (full)No price yet
NVIDIA V100 PCIe 16GB16 GB~200 tok/s128K (full)No price yet
AMD Radeon RX 7900 XT20 GB~239 tok/s128K (full)No price yet
NVIDIA RTX 4000 Ada Generation20 GB~141 tok/s128K (full)No price yet
NVIDIA RTX 4000 SFF Ada Generation20 GB~124 tok/s128K (full)No price yet
NVIDIA RTX A450020 GB~180 tok/s128K (full)No price yet
Intel Arc Pro B6024 GB~154 tok/s128K (full)No price yet
NVIDIA A1024 GB~176 tok/s128K (full)No price yet
NVIDIA GeForce RTX 3090 Ti24 GB~207 tok/s128K (full)No price yet
NVIDIA L424 GB~129 tok/s128K (full)No price yet
NVIDIA Quadro RTX 600024 GB~183 tok/s128K (full)No price yet
NVIDIA RTX 4500 Ada Generation24 GB~154 tok/s128K (full)No price yet
NVIDIA RTX A500024 GB~191 tok/s128K (full)No price yet
NVIDIA RTX A550024 GB~191 tok/s128K (full)No price yet
NVIDIA RTX PRO 4000 Blackwell24 GB~183 tok/s128K (full)No price yet
NVIDIA RTX PRO 4000 SFF Blackwell24 GB~154 tok/s128K (full)No price yet
NVIDIA Tesla P4024 GB~118 tok/s128K (full)No price yet
NVIDIA TITAN RTX24 GB~183 tok/s128K (full)No price yet
AMD Radeon PRO V71028 GB~179 tok/s128K (full)No price yet
AMD Radeon AI PRO R960032 GB~216 tok/s128K (full)No price yet
AMD Radeon AI PRO R9600D32 GB~216 tok/s128K (full)No price yet
AMD Radeon AI PRO R970032 GB~216 tok/s128K (full)No price yet
AMD Radeon AI PRO R9700S32 GB~216 tok/s128K (full)No price yet
AMD Radeon PRO V62032 GB~193 tok/s128K (full)No price yet
AMD Radeon PRO W680032 GB~193 tok/s128K (full)No price yet
AMD Radeon PRO W7800 32GB32 GB~205 tok/s128K (full)No price yet
Intel Arc Pro B7032 GB~183 tok/s128K (full)No price yet
NVIDIA Quadro GV10032 GB~199 tok/s128K (full)No price yet
NVIDIA RTX 5000 Ada Generation32 GB~173 tok/s128K (full)No price yet
NVIDIA RTX PRO 4500 Blackwell32 GB~200 tok/s128K (full)No price yet
NVIDIA V100 PCIe 32GB32 GB~200 tok/s128K (full)No price yet
NVIDIA V100S PCIe 32GB32 GB~213 tok/s128K (full)No price yet
Apple M5 Pro 48GB48 GB (~36 usable)~120 tok/s128K (full)No price yet
NVIDIA A100 40GB PCIe40 GB~227 tok/s128K (full)No price yet
NVIDIA A800 40GB Active40 GB~227 tok/s128K (full)No price yet
AMD Radeon PRO W7800 48GB48 GB~247 tok/s128K (full)No price yet
AMD Radeon PRO W790048 GB~247 tok/s128K (full)No price yet
AMD Radeon PRO W7900 Dual Slot48 GB~247 tok/s128K (full)No price yet
Apple Mac Studio M5 Max (40-core GPU, 64 GB)64 GB (~48 usable)~158 tok/s128K (full)No price yet
NVIDIA A4048 GB~185 tok/s128K (full)No price yet
NVIDIA L4048 GB~198 tok/s128K (full)No price yet
NVIDIA L40S48 GB~198 tok/s128K (full)No price yet
NVIDIA Quadro RTX 800048 GB~183 tok/s128K (full)No price yet
NVIDIA RTX 6000 Ada Generation48 GB~204 tok/s128K (full)No price yet
NVIDIA RTX PRO 5000 Blackwell 48GB48 GB~221 tok/s128K (full)No price yet
NVIDIA RTX PRO 5000 Blackwell 72GB72 GB~221 tok/s128K (full)No price yet
NVIDIA A100 80GB PCIe80 GB~236 tok/s128K (full)No price yet
NVIDIA RTX PRO 6000 Blackwell Max-Q96 GB~233 tok/s128K (full)No price yet
NVIDIA RTX PRO 6000 Blackwell Server Edition96 GB~229 tok/s128K (full)No price yet
NVIDIA RTX PRO 6000 Blackwell Workstation Edition96 GB~233 tok/s128K (full)No price yet

Every device that runs it

Graphics cards, Macs and mini PCs from the wider hardware list behind My rig, smallest usable memory first. Not sure about yours? Check your exact rig.

Show all 224 devices that run it
DeviceTypeMemorySpeed estimateMax context estimatePrice
AMD Radeon PRO W6400Workstation GPU4 GB~74 tok/s128K (full)No price yet
AMD Radeon RX 6400GPU4 GB~74 tok/s128K (full)No price yet
AMD Radeon RX 6500 XT 4GBGPU4 GB~81 tok/s128K (full)No price yet
AMD Radeon RX 9050 4GBGPU4 GB~81 tok/s128K (full)No price yet
Intel Arc A310GPU4 GB~37 tok/s128K (full)No price yet
NVIDIA GeForce GTX 1050 TiGPU4 GB~53 tok/s128K (full)No price yet
NVIDIA GeForce GTX 1650 (GDDR5)GPU4 GB~75 tok/s128K (full)No price yet
NVIDIA GeForce GTX 1650 (GDDR6)GPU4 GB~99 tok/s128K (full)No price yet
NVIDIA RTX A400Workstation GPU4 GB~60 tok/s128K (full)No price yet
Apple M2 8GBMac8 GB (~5.4 usable)~60 tok/s128K (full)No price yet
Apple M3 8GBMac8 GB (~5.4 usable)~60 tok/s128K (full)No price yet
Intel Arc A380GPU6 GB~53 tok/s128K (full)No price yet
Intel Arc Pro A40Workstation GPU6 GB~55 tok/s128K (full)No price yet
Intel Arc Pro A50Workstation GPU6 GB~55 tok/s128K (full)No price yet
NVIDIA GeForce GTX 1060 6GBGPU6 GB~81 tok/s128K (full)No price yet
NVIDIA GeForce GTX 1660GPU6 GB~99 tok/s128K (full)No price yet
NVIDIA GeForce GTX 1660 SUPERGPU6 GB~137 tok/s128K (full)No price yet
NVIDIA GeForce GTX 1660 TiGPU6 GB~126 tok/s128K (full)No price yet
NVIDIA GeForce RTX 2060 6GBGPU6 GB~137 tok/s128K (full)No price yet
NVIDIA RTX A2000 6GBWorkstation GPU6 GB~126 tok/s128K (full)No price yet
AMD Radeon PRO W6600Workstation GPU8 GB~114 tok/s128K (full)No price yet
AMD Radeon PRO W7400Workstation GPU8 GB~94 tok/s128K (full)No price yet
AMD Radeon PRO W7500Workstation GPU8 GB~125 tok/s128K (full)No price yet
AMD Radeon PRO W7600Workstation GPU8 GB~136 tok/s128K (full)No price yet
AMD Radeon RX 6500 XT 8GBGPU8 GB~81 tok/s128K (full)No price yet
AMD Radeon RX 6600GPU8 GB~114 tok/s128K (full)No price yet
AMD Radeon RX 6600 XTGPU8 GB~125 tok/s128K (full)No price yet
AMD Radeon RX 6650 XTGPU8 GB~133 tok/s128K (full)No price yet
AMD Radeon RX 7400GPU8 GB~94 tok/s128K (full)No price yet
AMD Radeon RX 7600GPU8 GB~136 tok/s128K (full)No price yet
AMD Radeon RX 9050GPU8 GB~136 tok/s128K (full)No price yet
AMD Radeon RX 9060GPU8 GB~136 tok/s128K (full)No price yet
AMD Radeon RX 9060 XT 8GBGPU8 GB~146 tok/s128K (full)No price yet
Intel Arc A580GPU8 GB~120 tok/s128K (full)No price yet
Intel Arc A750GPU8 GB~120 tok/s128K (full)No price yet
Intel Arc A770 8GBGPU8 GB~120 tok/s128K (full)No price yet
NVIDIA GeForce GTX 1070GPU8 GB~98 tok/s128K (full)No price yet
NVIDIA GeForce GTX 1070 TiGPU8 GB~98 tok/s128K (full)No price yet
NVIDIA GeForce GTX 1080GPU8 GB~113 tok/s128K (full)No price yet
NVIDIA GeForce RTX 2060 SUPERGPU8 GB~156 tok/s128K (full)No price yet
NVIDIA GeForce RTX 2070GPU8 GB~156 tok/s128K (full)No price yet
NVIDIA GeForce RTX 2070 SUPERGPU8 GB~156 tok/s128K (full)No price yet
NVIDIA GeForce RTX 2080GPU8 GB~156 tok/s128K (full)No price yet
NVIDIA GeForce RTX 2080 SUPERGPU8 GB~163 tok/s128K (full)No price yet
NVIDIA GeForce RTX 3070GPU8 GB~156 tok/s128K (full)No price yet
NVIDIA GeForce RTX 3070 TiGPU8 GB~177 tok/s128K (full)No price yet
NVIDIA GeForce RTX 4060GPU8 GB~122 tok/s128K (full)No price yet
NVIDIA GeForce RTX 4060 Ti 8GBGPU8 GB~126 tok/s128K (full)No price yet
NVIDIA GeForce RTX 5050GPU8 GB~133 tok/s128K (full)No price yet
NVIDIA GeForce RTX 5060GPU8 GB~156 tok/s128K (full)low $410avg $550 · new · source, 2026-11-02
NVIDIA GeForce RTX 5060 Ti 8 GBGPU8 GB~156 tok/s128K (full)low $450avg $809 · new · source, 2026-11-02
NVIDIA RTX A1000Workstation GPU8 GB~99 tok/s128K (full)No price yet
NVIDIA T1000 8GBWorkstation GPU8 GB~88 tok/s128K (full)No price yet
AMD Radeon RX 6700GPU10 GB~146 tok/s128K (full)No price yet
Intel Arc B570GPU10 GB~137 tok/s128K (full)No price yet
NVIDIA GeForce RTX 3080GPU10 GB~191 tok/s128K (full)No price yet
Apple M1 Pro 16GBMac16 GB (~10.7 usable)~95 tok/s128K (full)No price yet
Apple M2 16GBMac16 GB (~10.7 usable)~60 tok/s128K (full)No price yet
Apple M2 Pro 16GBMac16 GB (~10.7 usable)~95 tok/s128K (full)No price yet
Apple M3 16GBMac16 GB (~10.7 usable)~60 tok/s128K (full)No price yet
Apple M4 16GBMac16 GB (~10.7 usable)~68 tok/s128K (full)No price yet
Apple M5 16GBMac16 GB (~10.7 usable)~81 tok/s128K (full)No price yet
Apple M6 16GBMac16 GB (~10.7 usable)~81 tok/s128K (full)No price yet
NVIDIA GeForce GTX 1080 TiGPU11 GB~141 tok/s128K (full)No price yet
NVIDIA GeForce RTX 2080 TiGPU11 GB~178 tok/s128K (full)No price yet
AMD Radeon RX 6700 XTGPU12 GB~163 tok/s128K (full)No price yet
AMD Radeon RX 6750 XTGPU12 GB~175 tok/s128K (full)No price yet
AMD Radeon RX 7700 XTGPU12 GB~175 tok/s128K (full)No price yet
AMD Radeon RX 9070 GREGPU12 GB~175 tok/s128K (full)No price yet
Intel Arc B580GPU12 GB~154 tok/s128K (full)low $330avg $446 · new · source, 2026-11-02
Intel Arc Pro A60Workstation GPU12 GB~97 tok/s128K (full)No price yet
NVIDIA GeForce RTX 3060 12 GBGPU12 GB~141 tok/s128K (full)low $305avg $330 · used · source, 2026-11-02
NVIDIA GeForce RTX 3080 TiGPU12 GB~201 tok/s128K (full)No price yet
NVIDIA GeForce RTX 4070GPU12 GB~164 tok/s128K (full)No price yet
NVIDIA GeForce RTX 4070 SUPERGPU12 GB~164 tok/s128K (full)low $620avg $689 · used · source, 2026-11-02
NVIDIA GeForce RTX 4070 TiGPU12 GB~164 tok/s128K (full)No price yet
NVIDIA GeForce RTX 5070GPU12 GB~183 tok/s128K (full)low $800avg $1,086 · new · source, 2026-11-02
NVIDIA RTX A2000 12GBWorkstation GPU12 GB~126 tok/s128K (full)No price yet
NVIDIA Tesla P100 PCIe 12GBData center GPU12 GB~150 tok/s128K (full)No price yet
NVIDIA TITAN XpGPU12 GB~149 tok/s128K (full)No price yet
Apple M3 Pro 18GBMac18 GB (~12.1 usable)~80 tok/s128K (full)No price yet
AMD Radeon PRO W7700Workstation GPU16 GB~205 tok/s128K (full)No price yet
AMD Radeon RX 6800GPU16 GB~193 tok/s128K (full)No price yet
AMD Radeon RX 6800 XTGPU16 GB~193 tok/s128K (full)No price yet
AMD Radeon RX 6900 XTGPU16 GB~193 tok/s128K (full)No price yet
AMD Radeon RX 6950 XTGPU16 GB~205 tok/s128K (full)No price yet
AMD Radeon RX 7600 XTGPU16 GB~136 tok/s128K (full)No price yet
AMD Radeon RX 7700GPU16 GB~213 tok/s128K (full)No price yet
AMD Radeon RX 7800 XTGPU16 GB~213 tok/s128K (full)low $599avg $834 · new · source, 2026-11-02
AMD Radeon RX 7900 GREGPU16 GB~205 tok/s128K (full)No price yet
AMD Radeon RX 9060 XT 16 GBGPU16 GB~146 tok/s128K (full)low $620avg $812 · new · source, 2026-11-02
AMD Radeon RX 9060 XT LPGPU16 GB~146 tok/s128K (full)No price yet
AMD Radeon RX 9070GPU16 GB~216 tok/s128K (full)low $570avg $1,052 · new · source, 2026-11-02
AMD Radeon RX 9070 XTGPU16 GB~216 tok/s128K (full)low $810avg $1,194 · new · source, 2026-11-02
Intel Arc A770 16GBGPU16 GB~127 tok/s128K (full)No price yet
Intel Arc Pro B50Workstation GPU16 GB~93 tok/s128K (full)No price yet
NVIDIA GeForce RTX 4060 Ti 16 GBGPU16 GB~126 tok/s128K (full)No price yet
NVIDIA GeForce RTX 4070 Ti SUPERGPU16 GB~183 tok/s128K (full)No price yet
NVIDIA GeForce RTX 4080GPU16 GB~187 tok/s128K (full)No price yet
NVIDIA GeForce RTX 4080 SUPERGPU16 GB~189 tok/s128K (full)No price yet
NVIDIA GeForce RTX 5060 Ti 16 GBGPU16 GB~156 tok/s128K (full)low $780avg $1,146 · new · source, 2026-11-02
NVIDIA GeForce RTX 5070 TiGPU16 GB~200 tok/s128K (full)low $1,120avg $1,792 · new · source, 2026-11-02
NVIDIA GeForce RTX 5080GPU16 GB~204 tok/s128K (full)low $1,600avg $2,399 · new · source, 2026-11-02
NVIDIA RTX 2000 Ada GenerationWorkstation GPU16 GB~109 tok/s128K (full)No price yet
NVIDIA RTX A4000Workstation GPU16 GB~156 tok/s128K (full)No price yet
NVIDIA RTX PRO 2000 BlackwellWorkstation GPU16 GB~126 tok/s128K (full)No price yet
NVIDIA T4Data center GPU16 GB~129 tok/s128K (full)No price yet
NVIDIA Tesla P100 PCIe 16GBData center GPU16 GB~169 tok/s128K (full)No price yet
NVIDIA V100 PCIe 16GBData center GPU16 GB~200 tok/s128K (full)No price yet
Apple M2 24GBMac24 GB (~16.1 usable)~60 tok/s128K (full)No price yet
Apple M3 24GBMac24 GB (~16.1 usable)~60 tok/s128K (full)No price yet
Apple M4 24GBMac24 GB (~16.1 usable)~68 tok/s128K (full)No price yet
Apple M4 Pro 24GBMac24 GB (~16.1 usable)~113 tok/s128K (full)No price yet
Apple M5 24GBMac24 GB (~16.1 usable)~81 tok/s128K (full)No price yet
Apple M5 Pro 24GBMac24 GB (~16.1 usable)~120 tok/s128K (full)No price yet
Apple M6 24GBMac24 GB (~16.1 usable)~86 tok/s128K (full)No price yet
AMD Radeon RX 7900 XTGPU20 GB~239 tok/s128K (full)No price yet
NVIDIA RTX 4000 Ada GenerationWorkstation GPU20 GB~141 tok/s128K (full)No price yet
NVIDIA RTX 4000 SFF Ada GenerationWorkstation GPU20 GB~124 tok/s128K (full)No price yet
NVIDIA RTX A4500Workstation GPU20 GB~180 tok/s128K (full)No price yet
Apple M1 Max 32GBMac32 GB (~21.4 usable)~135 tok/s128K (full)No price yet
Apple M1 Pro 32GBMac32 GB (~21.4 usable)~95 tok/s128K (full)No price yet
Apple M2 Max (30-core GPU) 32GBMac32 GB (~21.4 usable)~135 tok/s128K (full)No price yet
Apple M2 Max (38-core GPU) 32GBMac32 GB (~21.4 usable)~135 tok/s128K (full)No price yet
Apple M2 Pro 32GBMac32 GB (~21.4 usable)~95 tok/s128K (full)No price yet
Apple M4 32GBMac32 GB (~21.4 usable)~68 tok/s128K (full)No price yet
Apple M5 32GBMac32 GB (~21.4 usable)~81 tok/s128K (full)No price yet
Apple M6 32GBMac32 GB (~21.4 usable)~86 tok/s128K (full)No price yet
AMD Radeon RX 7900 XTXGPU24 GB~257 tok/s128K (full)low $1,350avg $1,552 · new · source, 2026-11-02
Intel Arc Pro B60Workstation GPU24 GB~154 tok/s128K (full)No price yet
NVIDIA A10Data center GPU24 GB~176 tok/s128K (full)No price yet
NVIDIA GeForce RTX 3090GPU24 GB~203 tok/s128K (full)low $1,499avg $1,551 · used · source, 2026-11-02
NVIDIA GeForce RTX 3090 TiGPU24 GB~207 tok/s128K (full)No price yet
NVIDIA GeForce RTX 4090GPU24 GB~207 tok/s128K (full)low $2,910avg $3,100 · used · source, 2026-11-02
NVIDIA L4Data center GPU24 GB~129 tok/s128K (full)No price yet
NVIDIA Quadro RTX 6000Workstation GPU24 GB~183 tok/s128K (full)No price yet
NVIDIA RTX 4500 Ada GenerationWorkstation GPU24 GB~154 tok/s128K (full)No price yet
NVIDIA RTX A5000Workstation GPU24 GB~191 tok/s128K (full)No price yet
NVIDIA RTX A5500Workstation GPU24 GB~191 tok/s128K (full)No price yet
NVIDIA RTX PRO 4000 BlackwellWorkstation GPU24 GB~183 tok/s128K (full)No price yet
NVIDIA RTX PRO 4000 SFF BlackwellWorkstation GPU24 GB~154 tok/s128K (full)No price yet
NVIDIA RTX Spark N1X laptop (6144-core GPU, 24GB)Laptop24 GB~129 tok/s128K (full)No price yet
NVIDIA Tesla P40Data center GPU24 GB~118 tok/s128K (full)No price yet
NVIDIA TITAN RTXGPU24 GB~183 tok/s128K (full)No price yet
Apple M3 Max (30-core GPU) 36GBMac36 GB (~24.1 usable)~119 tok/s128K (full)No price yet
Apple M3 Pro 36GBMac36 GB (~24.1 usable)~80 tok/s128K (full)No price yet
Apple M4 Max (32-core GPU) 36GBMac36 GB (~24.1 usable)~137 tok/s128K (full)No price yet
Apple Mac Studio M5 Max (32-core GPU, 36 GB)Mac36 GB (~24.1 usable)~143 tok/s128K (full)low $2,499new · source, 2026-10-16
AMD Radeon PRO V710Data center GPU28 GB~179 tok/s128K (full)No price yet
AMD Radeon AI PRO R9600Workstation GPU32 GB~216 tok/s128K (full)No price yet
AMD Radeon AI PRO R9600DWorkstation GPU32 GB~216 tok/s128K (full)No price yet
AMD Radeon AI PRO R9700Workstation GPU32 GB~216 tok/s128K (full)No price yet
AMD Radeon AI PRO R9700SWorkstation GPU32 GB~216 tok/s128K (full)No price yet
AMD Radeon PRO V620Data center GPU32 GB~193 tok/s128K (full)No price yet
AMD Radeon PRO W6800Workstation GPU32 GB~193 tok/s128K (full)No price yet
AMD Radeon PRO W7800 32GBWorkstation GPU32 GB~205 tok/s128K (full)No price yet
AMD Ryzen AI Max 385 (32GB)Mini PC32 GB~125 tok/s128K (full)No price yet
AMD Ryzen AI Max 390 (32GB)Mini PC32 GB~125 tok/s128K (full)No price yet
AMD Ryzen AI Max+ 395 (32GB)Mini PC32 GB~125 tok/s128K (full)No price yet
Intel Arc Pro B70Workstation GPU32 GB~183 tok/s128K (full)No price yet
NVIDIA GeForce RTX 5090GPU32 GB~233 tok/s128K (full)low $6,500avg $8,757 · new · source, 2026-11-02
NVIDIA Quadro GV100Workstation GPU32 GB~199 tok/s128K (full)No price yet
NVIDIA RTX 5000 Ada GenerationWorkstation GPU32 GB~173 tok/s128K (full)No price yet
NVIDIA RTX PRO 4500 BlackwellWorkstation GPU32 GB~200 tok/s128K (full)No price yet
NVIDIA RTX Spark N1X laptop (6144-core GPU, 32GB)Laptop32 GB~129 tok/s128K (full)No price yet
NVIDIA V100 PCIe 32GBData center GPU32 GB~200 tok/s128K (full)No price yet
NVIDIA V100S PCIe 32GBData center GPU32 GB~213 tok/s128K (full)No price yet
Apple M3 Max (40-core GPU) 48GBMac48 GB (~36 usable)~135 tok/s128K (full)No price yet
Apple M4 Max (40-core GPU) 48GBMac48 GB (~36 usable)~152 tok/s128K (full)No price yet
Apple M4 Pro 48GBMac48 GB (~36 usable)~113 tok/s128K (full)No price yet
Apple M5 Max (40-core GPU) 48GBMac48 GB (~36 usable)~158 tok/s128K (full)No price yet
Apple M5 Pro 48GBMac48 GB (~36 usable)~120 tok/s128K (full)No price yet
NVIDIA A100 40GB PCIeData center GPU40 GB~227 tok/s128K (full)No price yet
NVIDIA A800 40GB ActiveWorkstation GPU40 GB~227 tok/s128K (full)No price yet
AMD Radeon PRO W7800 48GBWorkstation GPU48 GB~247 tok/s128K (full)No price yet
AMD Radeon PRO W7900Workstation GPU48 GB~247 tok/s128K (full)No price yet
AMD Radeon PRO W7900 Dual SlotWorkstation GPU48 GB~247 tok/s128K (full)No price yet
Apple M1 Max 64GBMac64 GB (~48 usable)~135 tok/s128K (full)No price yet
Apple M1 Ultra 64GBMac64 GB (~48 usable)~171 tok/s128K (full)No price yet
Apple M2 Max (30-core GPU) 64GBMac64 GB (~48 usable)~135 tok/s128K (full)No price yet
Apple M2 Max (38-core GPU) 64GBMac64 GB (~48 usable)~135 tok/s128K (full)No price yet
Apple M2 Ultra 64GBMac64 GB (~48 usable)~171 tok/s128K (full)No price yet
Apple M3 Max (40-core GPU) 64GBMac64 GB (~48 usable)~135 tok/s128K (full)No price yet
Apple M4 Max (40-core GPU) 64GBMac64 GB (~48 usable)~152 tok/s128K (full)No price yet
Apple M4 Pro 64GBMac64 GB (~48 usable)~113 tok/s128K (full)No price yet
Apple M5 Pro 64GBMac64 GB (~48 usable)~120 tok/s128K (full)No price yet
Apple Mac Studio M5 Max (40-core GPU, 64 GB)Mac64 GB (~48 usable)~158 tok/s128K (full)No price yet
NVIDIA A40Data center GPU48 GB~185 tok/s128K (full)No price yet
NVIDIA L40Data center GPU48 GB~198 tok/s128K (full)No price yet
NVIDIA L40SData center GPU48 GB~198 tok/s128K (full)No price yet
NVIDIA Quadro RTX 8000Workstation GPU48 GB~183 tok/s128K (full)No price yet
NVIDIA RTX 6000 Ada GenerationWorkstation GPU48 GB~204 tok/s128K (full)No price yet
NVIDIA RTX A6000Workstation GPU48 GB~191 tok/s128K (full)low $8,363new · source, 2026-11-02
NVIDIA RTX PRO 5000 Blackwell 48GBWorkstation GPU48 GB~221 tok/s128K (full)No price yet
NVIDIA RTX Spark N1X laptop (6144-core GPU, 48GB)Laptop48 GB~129 tok/s128K (full)No price yet
AMD Ryzen AI Max 385 (64GB)Mini PC64 GB~125 tok/s128K (full)No price yet
AMD Ryzen AI Max 390 (64GB)Mini PC64 GB~125 tok/s128K (full)No price yet
AMD Ryzen AI Max+ 395 (64GB)Mini PC64 GB~125 tok/s128K (full)low $2,199.99new · source, 2026-11-13
NVIDIA DGX Spark (64GB)Mini PC64 GB~122 tok/s128K (full)low $4,999new · source, 2026-11-13
NVIDIA RTX Spark N1X laptop (6144-core GPU, 64GB)Laptop64 GB~129 tok/s128K (full)No price yet
Apple M2 Max (38-core GPU) 96GBMac96 GB (~72 usable)~135 tok/s128K (full)No price yet
Apple M3 Max (30-core GPU) 96GBMac96 GB (~72 usable)~119 tok/s128K (full)No price yet
Apple M3 Ultra 96GBMac96 GB (~72 usable)~172 tok/s128K (full)No price yet
Apple Mac Studio M5 Ultra (64-core GPU, 96 GB)Mac96 GB (~72 usable)~188 tok/s128K (full)low $5,499new · source, 2026-10-23
NVIDIA RTX PRO 5000 Blackwell 72GBWorkstation GPU72 GB~221 tok/s128K (full)No price yet
NVIDIA A100 80GB PCIeData center GPU80 GB~236 tok/s128K (full)No price yet
Apple M1 Ultra 128GBMac128 GB (~96 usable)~171 tok/s128K (full)No price yet
Apple M2 Ultra 128GBMac128 GB (~96 usable)~171 tok/s128K (full)No price yet
Apple M3 Max (40-core GPU) 128GBMac128 GB (~96 usable)~135 tok/s128K (full)No price yet
Apple M4 Max (40-core GPU) 128GBMac128 GB (~96 usable)~152 tok/s128K (full)No price yet
Apple M5 Max (40-core GPU) 128GBMac128 GB (~96 usable)~158 tok/s128K (full)No price yet
NVIDIA RTX PRO 6000 Blackwell Max-QWorkstation GPU96 GB~233 tok/s128K (full)No price yet
NVIDIA RTX PRO 6000 Blackwell Server EditionData center GPU96 GB~229 tok/s128K (full)No price yet
NVIDIA RTX PRO 6000 Blackwell Workstation EditionWorkstation GPU96 GB~233 tok/s128K (full)No price yet
AMD Ryzen AI Max 385 (128GB)Mini PC128 GB~125 tok/s128K (full)No price yet
AMD Ryzen AI Max 390 (128GB)Mini PC128 GB~125 tok/s128K (full)No price yet
AMD Ryzen AI Max+ 395 (128GB)Mini PC128 GB~125 tok/s128K (full)low $3,499.99new · source, 2026-11-13
NVIDIA DGX Spark (128GB)Mini PC128 GB~122 tok/s128K (full)low $6,949.99new · source, 2026-10-23
NVIDIA RTX Spark N1X laptop (6144-core GPU, 128GB)Laptop128 GB~129 tok/s128K (full)No price yet
Apple M2 Ultra 192GBMac192 GB (~144 usable)~171 tok/s128K (full)No price yet
Apple M3 Ultra 256GBMac256 GB (~192 usable)~172 tok/s128K (full)No price yet
Apple M5 Ultra 256GBMac256 GB (~192 usable)~188 tok/s128K (full)No price yet
Framework Desktop, AMD Ryzen AI Max+ PRO 495 (Strix Halo), 192 GBMini PC192 GB~131 tok/s128K (full)low $6,799new · source, 2026-10-16
Apple M5 Ultra 512GBMac512 GB (~384 usable)~188 tok/s128K (full)No price yet

Speed calculator

estimate

Estimate = bandwidth ÷ GB read per token (the model's listed GGUF file: Q4_K_M for most models, otherwise the quant named in the list; scaled by active/total parameters for MoE), scaled by a per-platform efficiency and fixed per-token costs calibrated to 45 measured llama.cpp benchmarks (2025–26). Fit = file size + 1.5 GB headroom ≤ total VRAM (on Macs, the part of unified memory macOS lets the GPU use by default), and room for at least 4K tokens of context with an 8-bit KV cache. For a model with no KV cache data, only the file and headroom are checked, so a fit says nothing about context. Multi-GPU: VRAM adds, speed stays one card's (a layer split runs the cards in turn); max context uses the total. Speed is for short context. Max context = what is left after the file and a 1 GB runtime reserve ÷ KV cache bytes per token, default FP16 and 8-bit (q8_0) cache. How speed works · how context works

Related