RigPerDollar

What GPU do you need to run Ornith-1.5-122B?

A new Framework Desktop ($6,799). No priced GPU card holds Ornith-1.5-122B (about 80.4 GB at Q4); this system holds it with room for its full 256K context, at about 29 tok/s estimate. 5 of the 157 GPUs and systems we track fit it.

Parameters125.09B10B active (mixture-of-experts)
Q4_K_M GGUF78.92 GBsource
VRAM needed~80.4 GBfile + headroom
Single GPUs that fit5
ReleasedOct 16, 2026source
LicenseMITsource
Context window256K tokens

125.09B parameters, 10B active (mixture-of-experts) (Hugging Face, accessed 2026-11-11). Q4_K_M GGUF: 78.92 GB (source). Architecture config (Hugging Face config.json): 12 attention layers (the rest are recurrent) × 2 KV heads × 256 head dim, so about 24 KB of FP16 KV cache per token of context (how we estimate context).

Ornith's card calls it a 122B MoE model and gives no active-parameter count. Its config.json has the same layout as Qwen3.5-122B-A10B, whose card says 10B activated, so this page uses 10B for its speed estimates. That is our inference from the matching config, not a figure Ornith publishes. Same architecture as Qwen3.5-122B-A10B (qwen35moe), so it runs in stock llama.cpp (bartowski quantized with release b11716). Fit ignores the 0.91 GB vision projector. Reasoning model, thinking on by default. On a Mac, Ornith's own MLX 4-bit build is listed under What we checked. Release date is the Hugging Face repo creation date.

What we checked

Checked Nov 11, 2026. Official is the maker or the weight files. A vendor claim is that project's own documentation. A community claim is someone else's upload. Our check is a file or search we read. Unknown means we have no source, so it is not estimated. None of these rows is a speed we measured.

KindWhatDetailSource
OfficialModel cardOrnith's card calls Ornith-1.5-122B "a 122B MOE model" and does not state how many parameters are active per token. It says Ornith-1.0 was developed on top of Qwen3.5 and Gemma4, and Ornith-1.5 extends it. That is Ornith's description; it is not an official Qwen release, and the card does not say it is a fine-tune of the Qwen3.5-122B-A10B checkpoint. It is a reasoning model with thinking on by default. The card gives a context of up to 262,144 tokens. Hugging Face's safetensors metadata totals 125,086,497,008 BF16 parameters (125.09B on this page).Model card, checked Nov 11, 2026
OfficialWeight filesThe BF16 safetensors sum to 250,173,238,368 bytes (250.17 GB) at revision 7681ef608624e7532d8164128bcffdbdbaf1b1af. That is a download size, not GPU or unified memory.Hugging Face API, checked Nov 11, 2026
OfficialArchitecture configconfig.json sets model_type qwen3_5_moe: 48 layers, with full attention on every 4th layer (12 attention layers) and linear attention on the rest; 2 KV heads with head dim 256; 256 experts with 8 routed per token, expert width 1,024; max_position_embeddings 262,144; a vision tower is included. Ornith's card gives no active-parameter count. This layout is the same as Qwen3.5-122B-A10B's, whose card says 10B activated, so this page uses 10B for its speed estimates. That is our inference from the matching config, not a figure Ornith publishes.config.json, checked Nov 11, 2026
Our checkSame config as Qwen3.5-122B-A10BWe compared Ornith's config.json with Qwen/Qwen3.5-122B-A10B's. They are identical apart from cosmetic fields (dtype, transformers_version, and the vision model_type label), so the context and expert-split figures on this page use the same values as the Qwen3.5-122B-A10B page.Qwen config.json, checked Nov 11, 2026
OfficialMLX for MacsOrnith publishes its own MLX builds. The 4-bit build is 69,612,579,840 bytes of safetensors (69.61 GB, or 64.83 GiB), including a 902,618,785-byte vision file. The 8-bit build (ornith-ai/Ornith-1.5-122B-MLX-8bit) is 130,648,354,386 bytes (130.65 GB). These are file sizes, not memory. The fit and speed figures on this page are for the GGUF, not these files.MLX 4-bit repo, checked Nov 11, 2026
Community claimezoushen MLX mixed 4.46 bpw68,994,951,362 bytes of safetensors (68.99 GB). The uploader's card says it is 64.3 GiB with vision, 4.46 bits per weight, made for 128 GB Apple Silicon Macs (tested on an M5 Max), and runs with Splash (DFlash2 speculative decoding) and mlx-lm 0.31.3 (text only). Those are the uploader's claims; we have not run it.ezoushen card, checked Nov 11, 2026
OfficialSingle-GPU serving claimOrnith's own claim, not ours: the card says it "serves on a single 80GB GPU" with vLLM ≥ 0.19.1, SGLang ≥ 0.5.9 or Transformers ≥ 5.8.1. The BF16 weights are 250.17 GB, and Ornith's FP8 checkpoint is 132.95 GB (next row), so the 80 GB claim can only refer to a 4-bit-class checkpoint such as Ornith's NVFP4 build (77.63 GB). The card doesn't say which. We have not tested it.Model card, checked Nov 11, 2026
OfficialFP8 checkpointornith-ai/Ornith-1.5-122B-FP8 is 132,949,613,832 bytes (132.95 GB). A download size, not memory.FP8 repo, checked Nov 11, 2026
OfficialNVFP4 checkpointornith-ai/Ornith-1.5-122B-NVFP4 is 77,627,904,940 bytes (77.63 GB). A download size, not memory.NVFP4 repo, checked Nov 11, 2026
Community claimllama.cppbartowski's GGUFs were made with llama.cpp release b11716 and use the qwen35moe architecture, so stock llama.cpp loads them. The Q4_K_M is two parts, 40,005,676,608 + 38,916,060,128 = 78,921,736,736 bytes (78.92 GB), the file the fit on this page uses. bartowski's BF16 vision projector is 912,263,520 bytes and is not counted in the fit.bartowski GGUF (commit a8bc08fa), checked Nov 11, 2026

GGUF files and sizes

Exact sizes from Hugging Face, accessed 2026-11-11. The fit and context tables on this page use the Q4_K_M file (78.92 GB); a smaller file needs less memory by the difference. VRAM needed is the file + the same headroom.

FilePublished byBytesSizeVRAM neededSource
Q4_K_Mornith-ai (official)75,843,911,64875.84 GB~77.3 GBOrnith-1.5-122B-Q4_K_M.gguf
Q4_K_Mbartowski (community)78,921,736,73678.92 GB~80.4 GBOrnith-1.5-122B-Q4_K_M/ (2 parts)
Q5_K_Mornith-ai (official)88,710,135,77688.71 GB~90.2 GBHugging Face
Q6_Kornith-ai (official)102,380,498,912102.38 GB~103.9 GBHugging Face
Q8_0ornith-ai (official)132,555,710,048132.56 GB~134.1 GBHugging Face
BF16 mmproj Vision projector, extraornith-ai (official)912,263,2000.91 GB—mmproj-Ornith-1.5-122B-BF16.gguf

Other places to get it

Checked Nov 14, 2026. We list only copies we opened and checked. Check file hashes for copies from other uploaders.

Single GPUs that fit, cheapest first

Single GPU that fitsVRAMSpeed estimateMax context estimatePrice
Framework Desktop, AMD Ryzen AI Max+ PRO 495 (Strix Halo), 192 GB192 GB~29 tok/s256K (full)low $6,799new · source, 2026-10-16
NVIDIA DGX Spark (128GB)128 GB~33 tok/s256K (full)low $6,949.99new · source, 2026-10-23
NVIDIA RTX PRO 6000 Blackwell Max-Q96 GB~123 tok/s256K (full)No price yet
NVIDIA RTX PRO 6000 Blackwell Server Edition96 GB~117 tok/s256K (full)No price yet
NVIDIA RTX PRO 6000 Blackwell Workstation Edition96 GB~123 tok/s256K (full)No price yet

Every device that runs it

Graphics cards, Macs and mini PCs from the wider hardware list behind My rig, smallest usable memory first. Not sure about yours? Check your exact rig.

Show all 18 devices that run it
DeviceTypeMemorySpeed estimateMax context estimatePrice
Apple M1 Ultra 128GBMac128 GB (~96 usable)~61 tok/s256K (full)No price yet
Apple M2 Ultra 128GBMac128 GB (~96 usable)~61 tok/s256K (full)No price yet
Apple M3 Max (40-core GPU) 128GBMac128 GB (~96 usable)~40 tok/s256K (full)No price yet
Apple M4 Max (40-core GPU) 128GBMac128 GB (~96 usable)~49 tok/s256K (full)No price yet
Apple M5 Max (40-core GPU) 128GBMac128 GB (~96 usable)~53 tok/s256K (full)No price yet
NVIDIA RTX PRO 6000 Blackwell Max-QWorkstation GPU96 GB~123 tok/s256K (full)No price yet
NVIDIA RTX PRO 6000 Blackwell Server EditionData center GPU96 GB~117 tok/s256K (full)No price yet
NVIDIA RTX PRO 6000 Blackwell Workstation EditionWorkstation GPU96 GB~123 tok/s256K (full)No price yet
AMD Ryzen AI Max 385 (128GB)Mini PC128 GB~27 tok/s256K (full)No price yet
AMD Ryzen AI Max 390 (128GB)Mini PC128 GB~27 tok/s256K (full)No price yet
AMD Ryzen AI Max+ 395 (128GB)Mini PC128 GB~27 tok/s256K (full)low $3,499.99new · source, 2026-11-13
NVIDIA DGX Spark (128GB)Mini PC128 GB~33 tok/s256K (full)low $6,949.99new · source, 2026-10-23
NVIDIA RTX Spark N1X laptop (6144-core GPU, 128GB)Laptop128 GB~36 tok/s256K (full)No price yet
Apple M2 Ultra 192GBMac192 GB (~144 usable)~61 tok/s256K (full)No price yet
Apple M3 Ultra 256GBMac256 GB (~192 usable)~62 tok/s256K (full)No price yet
Apple M5 Ultra 256GBMac256 GB (~192 usable)~75 tok/s256K (full)No price yet
Framework Desktop, AMD Ryzen AI Max+ PRO 495 (Strix Halo), 192 GBMini PC192 GB~29 tok/s256K (full)low $6,799new · source, 2026-10-16
Apple M5 Ultra 512GBMac512 GB (~384 usable)~75 tok/s256K (full)No price yet

Multi-GPU: cards that need two or more

CardsTotal VRAMSpeed estimateMax context estimate
4 × AMD Radeon RX 7900 XTX96 GB~75 tok/s256K (full)
4 × NVIDIA GeForce RTX 309096 GB~85 tok/s256K (full)
4 × NVIDIA GeForce RTX 409096 GB~89 tok/s256K (full)
3 × NVIDIA GeForce RTX 509096 GB~123 tok/s256K (full)
2 × NVIDIA RTX A600096 GB~74 tok/s256K (full)

Speed calculator

estimate

Estimate = bandwidth ÷ GB read per token (the model's listed GGUF file: Q4_K_M for most models, otherwise the quant named in the list; scaled by active/total parameters for MoE), scaled by a per-platform efficiency and fixed per-token costs calibrated to 45 measured llama.cpp benchmarks (2025–26). Fit = file size + 1.5 GB headroom ≤ total VRAM (on Macs, the part of unified memory macOS lets the GPU use by default), and room for at least 4K tokens of context with an 8-bit KV cache. For a model with no KV cache data, only the file and headroom are checked, so a fit says nothing about context. Multi-GPU: VRAM adds, speed stays one card's (a layer split runs the cards in turn); max context uses the total. Speed is for short context. Max context = what is left after the file and a 1 GB runtime reserve ÷ KV cache bytes per token, default FP16 and 8-bit (q8_0) cache. How speed works · how context works

Reported by others

These are speed reports posted by individual users or reviewers. We haven't checked or reproduced them. They are not our estimates, they don't feed the estimator or My Rig, and they can't be compared with the tok/s figures elsewhere on this site or with each other, because each used a different model, quant, engine and test.

What this does and doesn't show

For coding agents, how much total output a machine keeps up with several requests at once, and how long each waits for its first token, matter as much as single-request tok/s. These reports show that for specific setups only; they don't show what you'd get with a different engine, quant or workload.

Ornith-1.5-122B at 4-bit on an M5 Ultra Mac, with and without DFlash2 drafting

Reported by @plotarmordev on X
How this run was set up
Model & revisionOrnith-1.5-122B (ornith-ai); exact repo and revision Unknown
Quant4-bit (per the post); exact file Unknown
Runtime & versionUnknown. The post credits Mac support for the drafter to @BobClawblaw and @ashxhart; the author says in a reply the DFlash2 drafter is by inco
Topology1x Mac with an M5 Ultra; memory size UnknownThe poster didn't give the Mac's memory size, so this run isn't listed on any Mac hardware page.
Input / output / contextUnknown
ConcurrencyUnknown for the 91 and 242 tok/s figures; four chats at once for the 'about 20%' figure
Speculative decodingOff for 91 tok/s. On (DFlash2 drafter) for 242 tok/s. The author says the output was token for token the same; we haven't checked that.
How speed was timedUnknown
Date measuredUnknown (posted 2026-11-11)
Source@plotarmordev on X, 2026-11-11 · Author's reply naming the drafter
Evidence statusSelf-reported, not independently reproduced

Plain decoding (no drafting)

WhatReportedNote
Generation91 tok/s—

With speculative decoding (DFlash2 drafter)

WhatReportedNote
Generation, same prompt per the author242 tok/s—
Four chats at oncegain drops to about 20% (author's words; no tok/s given)—

The 242 tok/s figure uses a drafter. How much a drafter helps depends on how predictable the text is, so it isn't a plain generation speed.

Caveats

  • One post with a graphic; no prompt, output length, context or runtime version given.
  • Self-reported, not independently reproduced.

Related