RigPerDollar

What GPU do you need to run Ripple-65B Preview?

A new RTX A6000 ($8,363). It is the cheapest priced graphics card that holds Ripple-65B Preview (about 40.3 GB at Q4) with room for about 116K tokens of context (224K with 8-bit KV cache), at about 17 tok/s estimate; that is the card price only, and it requires a separate compatible PC. 20 of the 157 GPUs and systems we track fit it.

Parameters64.78B
Q4_K_M GGUF38.8 GBsource
VRAM needed~40.3 GBfile + headroom
Single GPUs that fit20
ReleasedNov 4, 2026source
LicenseApache 2.0source
Context window1M tokens

64.78B parameters (Hugging Face, accessed 2026-11-13). Q4_K_M GGUF: 38.8 GB (source). Architecture config (Hugging Face config.json): 16 global attention layers × 8 KV heads × 128 head dim, plus 64 sliding-window layers (1024-token window), so about 64 KB of FP16 KV cache per token of context (how we estimate context).

Ricursive Intelligence's dense 65B coding and agent model, trained from scratch, released as a preview. Dense means every token reads all of the weights, so per token it is slower than a mixture-of-experts model with a file of similar size. Ricursive calls the design "thin-and-deep" and "Gemma 3N-like": 80 layers, 64 of them sliding-window (1,024 tokens) and 16 full attention. Context is the card's 1,048,576 tokens. Q4_K_M is AtomicChat's plain llama.cpp quant (Ripple-65B-Preview-Q4_K_M.gguf, 38,798,820,576 bytes, no importance matrix); every size is in the table below. Stock llama.cpp loads it from build b12167, and tagged release v1.0.0 includes it. Release date is the Hugging Face repo creation date.

What we checked

Checked Nov 13, 2026. Official is the maker or the weight files. A vendor claim is that project's own documentation. A community claim is someone else's upload. Our check is a file or search we read. Unknown means we have no source, so it is not estimated. None of these rows is a speed we measured.

KindWhatDetailSource
OfficialModel cardRicursive's card calls it a "65B parameter dense Transformer", "pretrained on 12 trillion tokens", with a context of "up to 1Mi (1,048,576 tokens)", and describes the design as "thin-and-deep" and "Gemma 3N-like". config.json (model_type ricursive): 80 layers, hidden size 5,120, 80 attention heads, 8 KV heads, head size 128. Its layer_types list has 64 sliding_attention layers (window 1,024) and 16 full_attention layers (every 5th layer), with gated attention and value residuals. config.json's max_position_embeddings is 2,097,152; this page uses the card's 1,048,576. Hugging Face's safetensors total is 64,782,689,360 parameters (BF16). Transformers needs the repo's own code (configuration_ricursive.py and modeling_ricursive.py).Model card, checked Nov 13, 2026
OfficialLicenseApache 2.0, in the repo's LICENSE file. This is a summary of the license, not legal advice.LICENSE, checked Nov 13, 2026
OfficialWeight files16 BF16 safetensors files sum to 129,565,519,472 bytes (129.57 GB) at commit b172323ffd63e62de9ce1ba3830dfffe493c7671. These are downloads, not the memory a runtime needs.Hugging Face API, checked Nov 13, 2026
OfficialNVFP4 checkpoint (experimental)Ricursive's ricursiveAI/Ripple-65B-Preview-NVFP4, labeled "(Experimental)", is 57,213,852,024 bytes of safetensors (57.21 GB) at commit 2789217ba87d93e8d032fad25217c4c63a0e1d5b. Its card describes a "conservative quantization ... NVFP4 for the MLP layers while keeping attention in BF16". It is not a GGUF, and the fits on this page use the Q4_K_M file.NVFP4 repo, checked Nov 13, 2026
Vendor claimDGX Spark (Ricursive's claim)Ricursive's card: "At only 65B total parameters, the model can fit on consumer hardware such as the NVIDIA DGX Spark. To encourage local model development, we provide an NVFP4 checkpoint and colab". That is Ricursive's claim. The DGX Spark rows on this page are our math on the Q4_K_M file, not a test.Model card, checked Nov 13, 2026
Vendor claimBenchmark scores (Ricursive's)Ricursive's card reports Terminal-Bench 2.1 80.5 (marked self-reported) and SWE-bench Verified 76.5. The card itself says "Replicating benchmark scores has been challenging" and calls its table "a best-effort attempt". These are Ricursive's own reported scores, not checked by us.Model card, checked Nov 13, 2026
OfficialDFlash2 draft modelRicursive publishes a DFlash2 draft model, ricursiveAI/Ripple-65B-Preview-DFlash2 (4,037,752,064 parameters, 8,075,513,104 bytes in BF16). It is only for speculative decoding (drafting) and is not a fit file. The speed estimates on this page do not assume drafting.DFlash2 repo, checked Nov 13, 2026
Our checkDFlash2 in llama.cpp (not merged)llama.cpp support for drafting Ripple with DFlash2 is not merged: pull request #31904 is open. A reviewer comment there says NoPE handling for the drafter was missing and that adding it improved acceptance on the reviewer's branch. The PR author's speed figures, with and without drafting, are under Reported by others below.llama.cpp PR #31904, checked Nov 13, 2026
Community claimGGUF files (AtomicChat)AtomicChat/Ripple-65B-Preview-GGUF (commit df550a7178a87bbfb6ee2bdbd37603c553d536ee), GGUF architecture ricursive. AtomicChat's card calls the plain Q4_K_M a "plain llama.cpp preset, no imatrix". The AD files are AtomicChat's own per-tensor "Atomic Dynamic" layouts, made with an importance matrix. AtomicChat reports a mean KLD (how far the quant's output drifts from the original) of 0.0149 for AD-IQ4_XS against 0.0380 for the plain Q4_K_M; that is their measurement. This page uses the plain Q4_K_M. Every size is in the table below.AtomicChat GGUF card, checked Nov 13, 2026
Community claimGH200 run (AtomicChat's figure)AtomicChat's card reports one run of the plain Q4_K_M with llama-cli on one GH200 96 GB: prompt 309 tokens/s, generation 40.6 tokens/s. That is AtomicChat's figure from a single run. We have not run it, and it is not a speed estimate on this page.AtomicChat GGUF card, checked Nov 13, 2026
Our checkllama.cppPull request #31692, "model : add Ripple (ricursiveai)", merged on 2026-11-05. The first build with it is b12167; AtomicChat's card says it "Runs on stock llama.cpp b12167 or newer, no patch". It is in tagged release v1.0.0 (2026-11-13). A loader is not a confirmed setup or a speed on this site.llama.cpp PR #31692, checked Nov 13, 2026
Community claimOllama and LM StudioAtomicChat's card says apps that bundle an older llama.cpp, LM Studio and Ollama among them, may not load it yet. We have not checked which llama.cpp build Ollama or LM Studio ships.AtomicChat GGUF card, checked Nov 13, 2026
Community claimMLX (unofficial)There is no official or mlx-community MLX build. frogggias/Ripple-65B-Preview-MLX-4bit (commit 4a33b33f043f41a51ae7236edd440d64cfa7cc94, 36,442,941,052 bytes) is a community build; its card says "mlx-lm doesn't know Ripple's architecture yet", so it ships its own ricursive.py and needs --trust-remote-code. An 8-bit version exists (frogggias/Ripple-65B-Preview-MLX-8bit). MLX support for Ripple is unofficial and not merged into mlx-lm.frogggias MLX card, checked Nov 13, 2026

GGUF files and sizes

Exact sizes from Hugging Face, accessed 2026-11-13. The fit and context tables on this page use the Q4_K_M file (38.8 GB); a smaller file needs less memory by the difference. VRAM needed is the file + the same headroom.

FilePublished byBytesSizeVRAM neededSource
AD-IQ1_MAtomicChat18,493,392,35218.49 GB~20 GBHugging Face
AD-IQ2_XXSAtomicChat20,007,273,95220.01 GB~21.5 GBHugging Face
AD-IQ2_XSAtomicChat22,120,482,27222.12 GB~23.6 GBHugging Face
AD-IQ2_SAtomicChat25,310,774,75225.31 GB~26.8 GBHugging Face
AD-IQ3_XXSAtomicChat27,964,982,75227.96 GB~29.5 GBHugging Face
AD-IQ3_SAtomicChat32,411,600,35232.41 GB~33.9 GBHugging Face
AD-IQ4_XSAtomicChat38,722,143,71238.72 GB~40.2 GBHugging Face
Q4_K_MAtomicChat38,798,820,57638.8 GB~40.3 GBRipple-65B-Preview-Q4_K_M.gguf
AD-Q4_K_MAtomicChat40,426,079,71240.43 GB~41.9 GBHugging Face
AD-Q5_K_MAtomicChat47,929,624,03247.93 GB~49.4 GBHugging Face
AD-Q6_KAtomicChat57,666,225,85657.67 GB~59.2 GB2 parts
Q8_0AtomicChat68,840,113,56868.84 GB~70.3 GB2 parts
BF16AtomicChat129,572,324,928129.57 GB~131.1 GB3 parts

Other places to get it

Checked Nov 14, 2026. We list only copies we opened and checked. Check file hashes for copies from other uploaders.

Single GPUs that fit, cheapest first

Single GPU that fitsVRAMSpeed estimateMax context estimatePrice
NVIDIA DGX Spark (64GB)64 GB~6 tok/s354K · 672K (8-bit)low $4,999new · source, 2026-11-13
Apple Mac Studio M5 Ultra (64-core GPU, 96 GB)96 GB (~72 usable)~26 tok/s473K · 897K (8-bit)low $5,499new · source, 2026-10-23
Framework Desktop, AMD Ryzen AI Max+ PRO 495 (Strix Halo), 192 GB192 GB~5 tok/s1M (full)low $6,799new · source, 2026-10-16
NVIDIA DGX Spark (128GB)128 GB~6 tok/s1M (full)low $6,949.99new · source, 2026-10-23
NVIDIA RTX A600048 GB~17 tok/s116K · 224K (8-bit)low $8,363new · source, 2026-11-02
AMD Radeon PRO W7800 48GB48 GB~17 tok/s116K · 224K (8-bit)No price yet
AMD Radeon PRO W790048 GB~17 tok/s116K · 224K (8-bit)No price yet
AMD Radeon PRO W7900 Dual Slot48 GB~17 tok/s116K · 224K (8-bit)No price yet
Apple Mac Studio M5 Max (40-core GPU, 64 GB)64 GB (~48 usable)~14 tok/s116K · 224K (8-bit)No price yet
NVIDIA A4048 GB~15 tok/s116K · 224K (8-bit)No price yet
NVIDIA L4048 GB~19 tok/s116K · 224K (8-bit)No price yet
NVIDIA L40S48 GB~19 tok/s116K · 224K (8-bit)No price yet
NVIDIA Quadro RTX 800048 GB~15 tok/s116K · 224K (8-bit)No price yet
NVIDIA RTX 6000 Ada Generation48 GB~21 tok/s116K · 224K (8-bit)No price yet
NVIDIA RTX PRO 5000 Blackwell 48GB48 GB~29 tok/s116K · 224K (8-bit)No price yet
NVIDIA RTX PRO 5000 Blackwell 72GB72 GB~29 tok/s473K · 897K (8-bit)No price yet
NVIDIA A100 80GB PCIe80 GB~42 tok/s593K · 1M (8-bit)No price yet
NVIDIA RTX PRO 6000 Blackwell Max-Q96 GB~39 tok/s831K · 1M (8-bit)No price yet
NVIDIA RTX PRO 6000 Blackwell Server Edition96 GB~35 tok/s831K · 1M (8-bit)No price yet
NVIDIA RTX PRO 6000 Blackwell Workstation Edition96 GB~39 tok/s831K · 1M (8-bit)No price yet

Every device that runs it

Graphics cards, Macs and mini PCs from the wider hardware list behind My rig, smallest usable memory first. Not sure about yours? Check your exact rig.

Show all 50 devices that run it
DeviceTypeMemorySpeed estimateMax context estimatePrice
AMD Radeon PRO W7800 48GBWorkstation GPU48 GB~17 tok/s116K · 224K (8-bit)No price yet
AMD Radeon PRO W7900Workstation GPU48 GB~17 tok/s116K · 224K (8-bit)No price yet
AMD Radeon PRO W7900 Dual SlotWorkstation GPU48 GB~17 tok/s116K · 224K (8-bit)No price yet
Apple M1 Max 64GBMac64 GB (~48 usable)~9 tok/s116K · 224K (8-bit)No price yet
Apple M1 Ultra 64GBMac64 GB (~48 usable)~18 tok/s116K · 224K (8-bit)No price yet
Apple M2 Max (30-core GPU) 64GBMac64 GB (~48 usable)~9 tok/s116K · 224K (8-bit)No price yet
Apple M2 Max (38-core GPU) 64GBMac64 GB (~48 usable)~9 tok/s116K · 224K (8-bit)No price yet
Apple M2 Ultra 64GBMac64 GB (~48 usable)~18 tok/s116K · 224K (8-bit)No price yet
Apple M3 Max (40-core GPU) 64GBMac64 GB (~48 usable)~9 tok/s116K · 224K (8-bit)No price yet
Apple M4 Max (40-core GPU) 64GBMac64 GB (~48 usable)~12 tok/s116K · 224K (8-bit)No price yet
Apple M4 Pro 64GBMac64 GB (~48 usable)~6 tok/s116K · 224K (8-bit)No price yet
Apple M5 Pro 64GBMac64 GB (~48 usable)~7 tok/s116K · 224K (8-bit)No price yet
Apple Mac Studio M5 Max (40-core GPU, 64 GB)Mac64 GB (~48 usable)~14 tok/s116K · 224K (8-bit)No price yet
NVIDIA A40Data center GPU48 GB~15 tok/s116K · 224K (8-bit)No price yet
NVIDIA L40Data center GPU48 GB~19 tok/s116K · 224K (8-bit)No price yet
NVIDIA L40SData center GPU48 GB~19 tok/s116K · 224K (8-bit)No price yet
NVIDIA Quadro RTX 8000Workstation GPU48 GB~15 tok/s116K · 224K (8-bit)No price yet
NVIDIA RTX 6000 Ada GenerationWorkstation GPU48 GB~21 tok/s116K · 224K (8-bit)No price yet
NVIDIA RTX A6000Workstation GPU48 GB~17 tok/s116K · 224K (8-bit)low $8,363new · source, 2026-11-02
NVIDIA RTX PRO 5000 Blackwell 48GBWorkstation GPU48 GB~29 tok/s116K · 224K (8-bit)No price yet
NVIDIA RTX Spark N1X laptop (6144-core GPU, 48GB)Laptop48 GB~7 tok/s116K · 224K (8-bit)No price yet
AMD Ryzen AI Max 385 (64GB)Mini PC64 GB~5 tok/s354K · 672K (8-bit)No price yet
AMD Ryzen AI Max 390 (64GB)Mini PC64 GB~5 tok/s354K · 672K (8-bit)No price yet
AMD Ryzen AI Max+ 395 (64GB)Mini PC64 GB~5 tok/s354K · 672K (8-bit)low $2,199.99new · source, 2026-11-13
NVIDIA DGX Spark (64GB)Mini PC64 GB~6 tok/s354K · 672K (8-bit)low $4,999new · source, 2026-11-13
NVIDIA RTX Spark N1X laptop (6144-core GPU, 64GB)Laptop64 GB~7 tok/s354K · 672K (8-bit)No price yet
Apple M2 Max (38-core GPU) 96GBMac96 GB (~72 usable)~9 tok/s473K · 897K (8-bit)No price yet
Apple M3 Max (30-core GPU) 96GBMac96 GB (~72 usable)~7 tok/s473K · 897K (8-bit)No price yet
Apple M3 Ultra 96GBMac96 GB (~72 usable)~18 tok/s473K · 897K (8-bit)No price yet
Apple Mac Studio M5 Ultra (64-core GPU, 96 GB)Mac96 GB (~72 usable)~26 tok/s473K · 897K (8-bit)low $5,499new · source, 2026-10-23
NVIDIA RTX PRO 5000 Blackwell 72GBWorkstation GPU72 GB~29 tok/s473K · 897K (8-bit)No price yet
NVIDIA A100 80GB PCIeData center GPU80 GB~42 tok/s593K · 1M (8-bit)No price yet
Apple M1 Ultra 128GBMac128 GB (~96 usable)~18 tok/s831K · 1M (8-bit)No price yet
Apple M2 Ultra 128GBMac128 GB (~96 usable)~18 tok/s831K · 1M (8-bit)No price yet
Apple M3 Max (40-core GPU) 128GBMac128 GB (~96 usable)~9 tok/s831K · 1M (8-bit)No price yet
Apple M4 Max (40-core GPU) 128GBMac128 GB (~96 usable)~12 tok/s831K · 1M (8-bit)No price yet
Apple M5 Max (40-core GPU) 128GBMac128 GB (~96 usable)~14 tok/s831K · 1M (8-bit)No price yet
NVIDIA RTX PRO 6000 Blackwell Max-QWorkstation GPU96 GB~39 tok/s831K · 1M (8-bit)No price yet
NVIDIA RTX PRO 6000 Blackwell Server EditionData center GPU96 GB~35 tok/s831K · 1M (8-bit)No price yet
NVIDIA RTX PRO 6000 Blackwell Workstation EditionWorkstation GPU96 GB~39 tok/s831K · 1M (8-bit)No price yet
AMD Ryzen AI Max 385 (128GB)Mini PC128 GB~5 tok/s1M (full)No price yet
AMD Ryzen AI Max 390 (128GB)Mini PC128 GB~5 tok/s1M (full)No price yet
AMD Ryzen AI Max+ 395 (128GB)Mini PC128 GB~5 tok/s1M (full)low $3,499.99new · source, 2026-11-13
NVIDIA DGX Spark (128GB)Mini PC128 GB~6 tok/s1M (full)low $6,949.99new · source, 2026-10-23
NVIDIA RTX Spark N1X laptop (6144-core GPU, 128GB)Laptop128 GB~7 tok/s1M (full)No price yet
Apple M2 Ultra 192GBMac192 GB (~144 usable)~18 tok/s1M (full)No price yet
Apple M3 Ultra 256GBMac256 GB (~192 usable)~18 tok/s1M (full)No price yet
Apple M5 Ultra 256GBMac256 GB (~192 usable)~26 tok/s1M (full)No price yet
Framework Desktop, AMD Ryzen AI Max+ PRO 495 (Strix Halo), 192 GBMini PC192 GB~5 tok/s1M (full)low $6,799new · source, 2026-10-16
Apple M5 Ultra 512GBMac512 GB (~384 usable)~26 tok/s1M (full)No price yet

Multi-GPU: cards that need two or more

CardsTotal VRAMSpeed estimateMax context estimate
3 × AMD Radeon RX 7800 XT48 GB~12 tok/s116K · 224K (8-bit)
2 × AMD Radeon RX 7900 XTX48 GB~19 tok/s116K · 224K (8-bit)
3 × AMD Radeon RX 9060 XT 16 GB48 GB~6 tok/s116K · 224K (8-bit)
3 × AMD Radeon RX 907048 GB~13 tok/s116K · 224K (8-bit)
3 × AMD Radeon RX 9070 XT48 GB~13 tok/s116K · 224K (8-bit)
4 × Intel Arc B58048 GB~7 tok/s116K · 224K (8-bit)
4 × NVIDIA GeForce RTX 3060 12 GB48 GB~8 tok/s116K · 224K (8-bit)
2 × NVIDIA GeForce RTX 309048 GB~21 tok/s116K · 224K (8-bit)
4 × NVIDIA GeForce RTX 4070 SUPER48 GB~11 tok/s116K · 224K (8-bit)
2 × NVIDIA GeForce RTX 409048 GB~22 tok/s116K · 224K (8-bit)
3 × NVIDIA GeForce RTX 5060 Ti 16 GB48 GB~10 tok/s116K · 224K (8-bit)
4 × NVIDIA GeForce RTX 507048 GB~15 tok/s116K · 224K (8-bit)
3 × NVIDIA GeForce RTX 5070 Ti48 GB~20 tok/s116K · 224K (8-bit)
3 × NVIDIA GeForce RTX 508048 GB~21 tok/s116K · 224K (8-bit)
2 × NVIDIA GeForce RTX 509064 GB~39 tok/s354K · 672K (8-bit)

Speed calculator

estimate

Estimate = bandwidth ÷ GB read per token (the model's listed GGUF file: Q4_K_M for most models, otherwise the quant named in the list; scaled by active/total parameters for MoE), scaled by a per-platform efficiency and fixed per-token costs calibrated to 45 measured llama.cpp benchmarks (2025–26). Fit = file size + 1.5 GB headroom ≤ total VRAM (on Macs, the part of unified memory macOS lets the GPU use by default), and room for at least 4K tokens of context with an 8-bit KV cache. For a model with no KV cache data, only the file and headroom are checked, so a fit says nothing about context. Multi-GPU: VRAM adds, speed stays one card's (a layer split runs the cards in turn); max context uses the total. Speed is for short context. Max context = what is left after the file and a 1 GB runtime reserve ÷ KV cache bytes per token, default FP16 and 8-bit (q8_0) cache. How speed works · how context works

Reported by others

These are speed reports posted by individual users or reviewers. We haven't checked or reproduced them. They are not our estimates, they don't feed the estimator or My Rig, and they can't be compared with the tok/s figures elsewhere on this site or with each other, because each used a different model, quant, engine and test.

What this does and doesn't show

For coding agents, how much total output a machine keeps up with several requests at once, and how long each waits for its first token, matter as much as single-request tok/s. These reports show that for specific setups only; they don't show what you'd get with a different engine, quant or workload.

Ripple-65B Preview on one RTX A6000 (Q4_K_M) and on one RTX 3090 (AD-IQ2_XXS), llama.cpp b12167

Reported by InferenceKey (inferencekey.com)
How this run was set up
Model & revisionricursiveAI/Ripple-65B-Preview, in AtomicChat's GGUFs; revision Unknown
QuantAtomicChat's plain Q4_K_M on the RTX A6000; AtomicChat's AD-IQ2_XXS (a 2-bit file) on the RTX 3090
Runtime & versionllama.cpp b12167
Topology1x RTX A6000 48 GB; separately, 1x RTX 3090 24 GBEach card ran on its own. The two setups used different files, so they are not a comparison of the cards.
Input / output / contextRTX 3090: 16K context with a q8_0 KV cache. RTX A6000: context Unknown. Prompts: coding tasks; lengths Unknown
ConcurrencyUnknown; the figures are per request
Speculative decodingOff: plain decoding, per the article
How speed was timedDecode tokens per second per request; method otherwise Unknown
Date measuredUnknown (published 2026-11-08)
SourceInferenceKey, 2026-11-08
Evidence statusSelf-reported, not independently reproduced

RTX A6000 48 GB, Q4_K_M, plain decoding

WhatReportedNote
Decode, per request14.3 to 16.3 tok/s—

RTX 3090 24 GB, AD-IQ2_XXS, 16K context, q8_0 cache, plain decoding

WhatReportedNote
Decode23.6 to 30.9 tok/s—
Memory used20,901 MiB—
Coding answers1 of 3 had a wrong test—

The RTX 3090 figures use AD-IQ2_XXS, a 2-bit file, not the Q4_K_M file this page's estimates use.

InferenceKey's measurements; we have not run either setup.

Caveats

  • A different file on each card.
  • Self-reported by InferenceKey, not independently reproduced.

Ripple-65B Preview (abliterated variant) on an M5 Max, with and without DFlash2 drafting, from unmerged llama.cpp PR #31904

Reported by The author of llama.cpp pull request #31904 (GitHub)
How this run was set up
Model & revisionAn abliterated Ripple-65B Preview variant, not the official checkpoint; exact repo and revision Unknown
QuantQ4_K GGUF (per the PR); DFlash2 drafter at Q8_0
Runtime & versionllama.cpp built from the open, unmerged PR #31904 (Metal)
Topology1x Apple M5 Max; memory size UnknownThe PR doesn't give the Mac's memory size, so this run isn't listed on any Mac hardware page.
Input / output / contextTemperature 0; prompt, output length and context Unknown
ConcurrencyUnknown
Speculative decodingOff for the no-draft row. On (DFlash2 drafter, Q8_0) for the draft n_max 4 and n_max 8 rows.
How speed was timedUnknown
Date measuredUnknown (PR still open on 2026-11-13)
Sourcellama.cpp PR #31904 (open)
Evidence statusSelf-reported, not independently reproduced

Plain decoding (no drafting)

WhatReportedNote
Generation, no draft14.5 tok/s—

With speculative decoding (DFlash2 drafter, Q8_0), unmerged PR

WhatReportedNote
Generation, draft n_max 419.3 tok/s—
Generation, draft n_max 89.3 tok/s—

These are the PR author's figures from an unmerged pull request, on an abliterated variant.

The drafted rows use a drafter. How much a drafter helps depends on how predictable the text is, so they aren't a plain generation speed.

A reviewer comment on the PR says NoPE handling for the drafter was missing and that adding it improved acceptance on the reviewer's branch, so these numbers may change.

Caveats

  • Unmerged pull request: stock llama.cpp can't draft Ripple with DFlash2 yet.
  • Abliterated variant, not the official checkpoint.
  • Self-reported, not independently reproduced.

Related