One RTX 3090 · bloomery 0.2.1 · Qwen3.8 Flash Next UD-Q4_K_XL 111 GB · code review, 1500 tokens
Qwen3.8-Flash-Next-UD-Q4_K_XL-00001-of-00004.gguf · 71.9 tok/s decode · 1 stream · q4_K
One RTX 3090 (250 W cap) on one box, one server at a time. The A6000 held nothing while each server was up; the script checked this. Same prompts for every engine: greedy, thinking off, one discarded warm-up per load. Recorded with toktape 0.7.1-8dde1df, which counts a server's child processes as the server.
Three setups: - bloomery 0.2.1 (commit b83f1269) on UD-Q4_K_XL (111 GB), at its defaults: MTP draft and adaptive residency. - Strata 6f32ec0 on its recommended GSQ-RCO IQ3_XXS file (76 GB). - Strata 6f32ec0 on the same UD-Q4_K_XL file bloomery serves. Strata reads it through --gguf-dir and lists that path as experimental.
Each setup ran once at one request (bloomery --parallel 1, Strata's setup config) for the one-stream tapes, and once at three (--parallel 3, or "parallel": 3 added to the config) for the three-stream tape.
The three-stream tapes are client-timed (--engine-kind openai), because Strata's /props reports total_slots 1 under "parallel": 3 (fix proposed upstream, Niko1221/Strata#1004).
Demonstration clips, not lease numbers.
| model | Qwen3.8-Flash-Next-UD-Q4_K_XL-00001-of-00004.gguf |
| quantisation | q4_K · 4.5 bit |
| size | 111.3 GB · MoE 512/10 |
| engine | bloomery 0.2.1 (b83f1269) |
| host | linux |
| gpus | NVIDIA GeForce RTX 3090 / NVIDIA RTX A6000 |
| streams | 1 |
| workload | 538 in / 1500 out · cache 0% |
| context | 38912 window · 1 slot |
| config | offload partial |
| draft | mtp-Qwen3.8-Flash-Next-shared-Q8_0.gguf · 74% accepted |
| machine | 266.7 of 550 W |
| prompt set | not in a comparison set |
| recorded | 2026-10-06T00:01:00Z |
| toktape | 0.7.1-8dde1df |
Details
The transcript, the card as text, and why each caveat fired — read out of the record in your browser, the same way Replay draws it.
conditions_changed. The card that comes with this record spells each one out.Page views are counted with Cloudflare Web Analytics: no cookies, no fingerprinting. The toktape binary itself sends nothing anywhere.
