One RTX 3090 · Strata 6f32ec0 · Qwen3.8 Flash Next IQ3_XXS 76 GB · Korean chat
Qwen3.8-Flash-Next-GSQ-RCO-IQ3_XXS-00001-of-00002.gguf · 91.4 tok/s decode · 1 stream · IQ3_XXS
One RTX 3090 (250 W cap) on one box, one server at a time. The A6000 held nothing while each server was up; the script checked this. Same prompts for every engine: greedy, thinking off, one discarded warm-up per load. Recorded with toktape 0.7.1-8dde1df, which counts a server's child processes as the server.
Three setups: - bloomery 0.2.1 (commit b83f1269) on UD-Q4_K_XL (111 GB), at its defaults: MTP draft and adaptive residency. - Strata 6f32ec0 on its recommended GSQ-RCO IQ3_XXS file (76 GB). - Strata 6f32ec0 on the same UD-Q4_K_XL file bloomery serves. Strata reads it through --gguf-dir and lists that path as experimental.
Each setup ran once at one request (bloomery --parallel 1, Strata's setup config) for the one-stream tapes, and once at three (--parallel 3, or "parallel": 3 added to the config) for the three-stream tape.
The three-stream tapes are client-timed (--engine-kind openai), because Strata's /props reports total_slots 1 under "parallel": 3 (fix proposed upstream, Niko1221/Strata#1004).
Demonstration clips, not lease numbers.
| model | Qwen3.8-Flash-Next-GSQ-RCO-IQ3_XXS-00001-of-00002.gguf |
| quantisation | IQ3_XXS · 3.06 bit |
| size | 177B params · 11B active · 75.8 GB · MoE 512/10 |
| engine | llama-server Strata 0.1.39 |
| host | linux |
| gpus | NVIDIA GeForce RTX 3090 / NVIDIA RTX A6000 |
| streams | 1 |
| workload | 33 in / 400 out · cache 0% |
| context | 131072 window · 1 slot |
| config | ? |
| machine | 267.6 of 550 W |
| prompt set | not in a comparison set |
| recorded | 2026-10-06T00:03:55Z |
| toktape | 0.7.1-8dde1df |
Details
The transcript, the card as text, and why each caveat fired — read out of the record in your browser, the same way Replay draws it.
short_prompt_for_prefill, client_disagrees_with_server, recorded, recorded, recorded. The card that comes with this record spells each one out.Page views are counted with Cloudflare Web Analytics: no cookies, no fingerprinting. The toktape binary itself sends nothing anywhere.
