0:00 / 0:00
Qwen3.8-Flash-Next on a 12 GB RTX 3060, short prompt (bloomery 0.3.1 release candidate)
Qwen3.8-Flash-Next-UD-Q4_K_XL-00001-of-00004.gguf · 5.4 tok/s decode · 1 stream · q4_K · rtx-3060
bloomery 0.3.1 release candidate 5ae948b0 (the v0.3.1 tag, f9ae9524, has the same Qwen3.8 path). Serving defaults: no flags, no --ctx-size. RTX 3060 12 GB, WSL2, 32 GB host. The experts that fit neither the card nor RAM are paged from NVMe; about 260 GB is read during the long-prompt tape.
decode
5.4tok/s
prefill
6.1tok/s
ttft p50
5458ms
| model | Qwen3.8-Flash-Next-UD-Q4_K_XL-00001-of-00004.gguf |
| quantisation | q4_K · 4.5 bit |
| size | 111.3 GB · MoE 512/10 |
| engine | bloomery 0.3.1 (5ae948b013c9) |
| host | linux · 1x rtx-3060 |
| gpus | NVIDIA GeForce RTX 3060 |
| streams | 1 |
| workload | 33 in / 400 out · cache 0% |
| context | 28881 window · 1 slot |
| config | offload partial |
| machine | 38.8 of 180 W · cold cache |
| prompt set | not in a comparison set |
| recorded | 2026-10-12T08:58:37Z |
| toktape | 0.7.4-c23e25e |
Details
The transcript, the card as text, and why each caveat fired — read out of the record in your browser, the same way Replay draws it.
! 3 caveats —
cold_cache, short_prompt_for_prefill, machine_contended. The card that comes with this record spells each one out.Page views are counted with Cloudflare Web Analytics: no cookies, no fingerprinting. The toktape binary itself sends nothing anywhere.
