0:00 / 0:00
bloomery 0.3.1 e659f4fe, Qwen3.8 UD-Q4_K_XL, no memory limit, BLOOMERY_RESIDENCY=off (arm B)
Qwen3.8-Flash-Next-UD-Q4_K_XL-00001-of-00004.gguf · 41.4 tok/s decode · 1 stream · q4_K · rtx-5090
bloomery-serve --ctx-size 8192 --parallel 2 --cache-ram 0, greedy, thinking off, 256 tokens. Recorded as request 20 on this server, after one warm-up and 18 requests with the same 33-token body.
decode
41.4tok/s
prefill
127tok/s
ttft p50
285ms
| model | Qwen3.8-Flash-Next-UD-Q4_K_XL-00001-of-00004.gguf |
| quantisation | q4_K · 4.5 bit |
| size | 111.3 GB · MoE 512/10 |
| engine | bloomery 0.3.1 (e659f4feb1b4) |
| host | linux · 1x rtx-5090 |
| gpus | NVIDIA GeForce RTX 5090 |
| streams | 1 |
| workload | 33 in / 256 out · cache 0% |
| context | 4096 window · 2 slots |
| config | offload partial |
| draft | mtp-Qwen3.8-Flash-Next-shared-Q8_0.gguf · 51% accepted |
| machine | 74.2 of 600 W |
| prompt set | not in a comparison set |
| recorded | 2026-10-12T12:49:15Z |
| toktape | 0.7.4 |
Details
The transcript, the card as text, and why each caveat fired — read out of the record in your browser, the same way Replay draws it.
! 1 caveat —
short_prompt_for_prefill. The card that comes with this record spells each one out.Page views are counted with Cloudflare Web Analytics: no cookies, no fingerprinting. The toktape binary itself sends nothing anywhere.
