0:00 / 0:00
bloomery · GLM-5.3-Flash UD-Q4_K_XL · A6000 alone · Rust chat 33 in / 574 out · residency + NextN MTP draft
GLM-5.3-Flash-UD-Q4_K_XL-00001-of-00006.gguf · 31.5 tok/s decode · 1 stream · q4_K
bloomery-serve --place a on the A6000 alone at its serving defaults: adaptive residency mid-p0-s1 and the NextN MTP draft. Greedy, cache_prompt off, one warm-up discarded. reasoning_effort low through chat_template_kwargs (GLM-5.3's template always opens <think>); the tape's rendered prompt is toktape's own render without the kwargs.
decode
31.5tok/s
prefill
50.7tok/s
ttft p50
726ms
| model | GLM-5.3-Flash-UD-Q4_K_XL-00001-of-00006.gguf |
| quantisation | q4_K · 4.5 bit |
| size | 199.7 GB · MoE 288/8 |
| engine | bloomery 0.1.0 (6a35136a-dirty) |
| host | linux |
| gpus | NVIDIA GeForce RTX 3090 / NVIDIA RTX A6000 |
| streams | 1 |
| workload | 33 in / 574 out · cache 0% |
| context | 4096 window · 1 slot |
| config | offload partial |
| draft | GLM-5.3-Flash-UD-Q4_K_XL-00001-of-00006.gguf · 89% accepted |
| machine | 327.8 of 550 W |
| prompt set | not in a comparison set |
| recorded | 2026-10-01T18:04:05Z |
| toktape | v0.6.0 |
Details
The transcript, the card as text, and why each caveat fired — read out of the record in your browser, the same way Replay draws it.
! 2 caveats —
short_prompt_for_prefill, conditions_changed. The card that comes with this record spells each one out.Page views are counted with Cloudflare Web Analytics: no cookies, no fingerprinting. The toktape binary itself sends nothing anywhere.
