0:00 / 0:00
bloomery · GLM-5.3-Flash UD-Q4_K_XL · A6000 alone · coding review 497 in / 2000 out · residency + NextN MTP draft
GLM-5.3-Flash-UD-Q4_K_XL-00001-of-00006.gguf · 31.3 tok/s decode · 1 stream · q4_K
bloomery-serve --place a on the A6000 alone at its serving defaults: adaptive residency mid-p0-s1 and the NextN MTP draft. Greedy, cache_prompt off, one warm-up discarded. reasoning_effort low through chat_template_kwargs (GLM-5.3's template always opens <think>); the tape's rendered prompt is toktape's own render without the kwargs.
decode
31.3tok/s
prefill
94.8tok/s
ttft p50
5244ms
| model | GLM-5.3-Flash-UD-Q4_K_XL-00001-of-00006.gguf |
| quantisation | q4_K · 4.5 bit |
| size | 199.7 GB · MoE 288/8 |
| engine | bloomery 0.1.0 (6a35136a-dirty) |
| host | linux |
| gpus | NVIDIA GeForce RTX 3090 / NVIDIA RTX A6000 |
| streams | 1 |
| workload | 497 in / 2000 out · 281 thinking · cache 0% |
| context | 4096 window · 1 slot |
| config | offload partial |
| draft | GLM-5.3-Flash-UD-Q4_K_XL-00001-of-00006.gguf · 91% accepted |
| machine | 327 of 550 W |
| prompt set | not in a comparison set |
| recorded | 2026-10-01T18:02:47Z |
| toktape | v0.6.0 |
Details
The transcript, the card as text, and why each caveat fired — read out of the record in your browser, the same way Replay draws it.
Page views are counted with Cloudflare Web Analytics: no cookies, no fingerprinting. The toktape binary itself sends nothing anywhere.
