0:00 / 0:00
bloomery · GLM-5.3-Flash UD-Q4_K_XL · RTX 3090 alone · Rust chat 33 in / 502 out · residency + NextN MTP draft
GLM-5.3-Flash-UD-Q4_K_XL-00001-of-00006.gguf · 27.2 tok/s decode · 1 stream · q4_K
GLM-5.3-Flash UD-Q4_K_XL (public file), bloomery 07ec8f04 bloomery-serve --model glm --place gate --ctx 4096 on the RTX 3090 alone (250 W cap), BLOOMERY_DRAFT=mtp BLOOMERY_RESIDENCY=mid-p0-s1 (the NextN draft is off by default on the 3090), prompts in groups of two 512-position batches with the host union's row lanes; greedy, cache_prompt off, reasoning_effort low (GLM-5.3's template always thinks).
decode
27.2tok/s
prefill
55.2tok/s
ttft p50
677ms
| model | GLM-5.3-Flash-UD-Q4_K_XL-00001-of-00006.gguf |
| quantisation | q4_K · 4.5 bit |
| size | 199.7 GB · MoE 288/8 |
| engine | bloomery 0.1.0 (07ec8f04) |
| host | linux |
| gpus | NVIDIA GeForce RTX 3090 / NVIDIA RTX A6000 |
| streams | 1 |
| workload | 33 in / 502 out · cache 0% |
| context | 4096 window · 1 slot |
| config | offload partial |
| draft | GLM-5.3-Flash-UD-Q4_K_XL-00001-of-00006.gguf · 91% accepted |
| machine | 267.5 of 550 W |
| prompt set | not in a comparison set |
| recorded | 2026-10-02T23:17:51Z |
| toktape | v0.6.0 |
Details
The transcript, the card as text, and why each caveat fired — read out of the record in your browser, the same way Replay draws it.
! 2 caveats —
short_prompt_for_prefill, conditions_changed. The card that comes with this record spells each one out.Page views are counted with Cloudflare Web Analytics: no cookies, no fingerprinting. The toktape binary itself sends nothing anywhere.
