0:00 / 0:00
GLM-5.3-Flash EXL3 4.05 bpw · 1 stream · exllamav3
GLM-5.3-Flash-exl3-4.05 · 22.0 tok/s decode · 1 stream · EXL3 4.05 bpw · head 6.0
GLM-5.3-Flash quantised to EXL3 at 4.05 bpw (head 6.0), served by exllamav3 1.5.0 across the RTX 3090 + RTX A6000. One stream. The engine reports its own placement; there is no GGUF to read.
decode
22.0tok/s
prefill
9.2tok/s
ttft p50
3551ms
| model | GLM-5.3-Flash-exl3-4.05 |
| quantisation | EXL3 4.05 bpw · head 6.0 |
| engine | exllamav3 1.5.0 |
| host | linux |
| gpus | NVIDIA RTX A6000 / NVIDIA GeForce RTX 3090 |
| streams | 1 |
| prompt set | not in a comparison set |
| recorded | 2026-09-15T20:56:46+09:00 |
| toktape | v0.2.1-5-g0719fec |
Details
The transcript, the card as text, and why each caveat fired — read out of the record in your browser, the same way Replay draws it.
! 3 caveats —
short_prompt_for_prefill, recorded, conditions_changed. The card that comes with this record spells each one out.