0:00 / 0:00
GLM-5.3-Flash EXL3 4.05 bpw · 2 streams · exllamav3
GLM-5.3-Flash-exl3-4.05 · 18.4 tok/s decode · 2 streams · EXL3 4.05 bpw · head 6.0
decode
18.4tok/s
prefill
308tok/s
ttft p50
30459ms
| model | GLM-5.3-Flash-exl3-4.05 |
| quantisation | EXL3 4.05 bpw · head 6.0 |
| size | 313B params · 21B active · 165.2 GB · MoE 288/8 |
| engine | exllamav3 1.5.0 |
| host | linux |
| gpus | NVIDIA GeForce RTX 3090 / NVIDIA RTX A6000 |
| streams | 2 |
| workload | 5296 in / 548 out · min 539 · 548 thinking · cache 0% · per stream |
| context | 16384 window · 2 slots |
| config | offload partial |
| draft | mtp |
| machine | 256.8 of 720 W |
| prompt set | not in a comparison set |
| recorded | 2026-09-20T09:54:26Z |
| toktape | dev |
Details
The transcript, the card as text, and why each caveat fired — read out of the record in your browser, the same way Replay draws it.
! 5 caveats —
ragged_aggregate, answer_cut, recorded, conditions_changed, run_cut_by_clock. The card that comes with this record spells each one out.