toktape mascot: a mint-haired chibi in headphonestoktapethe record, not a recording of it
The toktape card for this run: 19.4 tok/s decode · 2 streams · EXL3 4.05 bpw · head 6.0 



  
  
  0:00 / 0:00







  
  
  Download the record



GLM-5.3-Flash EXL3 4.05 bpw · 2 streams · exllamav3


GLM-5.3-Flash-exl3-4.05 · 19.4 tok/s decode · 2 streams · EXL3 4.05 bpw · head 6.0


 midagedev




Same server, two streams batched. Per-stream decode halves and the aggregate lands near the single-stream rate — batching on exllamav3 did not add throughput for this model on this pair of cards.






decode
19.4tok/s


prefill
78.3tok/s


ttft p50
2780ms







modelGLM-5.3-Flash-exl3-4.05


quantisationEXL3 4.05 bpw · head 6.0


engineexllamav3 1.5.0


hostlinux


gpusNVIDIA RTX A6000 / NVIDIA GeForce RTX 3090


streams2


prompt setnot in a comparison set


recorded2026-09-15T22:26:36+09:00


toktape0.2.2






  
Details

  
The transcript, the card as text, and why each caveat fired — read out of the record in your browser, the same way Replay draws it.

  
  




! 2 caveats — recorded, conditions_changed. The card that comes with this record spells each one out.