toktape mascot: a mint-haired chibi in headphonestoktapethe record, not a recording of it
The toktape card for this run: 102 tok/s decode · 1 stream · UD-Q6_K · rtx-a6000 



  
  
  0:00 / 0:00







  
  
  Download the record



Offload ladder · 10 layers on CPU


Qwen3.6-35B-A3B-UD-Q6_K.gguf · 102 tok/s decode · 1 stream · UD-Q6_K · rtx-a6000


 midagedev




Qwen3.6-35B-A3B UD-Q6_K (27.3 GiB) on one RTX A6000 48G, ik_llama.cpp c10fbbcc, -fa on.


Same ladder, ten layers on the CPU. Decode drops from ~129 to ~102 tok/s: what a fifth of the expert layers on DDR4 costs on this box.






decode
102tok/s


prefill
959tok/s


ttft p50
334ms







modelQwen3.6-35B-A3B-UD-Q6_K.gguf


quantisationUD-Q6_K · 6.56 bit


engineik_llama.cpp c10fbbcc


hostlinux · 1x rtx-a6000


gpusNVIDIA RTX A6000


streams1


prompt setnot in a comparison set


recorded2026-09-17T21:34:52+09:00


toktape0.2.2






  
Details

  
The transcript, the card as text, and why each caveat fired — read out of the record in your browser, the same way Replay draws it.

  
  




! 2 caveats — answer_cut, recorded. The card that comes with this record spells each one out.