toktape mascot: a mint-haired chibi in headphonestoktapethe record, not a recording of it
The toktape card for this run: 27.4 tok/s decode · 4 streams · Q3_K_M 



  
  
  0:00 / 0:00







  
  
  Download the record



DeepSeek-V4.1-Flash Q3_K_M · 4 streams


DeepSeek-V4.1-Flash-Q3_K_M-00001-of-00009.gguf · 27.4 tok/s decode · 4 streams · Q3_K_M


 midagedev




DeepSeek-V4.1-Flash Q3_K_M (engram Q8, token embeddings BF16), 9 shards, ~347 GB — far more than the 72 GB of VRAM on the RTX A6000 + RTX 3090, so most of the experts stream from 252 GB of DDR4. llama-server b96.


Four streams: per-stream decode drops to ~7 tok/s but the aggregate is a touch above the single stream — the expert traffic from RAM is shared across streams.






decode
27.4tok/s


prefill
24.7tok/s


ttft p50
4249ms







modelDeepSeek-V4.1-Flash-Q3_K_M-00001-of-00009.gguf


quantisationQ3_K_M


enginellama-server b96


hostlinux


gpusNVIDIA RTX A6000 / NVIDIA GeForce RTX 3090


streams4


prompt setnot in a comparison set


recorded2026-09-13T20:29:10+09:00


toktapedev






  
Details

  
The transcript, the card as text, and why each caveat fired — read out of the record in your browser, the same way Replay draws it.

  
  




! 1 caveat — short_prompt_for_prefill. The card that comes with this record spells each one out.