toktape mascot: a mint-haired chibi in headphonestoktapethe record, not a recording of it
The toktape card for this run: 183 tok/s decode · 1 stream · Q3_K_M · rtx-a6000

0:00 / 0:00
Download the record

DeepSeek-V2-Lite-Chat Q3_K_M · 1 stream

DeepSeek-V2-Lite-Chat.Q3_K_M.gguf · 183 tok/s decode · 1 stream · Q3_K_M · rtx-a6000

midagedev

A 16B MoE with 2.4B active, Q3_K_M, one stream on the A6000 under ik_llama.cpp. The fastest single stream on this box.

decode
183tok/s
prefill
1386tok/s
ttft p50
203ms
modelDeepSeek-V2-Lite-Chat.Q3_K_M.gguf
quantisationQ3_K_M
engineik_llama.cpp c10fbbcc
hostlinux · 1x rtx-a6000
gpusNVIDIA RTX A6000
streams1
prompt setnot in a comparison set
recorded2026-09-17T18:31:55+09:00
toktape0.2.2

Details

The transcript, the card as text, and why each caveat fired — read out of the record in your browser, the same way Replay draws it.

! 1 caveatrecorded. The card that comes with this record spells each one out.