0:00 / 0:00
DeepSeek-V2-Lite-Chat Q3_K_M · 1 stream
DeepSeek-V2-Lite-Chat.Q3_K_M.gguf · 183 tok/s decode · 1 stream · Q3_K_M · rtx-a6000
A 16B MoE with 2.4B active, Q3_K_M, one stream on the A6000 under ik_llama.cpp. The fastest single stream on this box.
decode
183tok/s
prefill
1386tok/s
ttft p50
203ms
| model | DeepSeek-V2-Lite-Chat.Q3_K_M.gguf |
| quantisation | Q3_K_M |
| engine | ik_llama.cpp c10fbbcc |
| host | linux · 1x rtx-a6000 |
| gpus | NVIDIA RTX A6000 |
| streams | 1 |
| prompt set | not in a comparison set |
| recorded | 2026-09-17T18:31:55+09:00 |
| toktape | 0.2.2 |
Details
The transcript, the card as text, and why each caveat fired — read out of the record in your browser, the same way Replay draws it.
! 1 caveat —
recorded. The card that comes with this record spells each one out.