toktapethe record, not a recording of it

midagedev

https://github.com/midagedev

Narrowed toquant: q3_k_m ×engine: ik_llama.cpp ×os: linux ×Clear all

4 runs, newest first

DeepSeek-V2-Lite-Chat Q3_K_M · 4 streams 211 tok/s

DeepSeek-V2-Lite-Chat.Q3_K_M.gguf

ik_llama.cppc10fbbccQ3_K_Mrtx-a6000linux4 streams ! 1 caveat

2026-09-18

DeepSeek-V2-Lite-Chat Q3_K_M · 1 stream 183 tok/s

DeepSeek-V2-Lite-Chat.Q3_K_M.gguf

ik_llama.cppc10fbbccQ3_K_Mrtx-a6000linux1 stream ! 1 caveat

2026-09-18

Qwen2.5-7B-Instruct Q3_K_M · 4 streams · dense control 196 tok/s

Qwen2.5-7B-Instruct-Q3_K_M.gguf

ik_llama.cppc10fbbccQ3_K_Mrtx-a6000linux4 streams ! 1 caveat

2026-09-18

Qwen2.5-7B-Instruct Q3_K_M · 1 stream · dense control 116 tok/s

Qwen2.5-7B-Instruct-Q3_K_M.gguf

ik_llama.cppc10fbbccQ3_K_Mrtx-a6000linux1 stream ! 2 caveats

2026-09-18