toktapethe record, not a recording of it

midagedev

https://github.com/midagedev

Narrowed toquant: q3_k_m ×sessions: 1 ×Clear all

4 runs, newest first

DeepSeek-V4.1-Flash Q3_K_M · Korean prose, no thinking 20.3 tok/s

DeepSeek-V4.1-Flash-Q3_K_M-00001-of-00009.gguf

llama-serverb96Q3_K_Mrtx-a6000 rtx-3090 linux1 stream! 2 caveats

2026-09-18

DeepSeek-V4.1-Flash Q3_K_M · 1 stream · 347 GB model on 72 GB of VRAM 28.6 tok/s

DeepSeek-V4.1-Flash-Q3_K_M-00001-of-00009.gguf

llama-serverb96Q3_K_Mrtx-a6000 rtx-3090 linux1 stream! 1 caveat

2026-09-18

DeepSeek-V2-Lite-Chat Q3_K_M · 1 stream 183 tok/s

DeepSeek-V2-Lite-Chat.Q3_K_M.gguf

ik_llama.cppc10fbbccQ3_K_Mrtx-a6000 linux1 stream! 1 caveat

2026-09-18

Qwen2.5-7B-Instruct Q3_K_M · 1 stream · dense control 116 tok/s

Qwen2.5-7B-Instruct-Q3_K_M.gguf

ik_llama.cppc10fbbccQ3_K_Mrtx-a6000 linux1 stream! 2 caveats

2026-09-18