toktapethe record, not a recording of it

midagedev

https://github.com/midagedev

Narrowed toquant: q3_k_m ×Clear all

7 runs, newest first

DeepSeek-V4.1-Flash Q3_K_M · Korean prose, no thinking 20.3 tok/s

DeepSeek-V4.1-Flash-Q3_K_M-00001-of-00009.gguf

llama-serverb96Q3_K_Mrtx-a6000 rtx-3090 linux 1 stream ! 2 caveats

2026-09-18

DeepSeek-V4.1-Flash Q3_K_M · 4 streams 27.4 tok/s

DeepSeek-V4.1-Flash-Q3_K_M-00001-of-00009.gguf

llama-serverb96Q3_K_Mrtx-a6000 rtx-3090 linux 4 streams ! 1 caveat

2026-09-18

DeepSeek-V4.1-Flash Q3_K_M · 1 stream · 347 GB model on 72 GB of VRAM 28.6 tok/s

DeepSeek-V4.1-Flash-Q3_K_M-00001-of-00009.gguf

llama-serverb96Q3_K_Mrtx-a6000 rtx-3090 linux 1 stream ! 1 caveat

2026-09-18

DeepSeek-V2-Lite-Chat Q3_K_M · 4 streams 211 tok/s

DeepSeek-V2-Lite-Chat.Q3_K_M.gguf

ik_llama.cppc10fbbccQ3_K_Mrtx-a6000 linux 4 streams ! 1 caveat

2026-09-18

DeepSeek-V2-Lite-Chat Q3_K_M · 1 stream 183 tok/s

DeepSeek-V2-Lite-Chat.Q3_K_M.gguf

ik_llama.cppc10fbbccQ3_K_Mrtx-a6000 linux 1 stream ! 1 caveat

2026-09-18

Qwen2.5-7B-Instruct Q3_K_M · 4 streams · dense control 196 tok/s

Qwen2.5-7B-Instruct-Q3_K_M.gguf

ik_llama.cppc10fbbccQ3_K_Mrtx-a6000 linux 4 streams ! 1 caveat

2026-09-18

Qwen2.5-7B-Instruct Q3_K_M · 1 stream · dense control 116 tok/s

Qwen2.5-7B-Instruct-Q3_K_M.gguf

ik_llama.cppc10fbbccQ3_K_Mrtx-a6000 linux 1 stream ! 2 caveats

2026-09-18