toktapethe record, not a recording of it

midagedev

https://github.com/midagedev

Narrowed toengine: ik_llama.cpp ×os: linux ×Clear all

14 runs, newest first

GLM-5.3-Flash graftB Q6_K · MTP · ik_llama.cpp 24.2 tok/s

GLM-5.3-Flash-graftB.gguf

ik_llama.cpp425a2c1dQ6_K rtx-a6000 rtx-3090linux1 stream ! 2 caveats

2026-09-18

Qwen3-Coder-Next IQ4_XS · 1 stream · long answer 133 tok/s

Qwen3-Coder-Next-IQ4_XS.gguf

ik_llama.cppc10fbbccIQ4_XS rtx-3090 rtx-a6000linux1 stream ! 3 caveats

2026-09-18

DeepSeek-V2-Lite-Chat Q3_K_M · 4 streams 211 tok/s

DeepSeek-V2-Lite-Chat.Q3_K_M.gguf

ik_llama.cppc10fbbccQ3_K_M rtx-a6000linux4 streams ! 1 caveat

2026-09-18

DeepSeek-V2-Lite-Chat Q3_K_M · 1 stream 183 tok/s

DeepSeek-V2-Lite-Chat.Q3_K_M.gguf

ik_llama.cppc10fbbccQ3_K_M rtx-a6000linux1 stream ! 1 caveat

2026-09-18

Qwen2.5-7B-Instruct Q3_K_M · 4 streams · dense control 196 tok/s

Qwen2.5-7B-Instruct-Q3_K_M.gguf

ik_llama.cppc10fbbccQ3_K_M rtx-a6000linux4 streams ! 1 caveat

2026-09-18

Qwen2.5-7B-Instruct Q3_K_M · 1 stream · dense control 116 tok/s

Qwen2.5-7B-Instruct-Q3_K_M.gguf

ik_llama.cppc10fbbccQ3_K_M rtx-a6000linux1 stream ! 2 caveats

2026-09-18

Qwen3.6-35B-A3B UD-Q4_K_XL · 1 stream 140 tok/s

Qwen3.6-35B-A3B-UD-Q4_K_XL.gguf

ik_llama.cppc10fbbccUD-Q4_K_XLrtx-a6000 rtx-3090linux1 stream ! 3 caveats

2026-09-18

Offload ladder · 10 layers on CPU 102 tok/s

Qwen3.6-35B-A3B-UD-Q6_K.gguf

ik_llama.cppc10fbbccUD-Q6_K rtx-a6000linux1 stream ! 2 caveats

2026-09-18

Offload ladder · 0 layers on CPU 129 tok/s

Qwen3.6-35B-A3B-UD-Q6_K.gguf

ik_llama.cppc10fbbccUD-Q6_K rtx-a6000linux1 stream ! 3 caveats

2026-09-18

The README hero: four code-review questions at once 144 tok/s

Qwen3.6-35B-A3B-UD-Q6_K.gguf

ik_llama.cppc10fbbccUD-Q6_K rtx-a6000linux4 streams ! 1 caveat

2026-09-18

Qwen3.6-35B-A3B Q6_K · 8 streams on 4 slots · ik_llama.cpp 152 tok/s

Qwen3.6-35B-A3B-UD-Q6_K.gguf

ik_llama.cppc10fbbccUD-Q6_K rtx-a6000linux8 streams ! 2 caveats

2026-09-18

Qwen3.6-35B-A3B Q6_K · 4 streams · ik_llama.cpp 146 tok/s

Qwen3.6-35B-A3B-UD-Q6_K.gguf

ik_llama.cppc10fbbccUD-Q6_K rtx-a6000linux4 streams ! 2 caveats

2026-09-18

Qwen3.6-35B-A3B Q6_K · 2 streams · ik_llama.cpp 130 tok/s

Qwen3.6-35B-A3B-UD-Q6_K.gguf

ik_llama.cppc10fbbccUD-Q6_K rtx-a6000linux2 streams ! 2 caveats

2026-09-18

Qwen3.6-35B-A3B Q6_K · 1 stream · ik_llama.cpp 129 tok/s

Qwen3.6-35B-A3B-UD-Q6_K.gguf

ik_llama.cppc10fbbccUD-Q6_K rtx-a6000linux1 stream ! 3 caveats

2026-09-18