toktapethe record, not a recording of it

NVIDIA RTX A6000

4 runs, newest first

ik_llama.cpp · V4.1 Flash Q3_K_M · 3090 + A6000 · coding review 507 in / 1500 out · DSpark n_max=3 28.8 tok/sprefill 156 tok/s

DeepSeek-V4.1-Flash-Q3_K_M-00001-of-00009.gguf

ik_llama.cpp81af2772Q3_K_M748B · 16B activeP507 · G1500 · cache 0%ctx 16koffload partialrtx-3090rtx-a6000linux1 stream! 2 caveats

midagedev

2026-09-30

Qwen3-Coder-Next IQ4_XS · 1 stream · long answer 129 tok/sprefill 1821 tok/s

qwen3-coder-next-512x2.5b

ik_llama.cpp7cd62a3eIQ4_XS80B · 4.2B activeP6881 · G5061 · cache 0%ctx 32kfa onrtx-3090rtx-a6000linux1 stream! 2 caveats

midagedev

2026-09-20

Offload ladder · 10 of 40 blocks' experts on CPU 97.9 tok/sprefill 1756 tok/s

qwen3.6-35b-a3b

ik_llama.cppUD-Q6_K35B · 3.5B activeP7246 · G2048 · cache 0%ctx 32kfa onoffload partialrtx-3090rtx-a6000linux1 stream! 1 caveat

midagedev

2026-09-20

Qwen3.6-35B-A3B Q6_K · 1 stream · ik_llama.cpp 125 tok/sprefill 2734 tok/s

qwen3.6-35b-a3b

ik_llama.cpp7cd62a3eUD-Q6_K35B · 3.5B activeP7248 · G5271 · cache 0%ctx 32kfa onrtx-3090rtx-a6000linux1 stream! 3 caveats

midagedev

2026-09-20

Page views are counted with Cloudflare Web Analytics: no cookies, no fingerprinting. The toktape binary itself sends nothing anywhere.