toktapethe record, not a recording of it

NVIDIA GeForce RTX 3090

7 runs, newest first

Qwen3.8-Flash-Next-UD-Q4_K_XL-00001-of-00004.gguf 81.9 tok/sprefill 128 tok/s

bloomery0.2.10 (8e55b8ce)q4_KP33 · G400 · cache 0%ctx 8koffload partialrtx-3090rtx-a6000linux2 streams! 2 caveats

midagedev

2026-10-10

Qwen3.8-Flash-Next-UD-Q4_K_XL-00001-of-00004.gguf 88.9 tok/sprefill 111 tok/s

bloomery0.2.10 (8e55b8ce)q4_KP33 · G400 · cache 0%ctx 8koffload partialrtx-3090rtx-a6000linux2 streams! 2 caveats

midagedev

2026-10-10

qwen3.6-35b-a3b 177 tok/sprefill 669 tok/s

bloomery0.2.10 (8e55b8ce)P33 · G400 · cache 0%ctx 8krtx-3090rtx-a6000linux2 streams! 1 caveat

midagedev

2026-10-10

GLM-5.3-Flash-UD-IQ4_XS-00001-of-00005.gguf 24.6 tok/sprefill 43.8 tok/s

bloomery0.2.10 (8e55b8ce)iq3_sP38 · G400 · cache 0%ctx 8koffload partialrtx-3090rtx-a6000linux2 streams! 4 caveats

midagedev

2026-10-10

bloomery 0.2.1 · Qwen3.8 Flash Next UD-Q4_K_XL · RTX A6000 · 2 streams 91.3 tok/sprefill 117 tok/s

Qwen3.8-Flash-Next-UD-Q4_K_XL-00001-of-00004.gguf

bloomery0.2.1 (b83f1269)q4_KP33 · G400 · cache 0%ctx 24064offload partialrtx-3090rtx-a6000linux2 streams! 3 caveats

midagedev

2026-10-05

bloomery 0.2.1 · GLM-5.3 Flash UD-Q4_K_XL · RTX A6000 · 2 streams 34.0 tok/sprefill 48.6 tok/s

GLM-5.3-Flash-UD-Q4_K_XL-00001-of-00006.gguf

bloomery0.2.1 (b83f1269)q4_KP38 · G626 · cache 0% · min 547ctx 2koffload partialrtx-3090rtx-a6000linux2 streams! 4 caveats

midagedev

2026-10-05

bloomery 0.2.1 · DeepSeek V4.1 Flash Q3_K_M · RTX A6000 · 2 streams 51.3 tok/sprefill 71.9 tok/s

DeepSeek-V4.1-Flash-Q3_K_M-00001-of-00009.gguf

bloomery0.2.1 (b83f1269)q3_KP28 · G400 · cache 0%ctx 32koffload partialrtx-3090rtx-a6000linux2 streams! 1 caveat

midagedev

2026-10-05

Page views are counted with Cloudflare Web Analytics: no cookies, no fingerprinting. The toktape binary itself sends nothing anywhere.