toktapethe record, not a recording of it

NVIDIA RTX A6000

32 runs, newest first · showing the first 30

GLM-5.3-Flash-UD-Q4_K_XL-00001-of-00006.gguf 28.9 tok/sprefill 169 tok/s

bloomery0.2.10 (8e55b8ce)q4_KP2067 · G149 · cache 33% · min 79ctx 16koffload partialrtx-a6000linux1 stream! 2 caveats

midagedev

2026-10-11

GLM-5.3-Flash-UD-Q4_K_XL-00001-of-00006.gguf 27.9 tok/sprefill 139 tok/s

bloomery0.3.0 (8d937828)q4_KP2067 · G159 · cache 50% · min 84ctx 16koffload partialrtx-a6000linux1 stream! 3 caveats

midagedev

2026-10-11

Qwen3.8-Flash-Next-UD-Q4_K_XL-00001-of-00004.gguf 81.9 tok/sprefill 128 tok/s

bloomery0.2.10 (8e55b8ce)q4_KP33 · G400 · cache 0%ctx 8koffload partialrtx-3090rtx-a6000linux2 streams! 2 caveats

midagedev

2026-10-10

Qwen3.8-Flash-Next-UD-Q4_K_XL-00001-of-00004.gguf 88.9 tok/sprefill 111 tok/s

bloomery0.2.10 (8e55b8ce)q4_KP33 · G400 · cache 0%ctx 8koffload partialrtx-3090rtx-a6000linux2 streams! 2 caveats

midagedev

2026-10-10

Qwen3.8-Flash-Next-UD-Q4_K_XL-00001-of-00004.gguf 93.8 tok/sprefill 281 tok/s

bloomery0.2.10 (8e55b8ce)q4_KP33 · G400 · cache 0%ctx 16koffload partialrtx-3090rtx-a6000linux1 stream! 1 caveat

midagedev

2026-10-10

Qwen3.8-Flash-Next-UD-Q4_K_XL-00001-of-00004.gguf 97.6 tok/sprefill 314 tok/s

bloomery0.2.10 (8e55b8ce)q4_KP33 · G400 · cache 0%ctx 16koffload partialrtx-3090rtx-a6000linux1 stream! 1 caveat

midagedev

2026-10-10

Qwen3.8-Flash-Next-UD-Q4_K_XL-00001-of-00004.gguf 103 tok/sprefill 1312 tok/s

bloomery0.2.10 (8e55b8ce)q4_KP538 · G1500 · cache 0%ctx 16koffload partialrtx-3090rtx-a6000linux1 stream

midagedev

2026-10-10

Qwen3.8-Flash-Next-UD-Q4_K_XL-00001-of-00004.gguf 77.9 tok/sprefill 1698 tok/s

bloomery0.2.10 (8e55b8ce)q4_KP5673 · G387 · cache 0%ctx 16koffload partialrtx-3090rtx-a6000linux1 stream

midagedev

2026-10-10

Qwen3.8-Flash-Next-UD-Q4_K_XL-00001-of-00004.gguf 90.8 tok/sprefill 229 tok/s

bloomery0.2.10 (8e55b8ce)q4_KP33 · G400 · cache 0%ctx 16koffload partialrtx-3090rtx-a6000linux1 stream! 1 caveat

midagedev

2026-10-10

Qwen3.8-Flash-Next-UD-Q4_K_XL-00001-of-00004.gguf 94.1 tok/sprefill 1001 tok/s

bloomery0.2.10 (8e55b8ce)q4_KP538 · G1500 · cache 0%ctx 16koffload partialrtx-3090rtx-a6000linux1 stream

midagedev

2026-10-10

Qwen3.8-Flash-Next-UD-Q4_K_XL-00001-of-00004.gguf 70.9 tok/sprefill 1577 tok/s

bloomery0.2.10 (8e55b8ce)q4_KP5673 · G469 · cache 0%ctx 16koffload partialrtx-3090rtx-a6000linux1 stream

midagedev

2026-10-10

bloomery 0.2.6 · Qwen3.8 Flash UD-Q4_K_XL · A6000 + 3090 · 3.8K-token prompt, MTP 83.8 tok/sprefill 1450 tok/s

Qwen3.8-Flash-Next-UD-Q4_K_XL-00001-of-00004.gguf

bloomery0.2.6 (39b13149)q4_KP3847 · G425 · cache 0%ctx 8koffload partialrtx-3090rtx-a6000linux1 stream

midagedev

2026-10-07

One RTX 3090 · bloomery 0.2.1 · Qwen3.8 Flash Next UD-Q4_K_XL 111 GB · code review, 1500 tokens 71.9 tok/sprefill 461 tok/s

Qwen3.8-Flash-Next-UD-Q4_K_XL-00001-of-00004.gguf

bloomery0.2.1 (b83f1269)q4_KP538 · G1500 · cache 0%ctx 38koffload partialrtx-3090rtx-a6000linux1 stream! 1 caveat

midagedev

2026-10-06

One RTX 3090 · bloomery 0.2.1 · Qwen3.8 Flash Next UD-Q4_K_XL 111 GB · Korean chat 57.3 tok/sprefill 172 tok/s

Qwen3.8-Flash-Next-UD-Q4_K_XL-00001-of-00004.gguf

bloomery0.2.1 (b83f1269)q4_KP33 · G400 · cache 0%ctx 38koffload partialrtx-3090rtx-a6000linux1 stream! 2 caveats

midagedev

2026-10-06

One RTX 3090 · bloomery 0.2.1 · Qwen3.8 Flash Next UD-Q4_K_XL 111 GB · Rust chat 66.5 tok/sprefill 166 tok/s

Qwen3.8-Flash-Next-UD-Q4_K_XL-00001-of-00004.gguf

bloomery0.2.1 (b83f1269)q4_KP33 · G400 · cache 0%ctx 38koffload partialrtx-3090rtx-a6000linux1 stream! 1 caveat

midagedev

2026-10-06

bloomery 0.2.1 · Qwen3.8 Flash Next UD-Q4_K_XL · RTX A6000 · 2 streams 91.3 tok/sprefill 117 tok/s

Qwen3.8-Flash-Next-UD-Q4_K_XL-00001-of-00004.gguf

bloomery0.2.1 (b83f1269)q4_KP33 · G400 · cache 0%ctx 24064offload partialrtx-3090rtx-a6000linux2 streams! 3 caveats

midagedev

2026-10-05

bloomery 0.2.1 · Qwen3.8 Flash Next UD-Q4_K_XL · RTX A6000 · code review, 1500 tokens 91.1 tok/sprefill 732 tok/s

Qwen3.8-Flash-Next-UD-Q4_K_XL-00001-of-00004.gguf

bloomery0.2.1 (b83f1269)q4_KP538 · G1500 · cache 0%ctx 24064offload partialrtx-3090rtx-a6000linux1 stream! 1 caveat

midagedev

2026-10-05

bloomery 0.2.1 · Qwen3.8 Flash Next UD-Q4_K_XL · RTX A6000 · Korean chat 69.3 tok/sprefill 215 tok/s

Qwen3.8-Flash-Next-UD-Q4_K_XL-00001-of-00004.gguf

bloomery0.2.1 (b83f1269)q4_KP33 · G400 · cache 0%ctx 24064offload partialrtx-3090rtx-a6000linux1 stream! 1 caveat

midagedev

2026-10-05

bloomery 0.2.1 · Qwen3.8 Flash Next UD-Q4_K_XL · RTX A6000 · Rust chat 80.5 tok/sprefill 216 tok/s

Qwen3.8-Flash-Next-UD-Q4_K_XL-00001-of-00004.gguf

bloomery0.2.1 (b83f1269)q4_KP33 · G400 · cache 0%ctx 24064offload partialrtx-3090rtx-a6000linux1 stream! 1 caveat

midagedev

2026-10-05

bloomery 0.2.1 · GLM-5.3 Flash UD-Q4_K_XL · A6000 + 3090 (--place bp) · code review, 2000 tokens 32.4 tok/sprefill 222 tok/s

GLM-5.3-Flash-UD-Q4_K_XL-00001-of-00006.gguf

bloomery0.2.1 (b83f1269)q4_KP497 · G1003 · cache 0%ctx 2koffload partialrtx-3090rtx-a6000linux1 stream! 2 caveats

midagedev

2026-10-05

bloomery 0.2.1 · GLM-5.3 Flash UD-Q4_K_XL · RTX A6000 · 2 streams 34.0 tok/sprefill 48.6 tok/s

GLM-5.3-Flash-UD-Q4_K_XL-00001-of-00006.gguf

bloomery0.2.1 (b83f1269)q4_KP38 · G626 · cache 0% · min 547ctx 2koffload partialrtx-3090rtx-a6000linux2 streams! 4 caveats

midagedev

2026-10-05

bloomery 0.2.1 · GLM-5.3 Flash UD-Q4_K_XL · RTX A6000 · code review, 2000 tokens 30.5 tok/sprefill 199 tok/s

GLM-5.3-Flash-UD-Q4_K_XL-00001-of-00006.gguf

bloomery0.2.1 (b83f1269)q4_KP497 · G1003 · cache 0%ctx 2koffload partialrtx-3090rtx-a6000linux1 stream! 2 caveats

midagedev

2026-10-05

bloomery 0.2.1 · GLM-5.3 Flash UD-Q4_K_XL · RTX A6000 · Korean chat 31.4 tok/sprefill 76.8 tok/s

GLM-5.3-Flash-UD-Q4_K_XL-00001-of-00006.gguf

bloomery0.2.1 (b83f1269)q4_KP42 · G749 · cache 0%ctx 2koffload partialrtx-3090rtx-a6000linux1 stream! 3 caveats

midagedev

2026-10-05

bloomery 0.2.1 · GLM-5.3 Flash UD-Q4_K_XL · RTX A6000 · Rust chat 30.5 tok/sprefill 62.7 tok/s

GLM-5.3-Flash-UD-Q4_K_XL-00001-of-00006.gguf

bloomery0.2.1 (b83f1269)q4_KP33 · G564 · cache 0%ctx 2koffload partialrtx-3090rtx-a6000linux1 stream! 2 caveats

midagedev

2026-10-05

bloomery · GLM-5.3-Flash UD-Q4_K_XL · RTX 3090 alone · Korean chat 42 in / 821 out · residency + NextN MTP draft 32.3 tok/sprefill 68.3 tok/s

GLM-5.3-Flash-UD-Q4_K_XL-00001-of-00006.gguf

bloomery0.1.0 (07ec8f04)q4_KP42 · G821 · cache 0%ctx 4koffload partialrtx-3090rtx-a6000linux1 stream! 3 caveats

midagedev

2026-10-02

bloomery · GLM-5.3-Flash UD-Q4_K_XL · RTX 3090 alone · Rust chat 33 in / 502 out · residency + NextN MTP draft 27.2 tok/sprefill 55.2 tok/s

GLM-5.3-Flash-UD-Q4_K_XL-00001-of-00006.gguf

bloomery0.1.0 (07ec8f04)q4_KP33 · G502 · cache 0%ctx 4koffload partialrtx-3090rtx-a6000linux1 stream! 2 caveats

midagedev

2026-10-02

bloomery · GLM-5.3-Flash UD-Q4_K_XL · RTX 3090 alone · coding review 497 in / 2000 out · residency + NextN MTP draft 26.2 tok/sprefill 176 tok/s

GLM-5.3-Flash-UD-Q4_K_XL-00001-of-00006.gguf

bloomery0.1.0 (07ec8f04)q4_KP497 · G2000 · cache 0%ctx 4koffload partialrtx-3090rtx-a6000linux1 stream

midagedev

2026-10-02

bloomery · GLM-5.3-Flash UD-Q4_K_XL · A6000 alone · Korean chat 42 in / 705 out · residency + NextN MTP draft 30.8 tok/sprefill 75.5 tok/s

GLM-5.3-Flash-UD-Q4_K_XL-00001-of-00006.gguf

bloomery0.1.0 (07ec8f04)q4_KP42 · G705 · cache 0%ctx 4koffload partialrtx-3090rtx-a6000linux1 stream! 3 caveats

midagedev

2026-10-02

bloomery · GLM-5.3-Flash UD-Q4_K_XL · A6000 alone · Rust chat 33 in / 524 out · residency + NextN MTP draft 32.0 tok/sprefill 58.7 tok/s

GLM-5.3-Flash-UD-Q4_K_XL-00001-of-00006.gguf

bloomery0.1.0 (07ec8f04)q4_KP33 · G524 · cache 0%ctx 4koffload partialrtx-3090rtx-a6000linux1 stream! 2 caveats

midagedev

2026-10-02

bloomery · GLM-5.3-Flash UD-Q4_K_XL · A6000 alone · coding review 497 in / 2000 out · residency + NextN MTP draft 31.6 tok/sprefill 195 tok/s

GLM-5.3-Flash-UD-Q4_K_XL-00001-of-00006.gguf

bloomery0.1.0 (07ec8f04)q4_KP497 · G2000 · cache 0%ctx 4koffload partialrtx-3090rtx-a6000linux1 stream! 1 caveat

midagedev

2026-10-02

Older runs →

Page views are counted with Cloudflare Web Analytics: no cookies, no fingerprinting. The toktape binary itself sends nothing anywhere.