toktapethe record, not a recording of it

NVIDIA GeForce RTX 5090

8 runs, newest first

bloomery 0.3.1 e659f4fe, Qwen3.8 UD-Q4_K_XL, 48 GiB MemoryMax, BLOOMERY_RESIDENCY=off (arm D) 41.2 tok/sprefill 124 tok/s

Qwen3.8-Flash-Next-UD-Q4_K_XL-00001-of-00004.gguf

bloomery0.3.1 (e659f4feb1b4)q4_KP33 · G256 · cache 0%ctx 4koffload partialrtx-5090linux1 stream! 1 caveat

juliankang4 anonymous

2026-10-12

bloomery 0.3.1 e659f4fe, Qwen3.8 UD-Q4_K_XL, 48 GiB MemoryMax, residency unset (arm C) 97.4 tok/sprefill 143 tok/s

Qwen3.8-Flash-Next-UD-Q4_K_XL-00001-of-00004.gguf

bloomery0.3.1 (e659f4feb1b4)q4_KP33 · G256 · cache 0%ctx 4koffload partialrtx-5090linux1 stream! 3 caveats

juliankang4 anonymous

2026-10-12

bloomery 0.3.1 e659f4fe, Qwen3.8 UD-Q4_K_XL, no memory limit, BLOOMERY_RESIDENCY=off (arm B) 41.4 tok/sprefill 127 tok/s

Qwen3.8-Flash-Next-UD-Q4_K_XL-00001-of-00004.gguf

bloomery0.3.1 (e659f4feb1b4)q4_KP33 · G256 · cache 0%ctx 4koffload partialrtx-5090linux1 stream! 1 caveat

juliankang4 anonymous

2026-10-12

bloomery 0.3.1 e659f4fe, Qwen3.8 UD-Q4_K_XL, no memory limit, residency unset (arm A) 52.3 tok/sprefill 117 tok/s

Qwen3.8-Flash-Next-UD-Q4_K_XL-00001-of-00004.gguf

bloomery0.3.1 (e659f4feb1b4)q4_KP33 · G256 · cache 0%ctx 4koffload partialrtx-5090linux1 stream! 2 caveats

juliankang4 anonymous

2026-10-12

Qwen3.8-Flash-Next-UD-Q4_K_XL-00001-of-00004.gguf 54.0 tok/sprefill 449 tok/s

bloomery0.3.0 (8d937828)q4_KP3903 · G256 · cache 0%ctx 7680offload partialrtx-5090linux1 stream

anonymous

2026-10-12

Qwen3.8-Flash-Next-UD-Q4_K_XL-00001-of-00004.gguf 46.5 tok/sprefill 124 tok/s

bloomery0.3.0 (8d937828)q4_KP32 · G256 · cache 0%ctx 7680offload partialrtx-5090linux1 stream! 1 caveat

anonymous

2026-10-12

qwen3.6-35b-a3b 346 tok/sprefill 14952 tok/s

bloomery0.3.0 (8d937828)P4028 · G256 · cache 0%ctx 222krtx-5090linux1 stream

anonymous

2026-10-12

qwen3.6-35b-a3b 356 tok/sprefill 1662 tok/s

bloomery0.3.0 (8d937828)P32 · G256 · cache 0%ctx 222krtx-5090linux1 stream! 1 caveat

anonymous

2026-10-12

Page views are counted with Cloudflare Web Analytics: no cookies, no fingerprinting. The toktape binary itself sends nothing anywhere.