toktapethe record, not a recording of it

NVIDIA RTX A6000

5 runs, newest first

bloomery 0.3.9 candidate · Muse Spark Open 816B-A42B UD-IQ2_XXS · RTX A6000 + RTX 3090 · bp (unset pick) 14.2 tok/sprefill 94.4 tok/s

muse-spark-open-816b-a42b

bloomery0.3.8 (37e06f5f)iq2_xxsP5554 · G600 · cache 0%ctx 16koffload partialrtx-3090rtx-a6000linux1 stream! 1 caveat

midagedev

2026-10-24

bloomery 0.3.4 (release head 9723698f2) · Nemotron 3.5 Bolt 74B-A9B · RTX A6000 · serving defaults, 5.7K-token prompt 87.4 tok/sprefill 2708 tok/s

NVIDIA-Nemotron-3.5-Bolt-74B-A9B-24GB.gguf

bloomery0.3.4 (9723698f239b)iq2_xxsP5680 · G361 · cache 0%ctx 16krtx-3090rtx-a6000linux1 stream! 1 caveat

midagedev

2026-10-17

bloomery 0.3.4 · Nemotron 3.5 Bolt 74B-A9B · RTX 3090 alone · 5.7K-token prompt 86.3 tok/sprefill 1981 tok/s

NVIDIA-Nemotron-3.5-Bolt-74B-A9B-24GB.gguf

bloomery0.3.4 (85dd39c2f7f1)iq2_xxsP5680 · G361 · cache 0%ctx 16krtx-3090rtx-a6000linux1 stream

midagedev

2026-10-17

bloomery 0.3.4 · Nemotron 3.5 Bolt 74B-A9B · RTX A6000 alone · 5.7K-token prompt 87.2 tok/sprefill 2692 tok/s

NVIDIA-Nemotron-3.5-Bolt-74B-A9B-24GB.gguf

bloomery0.3.4 (85dd39c2f7f1)iq2_xxsP5680 · G361 · cache 0%ctx 16krtx-3090rtx-a6000linux1 stream

midagedev

2026-10-17

NVIDIA-Nemotron-3.5-Bolt-74B-A9B-24GB.gguf 87.5 tok/sprefill 2716 tok/s

bloomery0.3.4 (85dd39c2f7f1)iq2_xxsP5680 · G361 · cache 0%ctx 16krtx-3090rtx-a6000linux1 stream

midagedev

2026-10-17

Page views are counted with Cloudflare Web Analytics: no cookies, no fingerprinting. The toktape binary itself sends nothing anywhere.