minicpm-v-4-7-35b-a3b 59.2 tok/s bloomery0.3.2 (9bd7d5774c18)Q4_K_MP33 · G400 · cache 0%ctx 16krtx-3060linux1 stream! 1 caveat midagedev 2026-10-14
minicpm-v-4-7-35b-a3b 59.6 tok/sprefill 605 tok/s bloomery0.3.2 (9bd7d5774c18)Q4_K_MP5673 · G517 · cache 0%ctx 16krtx-3060linux1 stream midagedev 2026-10-14
Qwen3.8-Flash-Next on a 12 GB RTX 3060, short prompt (bloomery 0.3.1 release candidate) 5.4 tok/s Qwen3.8-Flash-Next-UD-Q4_K_XL-00001-of-00004.gguf bloomery0.3.1 (5ae948b013c9)q4_KP33 · G400 · cache 0%ctx 28881offload partialrtx-3060linux1 stream! 3 caveats midagedev 2026-10-12
Qwen3.8-Flash-Next on a 12 GB RTX 3060, long prompt (bloomery 0.3.1 release candidate) 4.5 tok/sprefill 84.9 tok/s Qwen3.8-Flash-Next-UD-Q4_K_XL-00001-of-00004.gguf bloomery0.3.1 (5ae948b013c9)q4_KP5673 · G505 · cache 0%ctx 28881offload partialrtx-3060linux1 stream! 2 caveats midagedev 2026-10-12