DeepSeek-V4.1-Flash Q3_K_M · 1 stream · 347 GB model on 72 GB of VRAM
23.8 tok/sprefill 52.3 tok/s
DeepSeek-V4.1-Flash-Q3_K_M-00001-of-00009.gguf
llama-serverb102Q3_K_M748B · 18B activeP6509 · G66 · cache 0%ctx 8koffload partialrtx-3090rtx-a6000linux1 stream! 4 caveats
2026-09-20
