Qwen3.8-Flash-Next-UD-Q4_K_XL-00001-of-00004.gguf

88.9 tok/s decode · 2 streams · q4_K

midagedev

decode

88.9tok/s

prefill

111tok/s

ttft p50

270ms

model	Qwen3.8-Flash-Next-UD-Q4_K_XL-00001-of-00004.gguf
quantisation	q4_K · 4.5 bit
size	111.3 GB · MoE 512/10
engine	bloomery 0.2.10 (8e55b8ce)
host	linux
gpus	NVIDIA GeForce RTX 3090 / NVIDIA RTX A6000
streams	2
workload	33 in / 400 out · cache 0% · per stream
context	8192 window · 2 slots
config	offload partial
draft	mtp-Qwen3.8-Flash-Next-shared-Q8_0.gguf · 57% accepted
machine	322.8 of 550 W
prompt set	not in a comparison set
recorded	2026-10-10T15:02:32Z
toktape	v0.6.0

Details

The transcript, the card as text, and why each caveat fired — read out of the record in your browser, the same way Replay draws it.

! 2 caveats — ragged_aggregate, short_prompt_for_prefill. The card that comes with this record spells each one out.

Download the record · 21.8 KB · published 2026-10-10 15:09 UTC
The record is the original: everything on this page was derived from it before it was uploaded, Replay draws it again in your browser with the same renderer the terminal uses, and toktape card gp67dtku5qqyxzfece5h.toktape draws the card from the same file.
Your own: toktape record against a running llama-server, then toktape publish. No flags to learn.

Page views are counted with Cloudflare Web Analytics: no cookies, no fingerprinting. The toktape binary itself sends nothing anywhere.