0:00 / 0:00
Offload ladder · 10 of 40 blocks' experts on CPU
qwen3.6-35b-a3b · 97.9 tok/s decode · 1 stream · UD-Q6_K
decode
97.9tok/s
prefill
1756tok/s
ttft p50
4309ms
| model | Qwen3.6-35B-A3B-UD-Q6_K.gguf |
| model id | qwen3.6-35b-a3b (from the gguf) |
| quantisation | UD-Q6_K · 6.56 bit |
| size | 35B params · 3.5B active · 29.3 GB · MoE 256/8 |
| engine | ik_llama.cpp |
| host | linux |
| gpus | NVIDIA GeForce RTX 3090 / NVIDIA RTX A6000 |
| streams | 1 |
| workload | 7246 in / 2048 out · 2048 thinking · cache 0% |
| context | 32768 window · 1 slot |
| config | fa on · b 2048 · ub 512 · ngl 99 · offload partial |
| machine | 362.9 of 720 W |
| prompt set | not in a comparison set |
| recorded | 2026-09-20T10:06:52Z |
| toktape | dev |
Details
The transcript, the card as text, and why each caveat fired — read out of the record in your browser, the same way Replay draws it.
! 1 caveat —
answer_cut. The card that comes with this record spells each one out.