0:00 / 0:00
Qwen2.5-7B-Instruct Q3_K_M · 4 streams · dense control
qwen2.5-7b-instruct · 134 tok/s decode · 4 streams · Q3_K_M
decode
134tok/s
prefill
4159tok/s
ttft p50
3169ms
| model | Qwen2.5-7B-Instruct-Q3_K_M.gguf |
| model id | qwen2.5-7b-instruct (from the gguf) |
| quantisation | Q3_K_M |
| size | 7.6B params · 3.8 GB |
| engine | ik_llama.cpp 7cd62a3e |
| host | linux |
| gpus | NVIDIA GeForce RTX 3090 / NVIDIA RTX A6000 |
| streams | 4 |
| workload | 5665 in / 934 out · min 703 · cache 0% · per stream |
| context | 8192 window · 4 slots |
| config | fa on · b 2048 · ub 512 · ngl 99 · offload full |
| machine | 516 of 720 W |
| prompt set | not in a comparison set |
| recorded | 2026-09-20T07:40:34Z |
| toktape | dev |
Details
The transcript, the card as text, and why each caveat fired — read out of the record in your browser, the same way Replay draws it.
! 4 caveats —
ragged_aggregate, recorded, conditions_changed, run_cut_by_clock. The card that comes with this record spells each one out.