0:00 / 0:00
Qwen2.5-7B-Instruct Q3_K_M · 4 streams · dense control
qwen2.5-7b-instruct · 134 tok/s decode · 4 streams · Q3_K_M
decode
134tok/s
prefill
4159tok/s
ttft p50
3169ms
| model | Qwen2.5-7B-Instruct-Q3_K_M.gguf |
| model id | qwen2.5-7b-instruct (from the gguf) |
| quantisation | Q3_K_M |
| size | 7.6B params · 3.8 GB |
| engine | ik_llama.cpp 7cd62a3e |
| host | linux |
| gpus | NVIDIA GeForce RTX 3090 / NVIDIA RTX A6000 |
| memory | GPU0 2.2/24.0 GiB · GPU1 4.2/48.0 GiB · host RSS 1.5 GiB (file 0.5 / anon 0.8) |
| streams | 4 |
| workload | 5665 in / 934 out · min 703 · cache 0% · per stream |
| context | 8192 window · 4 slots |
| config | fa on · b 2048 · ub 512 · ngl 99 · offload full |
| machine | 516 of 720 W |
| prompt set | not in a comparison set |
| recorded | 2026-09-20T07:40:34Z |
| toktape | dev |
Details
The transcript, the card as text, and why each caveat fired — read out of the record in your browser, the same way Replay draws it.
! 3 caveats —
ragged_aggregate, recorded, run_cut_by_clock. The card that comes with this record spells each one out.Page views are counted with Cloudflare Web Analytics: no cookies, no fingerprinting. The toktape binary itself sends nothing anywhere.
