0:00 / 0:00
nvidia-nemotron3-nano-4b
156 tok/s decode · 1 stream · q5_0 · rtx-3090
decode
156tok/s
prefill
162tok/s
ttft p50
7640ms
| model | NVIDIA-Nemotron3-Nano-4B-Q4_K_M.gguf |
| model id | nvidia-nemotron3-nano-4b (from the filename) |
| quantisation | q5_0 · 5.5 bit |
| size | 2.8 GB |
| engine | bloomery 0.3.2 (ba35fde3) |
| host | linux · 1x rtx-3090 |
| gpus | NVIDIA GeForce RTX 3090 |
| memory | GPU0 8.7/24.0 GiB · GPU1 0.0/48.0 GiB · host RSS 0.3 GiB (file 0.1 / anon 0.2) |
| streams | 1 |
| workload | 1233 in / 3486 out · 1490 thinking · cache 0% |
| prefill | probe 163 tok/s on one stream · 10 ms fixed |
| context | 262144 window · 1 slot |
| config | offload full |
| machine | 269.3 of 550 W |
| prompt set | prompts@v2 |
| recorded | 2026-10-15T08:10:02Z |
| toktape | 0.7.4 |
Details
The transcript, the card as text, and why each caveat fired — read out of the record in your browser, the same way Replay draws it.
! 1 caveat —
run_cut_by_clock. The card that comes with this record spells each one out.Page views are counted with Cloudflare Web Analytics: no cookies, no fingerprinting. The toktape binary itself sends nothing anywhere.
