0:00 / 0:00
NVIDIA-Nemotron-3.5-Bolt-74B-A9B-24GB.gguf
87.5 tok/s decode · 1 stream · iq2_xxs
decode
87.5tok/s
prefill
2716tok/s
ttft p50
2104ms
| model | NVIDIA-Nemotron-3.5-Bolt-74B-A9B-24GB.gguf |
| quantisation | iq2_xxs · 2.06 bit |
| size | 22.0 GB · MoE 496/9 |
| engine | bloomery 0.3.4 (85dd39c2f7f1) |
| host | linux |
| gpus | NVIDIA GeForce RTX 3090 / NVIDIA RTX A6000 |
| memory | ? |
| streams | 1 |
| workload | 5680 in / 361 out · cache 0% |
| context | 16384 window · 1 slot |
| config | offload full |
| machine | 329.8 of 550 W |
| prompt set | not in a comparison set |
| recorded | 2026-10-17T14:18:55Z |
| toktape | v0.6.0 |
Details
The transcript, the card as text, and why each caveat fired — read out of the record in your browser, the same way Replay draws it.
Page views are counted with Cloudflare Web Analytics: no cookies, no fingerprinting. The toktape binary itself sends nothing anywhere.
