0:00 / 0:00
bloomery 0.3.4 · Nemotron 3.5 Bolt 74B-A9B · RTX 3090 alone · 5.7K-token prompt
NVIDIA-Nemotron-3.5-Bolt-74B-A9B-24GB.gguf · 86.3 tok/s decode · 1 stream · iq2_xxs
decode
86.3tok/s
prefill
1981tok/s
ttft p50
2880ms
| model | NVIDIA-Nemotron-3.5-Bolt-74B-A9B-24GB.gguf |
| quantisation | iq2_xxs · 2.06 bit |
| size | 22.0 GB · MoE 496/9 |
| engine | bloomery 0.3.4 (85dd39c2f7f1) |
| host | linux |
| gpus | NVIDIA GeForce RTX 3090 / NVIDIA RTX A6000 |
| memory | ? |
| streams | 1 |
| workload | 5680 in / 361 out · cache 0% |
| context | 16384 window · 1 slot |
| config | offload full |
| machine | 270 of 550 W |
| prompt set | not in a comparison set |
| recorded | 2026-10-17T22:10:48Z |
| toktape | v0.6.0 |
Details
The transcript, the card as text, and why each caveat fired — read out of the record in your browser, the same way Replay draws it.
Page views are counted with Cloudflare Web Analytics: no cookies, no fingerprinting. The toktape binary itself sends nothing anywhere.
