bloomery 0.3.4 (release head 9723698f2) · Nemotron 3.5 Bolt 74B-A9B · RTX A6000 · serving defaults, 5.7K-token prompt

NVIDIA-Nemotron-3.5-Bolt-74B-A9B-24GB.gguf · 87.4 tok/s decode · 1 stream · iq2_xxs

midagedev

decode

87.4tok/s

prefill

2708tok/s

ttft p50

2110ms

model	NVIDIA-Nemotron-3.5-Bolt-74B-A9B-24GB.gguf
quantisation	iq2_xxs · 2.06 bit
size	22.0 GB · MoE 496/9
engine	bloomery 0.3.4 (9723698f239b)
host	linux
gpus	NVIDIA GeForce RTX 3090 / NVIDIA RTX A6000
memory	?
streams	1
workload	5680 in / 361 out · cache 0%
context	16384 window · 1 slot
config	offload full
machine	329.2 of 550 W
prompt set	not in a comparison set
recorded	2026-10-17T22:48:51Z
toktape	v0.6.0

Details

The transcript, the card as text, and why each caveat fired — read out of the record in your browser, the same way Replay draws it.

! 1 caveat — machine_contended. The card that comes with this record spells each one out.

Download the record · 23.3 KB · published 2026-10-17 22:54 UTC
The record is the original: everything on this page was derived from it before it was uploaded, Replay draws it again in your browser with the same renderer the terminal uses, and toktape card d34555nktajc3duqkmab.toktape draws the card from the same file.
Your own: toktape record against a running llama-server, then toktape publish. No flags to learn.

Page views are counted with Cloudflare Web Analytics: no cookies, no fingerprinting. The toktape binary itself sends nothing anywhere.