0:00 / 0:00
bloomery · Solar-Open2-250B · RTX 3090 · short chat
solar-open2-250b · 26.4 tok/s decode · 1 stream · q4_K
bloomery 0.3.6 release tarball, one RTX 3090 (250 W): 1,929 experts on the card, 129.2 GB on the host, ctx 8192, serving defaults.
decode
26.4tok/s
prefill
80.0tok/s
ttft p50
376ms
| model | Solar-Open2-250B-Q4_K_M-00001-of-00004.gguf |
| model id | solar-open2-250b (from the filename) |
| quantisation | q4_K · 4.5 bit |
| size | 151.8 GB · MoE 320/8 |
| engine | bloomery 0.3.6 (a0288c5c0715) |
| host | linux |
| gpus | NVIDIA GeForce RTX 3090 / NVIDIA RTX A6000 |
| memory | ? |
| streams | 1 |
| workload | 30 in / 400 out · 395 thinking · cache 0% |
| context | 8192 window · 1 slot |
| config | offload partial |
| machine | 217.8 of 550 W |
| prompt set | not in a comparison set |
| recorded | 2026-10-20T14:44:05Z |
| toktape | v0.6.0 |
Details
The transcript, the card as text, and why each caveat fired — read out of the record in your browser, the same way Replay draws it.
! 3 caveats —
short_prompt_for_prefill, thinking_ignored, conditions_changed. The card that comes with this record spells each one out.Page views are counted with Cloudflare Web Analytics: no cookies, no fingerprinting. The toktape binary itself sends nothing anywhere.
