EmbeddingGemma 2 Q8_0 side seat on bloomery, RTX 5090
qwen3.6-35b-a3b · 4.4 ms p50 embedding · Q4_K_M · rtx-5090
bloomery ab6b23c88db4c9307f5380b4b158c27c1e2d6f5c, EmbeddingGemma 2 Q8_0 with its BF16 image projector seated beside Qwen3.6-35B-A3B Q4_K_M. The same built-in 20 Korean/English documents, six queries, and task prefixes as ks3i97nukkma5s95gedh, checked byte for byte. Requests use POST /embedding, the llama API. Warm-up requests were discarded. The generic MODEL field names the co-hosted chat model; the embedding model field and all returned vectors belong to the EmbeddingGemma 2 side seat. Different cards and engines are shown in separate tapes; this is not an interleaved speed comparison.
| model | Qwen3.6-35B-A3B-Q4_K_M.gguf |
| model id | qwen3.6-35b-a3b (from the filename) |
| quantisation | Q4_K_M |
| size | ? |
| engine | bloomery 0.3.2 (ab6b23c88db4c9307f5380b4b158c27c1e2d6f5c) |
| host | linux · 1x rtx-5090 |
| gpus | NVIDIA GeForce RTX 5090 |
| memory | GPU0 22.7/31.8 GiB · host RSS 1.1 GiB (file 0.3 / anon 0.7) |
| mode | embedding model · POST /v1/embeddings or /embedding |
| workload | ? |
| context | ? |
| config | ? |
| machine | 55.7 of 400 W |
| prompt set | not in a comparison set |
| recorded | 2026-10-15T05:47:04Z |
| toktape | dev |
Details
The transcript, the card as text, and why each caveat fired — read out of the record in your browser, the same way Replay draws it.
Page views are counted with Cloudflare Web Analytics: no cookies, no fingerprinting. The toktape binary itself sends nothing anywhere.
