EmbeddingGemma 2 Q8_0 side seat on bloomery, RTX 5090
embeddinggemma-2-Q8_0.gguf · 4.6 ms p50 embedding · Q8_0 · rtx-5090
bloomery ab6b23c88db4c9307f5380b4b158c27c1e2d6f5c, EmbeddingGemma 2 Q8_0 with its BF16 image projector seated beside Qwen3.6-35B-A3B Q4_K_M. The same built-in 20 Korean/English documents, six queries, and task prefixes as ks3i97nukkma5s95gedh, checked byte for byte. Requests use POST /embedding, the llama API. Warm-up requests were discarded. Recorded again with toktape aa1a917c; the MODEL field names embeddinggemma-2-Q8_0.gguf. Different cards and engines are shown in separate tapes; this is not an interleaved speed comparison.
| model | embeddinggemma-2-Q8_0.gguf |
| quantisation | Q8_0 · 8.5 bit |
| size | ? |
| engine | bloomery 0.3.2 (ab6b23c88db4c9307f5380b4b158c27c1e2d6f5c) |
| host | linux · 1x rtx-5090 |
| gpus | NVIDIA GeForce RTX 5090 |
| memory | GPU0 22.7/31.8 GiB · host RSS 0.8 GiB (file 0.3 / anon 0.4) |
| mode | embedding model · POST /v1/embeddings or /embedding |
| workload | ? |
| context | ? |
| config | ? |
| machine | 54.3 of 400 W |
| prompt set | not in a comparison set |
| recorded | 2026-10-15T06:43:20Z |
| toktape | dev |
Details
The transcript, the card as text, and why each caveat fired — read out of the record in your browser, the same way Replay draws it.
Page views are counted with Cloudflare Web Analytics: no cookies, no fingerprinting. The toktape binary itself sends nothing anywhere.
