Spaces:
Running
Running
| title: Jina v5 Omni WebGPU | |
| emoji: "\U0001F3B5" | |
| colorFrom: indigo | |
| colorTo: blue | |
| sdk: static | |
| pinned: false | |
| license: cc-by-nc-4.0 | |
| short_description: Cross-modal search on WebGPU with jina-embeddings-v5-omni | |
| models: | |
| - jinaai/jina-embeddings-v5-omni-nano | |
| - onnx-community/jina-embeddings-v5-omni-nano-ONNX | |
| tags: | |
| - multimodal | |
| - cross-modal-retrieval | |
| - webgpu | |
| - transformers.js | |
| - onnx | |
| - jina-embeddings | |
| # jina · omni · webgpu | |
| In-browser cross-modal search powered by [`jinaai/jina-embeddings-v5-omni-nano`](https://huggingface.co/jinaai/jina-embeddings-v5-omni-nano) running entirely on WebGPU via [transformers.js](https://huggingface.co/docs/transformers.js) v4 + ONNX Runtime Web. | |
| One vector space for **text, images, audio, and (eventually) video** — a text query ranks image/audio corpus items and vice-versa without re-indexing. | |
| ## What's inside | |
| - **Model load gate** with a precision selector (`q4f16` default — 2.14 GB, or `fp16` for cleaner numerics at 2.68 GB). All three task-specific ONNX graphs (text / vision / audio) download in parallel with per-bundle progress bars; cached in your browser for subsequent loads. | |
| - **Curated query chips** to demo cross-modal retrieval against the seeded corpus. | |
| - **Result cards** render the actual asset — image thumbnails inline, audio with a ▶/❚❚ inline play toggle. When audio rarely cracks top-K (v5-omni's text→audio alignment is weaker than text→image), the closest audio match is appended after the top-K with an explainer. | |
| - **Corpus editor** — clear the seeded 25-item corpus and add your own text / image / audio. Embedding runs in-browser via the same ONNX session the query uses. | |
| ## Assets + attribution | |
| The seeded corpus mixes 12 text snippets, 10 instrument photos, and 3 audio clips — all images and audio are sourced from [Wikimedia Commons](https://commons.wikimedia.org/) with full inline artist + license + source attribution. Model license is **CC BY-NC 4.0** (inherited from the base model — non-commercial use only; contact `sales@jina.ai` for commercial). | |
| ## Links | |
| - Base model: [jinaai/jina-embeddings-v5-omni-nano](https://huggingface.co/jinaai/jina-embeddings-v5-omni-nano) | |
| - Blog: [Jina embeddings v5 omni](https://jina.ai/news/jina-embeddings-v5-omni-multimodal-embeddings-for-text-image-audio-and-video/) | |
| - ONNX weights: [onnx-community/jina-embeddings-v5-omni-nano-ONNX](https://huggingface.co/onnx-community/jina-embeddings-v5-omni-nano-ONNX) | |