--- title: Jina v5 Omni WebGPU emoji: "\U0001F3B5" colorFrom: indigo colorTo: blue sdk: static pinned: false license: cc-by-nc-4.0 short_description: Cross-modal search on WebGPU with jina-embeddings-v5-omni models: - jinaai/jina-embeddings-v5-omni-nano - onnx-community/jina-embeddings-v5-omni-nano-ONNX tags: - multimodal - cross-modal-retrieval - webgpu - transformers.js - onnx - jina-embeddings --- # jina · omni · webgpu In-browser cross-modal search powered by [`jinaai/jina-embeddings-v5-omni-nano`](https://huggingface.co/jinaai/jina-embeddings-v5-omni-nano) running entirely on WebGPU via [transformers.js](https://huggingface.co/docs/transformers.js) v4 + ONNX Runtime Web. One vector space for **text, images, audio, and (eventually) video** — a text query ranks image/audio corpus items and vice-versa without re-indexing. ## What's inside - **Model load gate** with a precision selector (`q4f16` default — 2.14 GB, or `fp16` for cleaner numerics at 2.68 GB). All three task-specific ONNX graphs (text / vision / audio) download in parallel with per-bundle progress bars; cached in your browser for subsequent loads. - **Curated query chips** to demo cross-modal retrieval against the seeded corpus. - **Result cards** render the actual asset — image thumbnails inline, audio with a ▶/❚❚ inline play toggle. When audio rarely cracks top-K (v5-omni's text→audio alignment is weaker than text→image), the closest audio match is appended after the top-K with an explainer. - **Corpus editor** — clear the seeded 25-item corpus and add your own text / image / audio. Embedding runs in-browser via the same ONNX session the query uses. ## Assets + attribution The seeded corpus mixes 12 text snippets, 10 instrument photos, and 3 audio clips — all images and audio are sourced from [Wikimedia Commons](https://commons.wikimedia.org/) with full inline artist + license + source attribution. Model license is **CC BY-NC 4.0** (inherited from the base model — non-commercial use only; contact `sales@jina.ai` for commercial). ## Links - Base model: [jinaai/jina-embeddings-v5-omni-nano](https://huggingface.co/jinaai/jina-embeddings-v5-omni-nano) - Blog: [Jina embeddings v5 omni](https://jina.ai/news/jina-embeddings-v5-omni-multimodal-embeddings-for-text-image-audio-and-video/) - ONNX weights: [onnx-community/jina-embeddings-v5-omni-nano-ONNX](https://huggingface.co/onnx-community/jina-embeddings-v5-omni-nano-ONNX)