ONNX quantized model for transformerjs v4 support
#9
by aperez900907 - opened
Will quantized versions of models compatible with Transformer.js v4 be released?
i get this error:
Error: Could not locate file: "https://huggingface.co/jaganadhg/jina-v5-nano-onnx/resolve/main/onnx/model_quantized.onnx"
Thanks.
Hi, I haven't tried if it works with transformers.js v4 but our onnx version is at https://huggingface.co/jinaai/jina-embeddings-v5-text-nano-retrieval
The version that you linked was created by someone else that I don't know. If you want to use that one, I would create an issue there. I am also not sure which adapter (task-type) that one is based on.