onnx output tensor for vector database
#1
by bhaskerraju - opened
hello,
the onnx model gives two output tensors.
which embedding should i store in vector DB?
bhaskerraju changed discussion status to closed
bhaskerraju changed discussion status to open
bhaskerraju changed discussion title from local / offline onnx usage example to onnx output tensor for vector database
Inputs: ['input_ids', 'token_type_ids', 'attention_mask']
Outputs: ['token_embeddings', 'sentence_embedding']
likely sentence_embedding unless you want each token embeddings