Export script

#6
by ir2718 - opened

Hi,

I would like to ask you to publish the conversion script for this model.

@Xenova Why don't you commit your ONNX-exportable model definitions to the transformers repo so we can all export models to ONNX ?

Judging by the nodes inside the model, it looks like it has been exported using a combination of onnxruntime-genai and olive-recipes. Coincidentally, there are some relevant PRs currently going on:

onnxruntime-genai merged PR
olive-recipes open PR

To me, it looks like this is it, but they're probably postponing resolving this as the PRs are not finished yet. You can see Kunal Vaishnavi is one of the people assigned to these PRs, who is also a contributor for many onnx-community models. Besides, these models contain non-standard ONNX nodes so you can only run them using onnxruntime-genai.

Thanks for your reply. Didn't see it in time for me to give up on ONNX mostly.

Sign up or log in to comment