Can you upload also the tokenizer.json?
#11
by nmaroulis - opened
I notice that there is no tokenizer.json and the framework i am using it needs it to load the model (Elixir#bumblebee).
Is anyway possible to generate it or uploaded?
seconded
I was unable to convert the model correctly without the tokenizer, the output contained tokens like etc. would be nice to have the proper tokenizer
I don't know how I would create that
teknium changed discussion status to closed