Sync with official tokenizer_config.json
#3
by so-anyway - opened
Hi,
The official tokenizer_config.json got updated and I was wondering if you could update it here too?
It has some fixes in it. Thank you.
Wow, thank you for your support!
Orion-zhen changed pull request status to merged