Update tokenizer_config.json

#1
by mkhadkevich - opened

update tokenizer class to make it compatible with SGLang

MMaghoumi changed pull request status to merged

Sign up or log in to comment