gpt-neox-tokenizer-digits / tokenizer_config.json
pavanyellow's picture
Upload 3 files
9650052 verified
{
"tokenizer_class": "PreTrainedTokenizerFast"
}