tiny-pellm / vocab.json
herutriana44's picture
Upload tokenizer
89fb929 verified
{
"<s>": 0,
"<sep>": 3,
"<unk>": 2,
"<pad>": 4,
"<cls>": 5,
"<mask>": 6,
"</s>": 1
}