mine-tokenizer / added_tokens.json
bpatel644's picture
Upload tokenizer
3c378a5
raw
history blame contribute delete
55 Bytes
{
"<|endoftext|>": 1001,
"<|startoftext|>": 1000
}