AksaraLLM
/

aksara-tokenizer-v4

Model card Files Files and versions

aksara-tokenizer-v4 / special_tokens_map.json

Ezekiel999's picture

Upload folder using huggingface_hub

000237b verified about 1 month ago

history blame contribute delete

98 Bytes

	{
	"bos_token": "[BOS]",
	"eos_token": "[EOS]",
	"pad_token": "[PAD]",
	"unk_token": "[UNK]"
	}