mimba
/

test

Model card Files Files and versions

test / tokenizer_config.json

mimba's picture

Update tokenizer_config.json

37c5530 verified 5 days ago

history blame contribute delete

164 Bytes

	{
	"tokenizer_class": "PreTrainedTokenizerFast",
	"model_max_length": 1000,
	"pad_token": " ",
	"pad_token_id": 0,
	"unk_token": "�",
	"unk_token_id": 121
	}