Hugging Face's logo

sanjeevnv
/
multimodal-tokenizer

Transformers
Model card Files
xet
 Community
multimodal-tokenizer
17.3 MB
  • 2 contributors
 History: 4 commits
openhands
Set pad_token=<|im_end|> (id=11), eos_token_id=11, unk_token_id=0
5b5d351