PraneetNS
/

indic-tokenizer-v2

Model card Files Files and versions

indic-tokenizer-v2

4.35 MB

Ctrl+K

Ctrl+K

1 contributor

History: 4 commits

PraneetNS's picture

Upload tokenizer_config.json with huggingface_hub

ddf010a verified 4 days ago

.gitattributes

1.52 kB
initial commit 4 days ago
indic_tokenizer_v2.model

2.26 MB
xet

Upload indic_tokenizer_v2.model with huggingface_hub 4 days ago
indic_tokenizer_v2.vocab

2.08 MB
Upload indic_tokenizer_v2.vocab with huggingface_hub 4 days ago
tokenizer_config.json

116 Bytes
Upload tokenizer_config.json with huggingface_hub 4 days ago