Hugging Face's logo

tsuberim
/
merlin-tokenizer-v0

Merlin
tokenizer
Model card Files
xet
 Community
merlin-tokenizer-v0
  • 1 contributor
 History: 5 commits
tsuberim's picture
tsuberim
v0: tokenizer trained on pretraining corpus
7aea5a3 verified