Ezekiel999
/

aksara-tokenizer-20b

Model card Files Files and versions

aksara-tokenizer-20b / tokenizer.json

Ezekiel999's picture

Upload 131K BPE tokenizer (vocab=131072, fertility id=1.22 en=1.28)

01be583 verified 14 days ago

history contribute delete

9.54 MB

File too large to display, you can check the raw version instead.