df-arc / tokenizer.json

vocab_size Increased from 64000 to 128000

34fc84b verified 2 months ago

8.86 MB

This file is stored with Xet . It is too big to display, but you can still download it.

Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.