raw_wiki.bm / tokenization.model
kushaltatariya's picture
Upload tokenizer
9568229 verified
This file is stored with Xet . It is too big to display, but you can still download it.

Xet Pointer Details

( Raw pointer file )
Xet hash:
600f6f20010b9d336194da74e3e3ff1a8dcaf7283efae7ad7f19e7c164b37d90
Size of remote file:
249 kB
·
SHA256:
15975b2899cbf0b89277a4336370b5f95bed643f45239f7b829338b07f5324b2

Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.