sproos
/

parameter-golf-tokenizers

Model card Files Files and versions

parameter-golf-tokenizers / tokenizers /fineweb_2048_bpe.model

sproos's picture

Upload folder using huggingface_hub

c5f9e16 verified about 1 month ago

history blame contribute delete

269 kB

This file is stored with Xet . It is too big to display, but you can still download it.

Xet Pointer Details

( Raw pointer file )

Xet hash:: b349192bf0f656049d0ea2c8c3acfa5c40ccfb76e947bcad9de13788d28a0350
Size of remote file:: 269 kB
SHA256:: ba9892fc3502b8c5f649e838bbf825cd1b929a092c010854c8784351151d2745

Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.