opencoder484 / tokenizer.json
tyzhu's picture
Add tokenizer.json for fast tokenizer support
4170d04 verified
This file is stored with Xet . It is too big to display, but you can still download it.

Xet Pointer Details

( Raw pointer file )
Xet hash:
1a94b4b612eec41c45873f1c7b18370934bc9578b9c983d796ccc797e5519b98
Size of remote file:
11.1 MB
·
SHA256:
739d8e2f2e0876f8f27be817195e725e998ad3838abfc942dd46989995e47ba4

Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.