Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Buckets new
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up
flexitok 's Collections
llama_and_16k
16k_v2
8k_v2
32000-vocab-v2
16000-vocab-v2
8000-vocab-v2
1000-vocab-v2
4000-vocab-v2
fineweb2-hq-tokenizers-v2
4000-vocab
16000-vocab
fineweb2-hq-tokenizers-feat2
flexitok-mod-tokenizers-zero-padded
flexitok/mod-tokenizers
flexitok/fineweb2-hq-superset-tokenizers
Fineweb2-HQ-Tokenizers
merging-toksuite
baselines

flexitok-mod-tokenizers-zero-padded

updated Mar 3
Upvote
-

  • flexitok/supertokenizer-mod_tokenizers_zero_padded

    Updated Mar 3

  • flexitok/mod-tokenizers-zero-padded-individual

    Updated Mar 3

  • flexitok/mod-tokenizers-zero-padded-ltr_3digit

    3.97M • Updated Mar 4 • 1

  • flexitok/mod-tokenizers-zero-padded-ltr_2digit

    3.46M • Updated Mar 4

  • flexitok/mod-tokenizers-zero-padded-ltr_4digit

    9.05M • Updated Mar 4 • 1

  • flexitok/mod-tokenizers-zero-padded-ltr_5digit

    59.7M • Updated Mar 4 • 1

  • flexitok/mod-tokenizers-zero-padded-rtl_2digit

    3.46M • Updated Mar 4 • 5

  • flexitok/mod-tokenizers-zero-padded-rtl_3digit

    3.97M • Updated Mar 4

  • flexitok/mod-tokenizers-zero-padded-rtl_4digit

    9.05M • Updated Mar 4 • 1

  • flexitok/mod-tokenizers-zero-padded-rtl_5digit

    59.7M • Updated Mar 4 • 6
Upvote
-
  • Collection guide
  • Browse collections
Company
TOS Privacy About Careers
Website
Models Datasets Spaces Pricing Docs