shikhar-srivastava/mono_350m_pre_lr1e-3_fineweb_eng_bpe_unscaled_8192
0.3B • Updated • 3
Tokenizer Study (LLaMA 350M)
Correlating tokenizer properties of pre-trained LLMs with their downstream performance.
-
-
shikhar-srivastava/mono_350m_pre_lr1e-3_fineweb_eng_unigram_unscaled_8192
0.3B • Updated • 1 -
shikhar-srivastava/mono_350m_pre_lr1e-3_fineweb_eng_unigram_unscaled_65536
0.4B • Updated • 4 -
shikhar-srivastava/mono_350m_pre_lr1e-3_fineweb_eng_bpe_unscaled_65536
0.4B • Updated • 3 -
shikhar-srivastava/mono_350m_pre_lr1e-3_fineweb_eng_bpe_unscaled_32768
0.4B • Updated • 13 -
shikhar-srivastava/mono_350m_pre_lr1e-3_fineweb_eng_bpe_unscaled_98304
0.5B • Updated • 2 -
shikhar-srivastava/mono_350m_pre_lr1e-3_fineweb_eng_unigram_unscaled_32768
0.4B • Updated • 6 -
shikhar-srivastava/mono_350m_pre_lr1e-3_fineweb_eng_unigram_unscaled_98304
0.5B • Updated • 6 -
shikhar-srivastava/mono_350m_pre_lr1e-3_fineweb2_vie_bpe_unscaled_8192
0.3B • Updated • 4 -
shikhar-srivastava/mono_350m_pre_lr1e-3_fineweb2_amh_bpe_unscaled_8192
Updated -
shikhar-srivastava/mono_350m_pre_lr1e-3_fineweb2_tha_bpe_unscaled_98304
0.5B • Updated • 1 -
shikhar-srivastava/mono_350m_pre_lr1e-3_fineweb2_tha_bpe_unscaled_8192
0.3B • Updated • 7 -
shikhar-srivastava/mono_350m_pre_lr1e-3_fineweb2_tha_unigram_unscaled_98304
0.5B • Updated • 2 -
shikhar-srivastava/mono_350m_pre_lr1e-3_fineweb2_urd_bpe_unscaled_8192
0.3B • Updated • 2 -
shikhar-srivastava/mono_350m_pre_lr1e-3_fineweb2_vie_unigram_unscaled_8192
0.3B • Updated • 1 -
shikhar-srivastava/mono_350m_pre_lr1e-3_fineweb2_urd_unigram_unscaled_8192
0.3B • Updated • 5 -
shikhar-srivastava/mono_350m_pre_lr1e-3_fineweb2_urd_bpe_unscaled_98304
0.5B • Updated • 2 -
shikhar-srivastava/mono_350m_pre_lr1e-3_fineweb2_urd_unigram_unscaled_98304
0.5B • Updated • 3 -
shikhar-srivastava/mono_350m_pre_lr1e-3_fineweb2_vie_bpe_unscaled_98304
0.5B • Updated • 1 -
shikhar-srivastava/mono_350m_pre_lr1e-3_fineweb2_vie_unigram_unscaled_98304
0.5B • Updated • 2 -
shikhar-srivastava/mono_350m_pre_lr1e-3_fineweb2_tha_unigram_unscaled_8192
0.3B • Updated • 6 -
shikhar-srivastava/mono_350m_pre_lr1e-3_fineweb2_urd_unigram_unscaled_32768
0.4B • Updated • 2 -
shikhar-srivastava/mono_350m_pre_lr1e-3_fineweb2_urd_unigram_unscaled_65536
0.4B • Updated • 1 -
shikhar-srivastava/mono_350m_pre_lr1e-3_fineweb2_urd_bpe_unscaled_65536
0.4B • Updated • 3 -
shikhar-srivastava/mono_350m_pre_lr1e-3_fineweb2_urd_bpe_unscaled_32768
0.4B • Updated • 3 -
shikhar-srivastava/mono_350m_pre_lr1e-3_fineweb2_tha_bpe_unscaled_65536
0.4B • Updated • 8 -
shikhar-srivastava/mono_350m_pre_lr1e-3_fineweb2_vie_unigram_unscaled_65536
0.4B • Updated • 6 -
shikhar-srivastava/mono_350m_pre_lr1e-3_fineweb2_tha_bpe_unscaled_32768
0.4B • Updated • 3 -
shikhar-srivastava/mono_350m_pre_lr1e-3_fineweb2_tha_unigram_unscaled_65536
0.4B • Updated • 8 -
shikhar-srivastava/mono_350m_pre_lr1e-3_fineweb2_tha_unigram_unscaled_32768
0.4B • Updated • 3 -
shikhar-srivastava/mono_350m_pre_lr1e-3_fineweb2_vie_unigram_unscaled_32768
0.4B • Updated • 3 -
shikhar-srivastava/mono_350m_pre_lr1e-3_fineweb2_vie_bpe_unscaled_65536
0.4B • Updated • 1 -
shikhar-srivastava/mono_350m_pre_lr1e-3_fineweb2_vie_bpe_unscaled_32768
0.4B • Updated • 2