Stories-SLM - a NamrataThakur Collection

NamrataThakur 's Collections

Stories-SLM

updated Mar 8

A collection of Small Language Models pretrained from scratch (using only PyTorch) on Tiny Stories Dataset on a single Tesla-T4 16GB GPU.

NamrataThakur/Small_Language_Model_MOE_127M_Pretrained

Text Generation • Updated Mar 17 • 3.19k • 2
NamrataThakur/Small_Language_Model_GQA_48M_Pretrained

Text Generation • Updated Mar 17 • 3.01k • 1
NamrataThakur/Small_Language_Model_MHA_53M_Pretrained

Text Generation • Updated Mar 17 • 3.04k • 1