stukenov/sozkz-core-llama-600m-kk-base-v1
Text Generation • 0.6B • Updated • 36 • 1
SozKZ Core: Kazakh Language Models
Base, instruct, and balanced Kazakh language models trained from scratch — Llama (50M–600M), GPT2, Pythia architectures
-
-
stukenov/sozkz-core-llama-600m-kk-instruct-v1
0.6B • Updated • 29 -
stukenov/sozkz-core-llama-300m-kk-base-v1
Text Generation • 0.3B • Updated • 29 -
stukenov/sozkz-core-llama-300m-kk-instruct-v1
Text Generation • 0.3B • Updated • 32 -
stukenov/sozkz-core-llama-150m-kk-base-v1
Text Generation • 0.2B • Updated • 69 -
stukenov/sozkz-core-llama-150m-kk-balanced-v1
Text Generation • 0.2B • Updated • 1 -
stukenov/sozkz-core-llama-150m-kk-instruct-v1
Text Generation • 0.2B • Updated • 30 -
stukenov/sozkz-core-llama-150m-kk-instruct-v2
Text Generation • 0.2B • Updated • 4 • 1 -
stukenov/sozkz-core-llama-50m-kk-base-v1
Text Generation • 50.3M • Updated • 4 -
stukenov/sozkz-core-llama-50m-kk-base-v2
50.6M • Updated • 27 • 3 -
stukenov/sozkz-core-llama-50m-kk-base-v4
60.8M • Updated • 5 -
stukenov/sozkz-core-llama-50m-kk-balanced-v1
Text Generation • 50.3M • Updated • 2 -
stukenov/sozkz-core-llama-30m-kk-base-v1
Text Generation • 33.5M • Updated • 2 -
stukenov/sozkz-llama-150m-200k-kk-base-v1
Text Generation • 0.2B • Updated • 1 -
stukenov/sozkz-core-gpt2-8m-kk-base-v1
Text Generation • 7.75M • Updated • 2 -
stukenov/sozkz-core-gpt2-30m-kk-base-v1
Text Generation • 33.9M • Updated • 2 -
stukenov/sozkz-core-gpt2-50k-kk-base-v1
Text Generation • Updated -
stukenov/sozkz-core-gpt2-60m-kk-base-v1
Updated -
stukenov/sozkz-core-gpt2-200k-kk-base-v1
Updated -
stukenov/sozkz-core-pythia-14m-kk-dapt-v1
Text Generation • 14.1M • Updated • 2 -
stukenov/sozkz-seq-t5-50m-kk-base-v1
84.5M • Updated • 1 -
SozKZ: Training Efficient Small Language Models for Kazakh from Scratch
Paper • 2603.20854 • Published • 1