mechramc/kalavai-cross-lingual-code-specialist-seed137
Text Generation • 0.4B • Updated • 142
KALAVAI - Cooperative Decentralized LLM Training
Specialist models from arXiv 2603.22755. Cross-lingual, private-domain, and English specialists at 410M, 1B, and Qwen-2.5-1.5B scale.
-
-
mechramc/kalavai-cross-lingual-code-specialist-seed2026
Text Generation • 0.4B • Updated • 405 -
mechramc/kalavai-cross-lingual-tamil-specialist-seed137
Text Generation • 0.4B • Updated • 31 -
mechramc/kalavai-cross-lingual-tamil-specialist-seed2026
Text Generation • 0.4B • Updated • 27 -
mechramc/kalavai-cross-lingual-welsh-specialist-seed137
Text Generation • 0.4B • Updated • 384 -
mechramc/kalavai-cross-lingual-welsh-specialist-seed2026
Text Generation • 0.4B • Updated • 139 -
mechramc/kalavai-cross-lingual-yoruba-specialist-seed137
Text Generation • 0.4B • Updated • 298 -
mechramc/kalavai-cross-lingual-yoruba-specialist-seed2026
Text Generation • 0.4B • Updated • 29 -
mechramc/kalavai-phase1-1b-code-specialist-seed42
Text Generation • 1B • Updated • 389 -
mechramc/kalavai-phase1-1b-fiction-specialist-seed42
Text Generation • 1B • Updated • 29 -
mechramc/kalavai-phase1-1b-science-specialist-seed42
Text Generation • 1B • Updated • 389 -
mechramc/kalavai-phase1-410m-code-specialist-seed42
Text Generation • 0.4B • Updated • 33 -
mechramc/kalavai-phase1-410m-fiction-specialist-seed42
0.4B • Updated • 24 -
mechramc/kalavai-phase1-410m-science-specialist-seed42
Text Generation • 0.4B • Updated • 251 -
mechramc/kalavai-private-domain-legal-specialist-seed42
Text Generation • 0.4B • Updated • 30 -
mechramc/kalavai-private-domain-medical-specialist-seed42
Text Generation • 0.4B • Updated • 30 -
mechramc/kalavai-private-domain-patent-specialist-seed42
Text Generation • 0.4B • Updated • 30 -
mechramc/kalavai-qwen-code-specialist-seed42
Text Generation • 2B • Updated • 32 -
mechramc/kalavai-qwen-fiction-specialist-seed42
Text Generation • 2B • Updated • 392 -
KALAVAI: Predicting When Independent Specialist Fusion Works -- A Quantitative Model for Post-Hoc Cooperative LLM Training
Paper • 2603.22755 • Published