The Smol Training Playbook
📚
3.11k
The secrets to building world-class LLMs
LLM PlayBooks
All useful playbooks for training LLM
Note [Lesson 1] Learn how to train a "LLM"
The Ultra-Scale Playbook
🌌3.79kThe ultimate guide to training LLM on large GPU Clusters
Note [Lesson 2] Learn how to scale up training
The Synthetic Data Playbook: Generating Trillions of the Finest Tokens
📝223Explore synthetic data experiments on a virtual bookshelf
Note [Lesson 3] Learn how to scale data by generating
Evaluation Guidebook
📝302Explore LLM benchmark trends over time
Note [Lesson 4] Learn how to evaluate your model
The SpeechLLM Playbook
🔊19🚧 [WiP] A deepdive into SpeechLLMs and Neural Audio Codec
Note [Lesson 5] Image and Text aren't challenged to you? Try audio!
LLM训练终极指南 | The Ultra-Scale Playbook
🔥264了解LLM训练的方方面面
Note [Lesson 1] Learn how to train a "LLM" (Simplified Chinese Translate)