The Ultra-Scale Playbook
π
3.8k
The ultimate guide to training LLM on large GPU Clusters
π Research & Long-Form Blog Posts
In-depth technical articles and research pieces published by Hugging Face
-
-
The Smol Training Playbook
π3.12kThe secrets to building world-class LLMs
-
Evaluation Guidebook
π305Explore LLM benchmark trends over time
-
FineVision: Open Data is All You Need
π221A new open-source dataset for training VLMs
-
Maintain the unmaintainable
π79Explore the complex relationships between 400+ machine learning models
-
FineWeb: decanting the web for the finest text data at scale
π·1.33kExplore and download the FineWeb webβtext dataset
-
The Eiffel Tower Llama
π113Explore the Eiffel Tower Llama experiment with open-source models
-
Porting nanochat to Transformers: an AI modeling history lesson
π49Learn about ML and Transformers through nanochat
-
FinePDFs: Liberating 3T of the finest tokens from PDFs
π70 -
Can LLMs Play the Game of Science?
π27Explore LLM science benchmark scores
-
QED-Nano: Teaching a Tiny Model to Prove Hard Theorems
π74Who needs 1T parameters? Olympiad proofs with a 4B model
-
Distilling 100B+ Models 40x Faster with TRL
π71TRL distillation for 100B+ teachers, 40x faster