The Synthetic Data Playbook: Generating Trillions of the Finest Tokens
📝
219
Explore synthetic data experiments on a virtual bookshelf
AI & ML interests
We release large pre-training datasets to accelerate open LLM development. Part of the Hugging Face Science team (hf.co/science)
Recent Activity
Papers
FineWeb2: One Pipeline to Scale Them All -- Adapting Pre-Training Data Processing to Every Language
The FineWeb Datasets: Decanting the Web for the Finest Text Data at Scale
joelniklaus
updated a
Space 5 days ago
thomwolf
updated a
dataset 9 days ago
joelniklaus
updated a
dataset 13 days ago
Intrinsic quality evaluation of 3000 examples using LLM-as-judge
👍 1
4
#5 opened 24 days ago
by 
ratishsp
clefourrier
authored a
paper about 1 month ago
error
2
#1 opened about 1 month ago
by 
georgebassemfouad
joelniklaus
published a
Space about 1 month ago
joelniklaus
updated 13
datasets about 1 month ago
HuggingFaceFW/finepdfs_edu_50BT-dclm_30BT-fineweb_edu_20BT-shuffled
Viewer • Updated • 56.1M • 4.17k
HuggingFaceFW/finepdfs_edu_50BT-dclm_30BT-fineweb_edu_20BT
Viewer • Updated • 56.1M • 4.48k
HuggingFaceFW/finepdfs_50BT-dclm_30BT-fineweb_edu_20BT-shuffled
Viewer • Updated • 62.1M • 2.27k • 3
HuggingFaceFW/finepdfs_50BT-dclm_30BT-fineweb_edu_20BT
Viewer • Updated • 62.1M • 5.52k • 1
HuggingFaceFW/finepdfs_edu_100BT-shuffled
Viewer • Updated • 17.8M • 1.65k
HuggingFaceFW/finepdfs_edu_100BT
Viewer • Updated • 17.8M • 2.02k
HuggingFaceFW/finepdfs_100BT-shuffled
Viewer • Updated • 14.6M • 505
HuggingFaceFW/finepdfs_100BT
Viewer • Updated • 29.9M • 1.38k
HuggingFaceFW/fineweb_edu_100BT-shuffled
Viewer • Updated • 102M • 636
HuggingFaceFW/fineweb_edu_100BT
Preview • Updated • 3.13k
HuggingFaceFW/fineweb_100BT-shuffled
Viewer • Updated • 161M • 389
HuggingFaceFW/fineweb_100BT
Viewer • Updated • 161M • 1.03k • 1
HuggingFaceFW/dclm_100BT-shuffled
Viewer • Updated • 89.3M • 2.13k • 1