FineInstructions: Scaling Synthetic Instructions to Pre-Training Scale
Paper • 2601.22146 • Published • 10
AI & ML interests
None defined yet.
AjayP13
authored a
paper 2 months ago
AjayP13
updated 19
datasets 3 months ago
fineinstructions-pretraining/dclm_baseline_1.0_actual_all
Viewer • Updated • 2.94B • 83 • 1
fineinstructions-pretraining/fineweb_edu_actual_all
Preview • Updated • 75 • 1
fineinstructions-pretraining/ipt_fineinstructions_judged
Viewer • Updated • 763k • 170
fineinstructions-pretraining/nemotron_wrap_1T_exp
Viewer • Updated • 302M • 53
fineinstructions-pretraining/nemotron_qa_1T_exp
Viewer • Updated • 425M • 51
fineinstructions-pretraining/nemotron_actual_1T_exp
Viewer • Updated • 302M • 54
fineinstructions-pretraining/nemotron_fineinstructions_1T_exp_chat
Viewer • Updated • 721M • 26 • 2
fineinstructions-pretraining/ipt_fineinstructions_all_judged_exp_chat
Viewer • Updated • 34.5M • 24
fineinstructions-pretraining/nemotron_synthetic_1T_exp
Viewer • Updated • 448M • 100
fineinstructions-pretraining/ipt_synthetic_all_exp
Viewer • Updated • 26.6M • 18 • 1
fineinstructions-pretraining/nemotron_actual_1T
Viewer • Updated • 746M • 31
fineinstructions-pretraining/longform_synthetic_all
Viewer • Updated • 27.7k • 25
fineinstructions-pretraining/ipt_synthetic_all
Viewer • Updated • 40M • 9 • 1
fineinstructions-pretraining/ipt_fineinstructions_all_exp
Viewer • Updated • 56.3M • 39 • 1
fineinstructions-pretraining/nemotron_wrap_1T
Viewer • Updated • 763M • 230 • 1
fineinstructions-pretraining/longform_fineinstructions_all
Viewer • Updated • 45.7k • 11
fineinstructions-pretraining/ipt_actual_all_exp
Viewer • Updated • 26.6M • 17
fineinstructions-pretraining/longform_actual_all
Viewer • Updated • 27.7k • 5
fineinstructions-pretraining/ipt_fineinstructions_scored
Viewer • Updated • 9.93k • 19