Instruction Pre-Training: Language Models are Supervised Multitask Learners
Paper • 2406.14491 • Published • 96
Instruction Pre-Training
-
-
Instruction Synthesizer
🐠86Generate instruction-response pairs from text
-
instruction-pretrain/InstructLM-1.3B
Text Generation • 1B • Updated • 333 • 43 -
instruction-pretrain/InstructLM-500M
Text Generation • 0.6B • Updated • 3.06k • 36 -
instruction-pretrain/instruction-synthesizer
Text Generation • 7B • Updated • 43 • 79 -
instruction-pretrain/medicine-Llama3-8B
Text Generation • 8B • Updated • 15 • 38 -
instruction-pretrain/finance-Llama3-8B
Text Generation • 8B • Updated • 173 • • 75 -
instruction-pretrain/ft-instruction-synthesizer-collection
Viewer • Updated • 249k • 178 • 63