payelb
/

UltraFeedback_openbmb_TinyLlama-1.1B_aligned_with_MARS_deberta_RM

Model card Files Files and versions

UltraFeedback_openbmb_TinyLlama-1.1B_aligned_with_MARS_deberta_RM

Commit History

Upload PPO-aligned TinyLlama-1.1B model using MARS DeBERTa reward model on UltraFeedback_openbmb

28176ec
verified

payelb commited on 12 days ago

Upload tokenizer for UltraFeedback_openbmb-MARS aligned TinyLlama model

27e4fc7
verified

payelb commited on 12 days ago

initial commit

5131aa3
verified

payelb commited on 12 days ago