payelb
/

UltraFeedback_openbmb_TinyLlama-1.1B_aligned_with_MARS_RM

Model card Files Files and versions

UltraFeedback_openbmb_TinyLlama-1.1B_aligned_with_MARS_RM / pytorch_model.bin

Commit History

Upload PPO-aligned TinyLlama-1.1B model using MARS reward model on UltraFeedback_openbmb

f50116e
verified

payelb commited on 17 days ago