payelb
/

PKUSafeRLHF_TinyLlama-1.1B_aligned_with_MARS_RM

Model card Files Files and versions

PKUSafeRLHF_TinyLlama-1.1B_aligned_with_MARS_RM / pytorch_model.bin

Commit History

Upload PPO-aligned TinyLlama-1.1B model using MARS reward model on PKUSafeRLHF

8f21213
verified

payelb commited on 18 days ago