payelb
/

HHRLHF_TinyLlama-1.1B_aligned_with_MARS_deberta_RM

Model card Files Files and versions

HHRLHF_TinyLlama-1.1B_aligned_with_MARS_deberta_RM / pytorch_model.bin

Commit History

Upload PPO-aligned TinyLlama-1.1B model using MARS DeBERTa reward model on HHRLHF

43e0566
verified

payelb commited on 14 days ago