payelb
/

HHRLHF_TinyLlama-1.1B_aligned_with_MARS_deberta_RM

Model card Files Files and versions

HHRLHF_TinyLlama-1.1B_aligned_with_MARS_deberta_RM / README.md

Commit History

Upload PPO-aligned TinyLlama-1.1B model using MARS DeBERTa reward model on HHRLHF

43e0566
verified

payelb commited on 14 days ago

Upload tokenizer for HHRLHF-MARS aligned TinyLlama model

8f54447
verified

payelb commited on 14 days ago