Hugging Face's logo

payelb
/
UltraFeedback_openbmb_TinyLlama-1.1B_aligned_with_MARS_RM

PyTorch
Safetensors
Model card Files
xet
 Community
UltraFeedback_openbmb_TinyLlama-1.1B_aligned_with_MARS_RM

Commit History

Upload PPO-aligned TinyLlama-1.1B model using MARS reward model on UltraFeedback_openbmb
f50116e
verified

payelb commited on

Upload tokenizer for UltraFeedback_openbmb-MARS aligned TinyLlama model
c8a98b1
verified

payelb commited on

initial commit
e5aa6a2
verified

payelb commited on