Hugging Face's logo

payelb
/
UltraFeedback_openbmb_Llama-3.2-1B_aligned_with_baseline_deberta_RM

PyTorch
Safetensors
Model card Files
xet
 Community
UltraFeedback_openbmb_Llama-3.2-1B_aligned_with_baseline_deberta_RM / adapter_model.safetensors

Commit History

Upload PPO-aligned Llama-3.2-1B model using baseline DeBERTa reward model on UltraFeedback_openbmb
4fb5c1f
verified

payelb commited on