Hugging Face's logo

payelb
/
PKUSafeRLHF_Llama-3.2-1B_aligned_with_WoN_deberta_RM

PyTorch
Safetensors
Model card Files
xet
 Community
PKUSafeRLHF_Llama-3.2-1B_aligned_with_WoN_deberta_RM / adapter_config.json

Commit History

Upload PPO-aligned Llama-3.2-1B model using WoN DeBERTa reward model on PKUSafeRLHF
e184dc2
verified

payelb commited on