Hugging Face's logo

payelb
/
PKUSafeRLHF_TinyLlama-1.1B_aligned_with_baseline_RM

PyTorch
Safetensors
Model card Files
xet
 Community
PKUSafeRLHF_TinyLlama-1.1B_aligned_with_baseline_RM / adapter_config.json

Commit History

Upload PPO-aligned TinyLlama-1.1B model using baseline reward model on PKUSafeRLHF
153b391
verified

payelb commited on