Phantomcloak19/qwen2.5-dpo-overnorm-full

Qwen2.5-3B DPO – Over-Normalization Mitigation

DPO-finetuned model based on Qwen/Qwen2.5-3B, trained to reduce over-normalized and false-equivalence responses.