ewqr2130/mistral-inst-v02-dpo

take the mistral inst-v02 model and run dpo on it, 6000 epoch. take the mistral inst-v02 model and run dpo on it, 6000 epoch. take the mistral inst-v02 model and run dpo on it, 6000 epoch. take the mistral inst-v02 model and run dpo on it, 6000 epoch. take the mistral inst-v02 model and run dpo on it, 6000 epoch.