ComparisonPO
/

Mistral-Instruct-7B-DPO-ComPO

Update README.md

dfa552a verified 6 months ago

121 Bytes

metadata

license: mit
datasets:
  - trl-lib/ultrafeedback_binarized
base_model:
  - ComparisonPO/Mistral-Instruct-7B-DPO_clean