This model is for the reproduction of results on Safe-RLHF dataset of paper "The crucial role of samplers in online direct preference optimization". Iteration 2 of DPO-mixp algorithm, trained on https://huggingface.co/zhezi12138/alpaca-7b-iter-1.
- Downloads last month
- 19
Inference Providers
NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API:
The model has no library tag.
Model tree for zhezi12138/alpaca-7b-iter-2-mixp
Base model
PKU-Alignment/alpaca-7b-reproduced