Hugging Face's logo

RTO-RL
/
Llama3-8B-RDPO

Safetensors
llama
Model card Files Community

Base model: OpenRLHF/Llama-3-8b-sft-mixture

Preference dataset: HuggingFaceH4/ultrafeedback_binarized

Downloads last month
0
Safetensors
Model size
8.03B params
Tensor type
BF16
·
Inference Providers NEW
This model is not currently available via any of the supported third-party Inference Providers, and HF Inference API was unable to determine this model's library.

Model tree for RTO-RL/Llama3-8B-RDPO

Base model

OpenRLHF/Llama-3-8b-sft-mixture
Finetuned
(7)
this model
Quantizations
1 model

Dataset used to train RTO-RL/Llama3-8B-RDPO