Hugging Face's logo

wzhouad
/
Llama3-Instruct-8B-WPO-HB

Text Generation
Transformers
Safetensors
llama
conversational
text-generation-inference
Model card Files Community
wzhouad commited on
Commit
dbecc3d
·
verified ·
1 Parent(s): 18018ff

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -2
README.md CHANGED
@@ -1,11 +1,12 @@
1
  ---
2
  library_name: transformers
3
- tags: []
 
4
  ---
5
 
6
  ## Description
7
 
8
- Llama3-Instruct-8B model finetuned by hybrid WPO (GPT-4-turbo + on-policy sampling + Ultrafeedback). Details in [WPO: Enhancing RLHF with Weighted Preference Optimization](https://arxiv.org/abs/2406.11827).
9
 
10
  ## License
11
  This model is licensed under the Zoom software license and is permitted for use only for noncommercial, educational, or academic research purposes.
 
1
  ---
2
  library_name: transformers
3
+ datasets:
4
+ - wzhouad/llama3-ultrafeedback-hybrid
5
  ---
6
 
7
  ## Description
8
 
9
+ Llama3-Instruct-8B model finetuned by hybrid WPO (GPT-4-turbo + on-policy sampling + Ultrafeedback). Details in [WPO: Enhancing RLHF with Weighted Preference Optimization](https://arxiv.org/abs/2406.11827). The model is trained based on [wzhouad/llama3-ultrafeedback-hybrid](https://huggingface.co/datasets/wzhouad/llama3-ultrafeedback-hybrid).
10
 
11
  ## License
12
  This model is licensed under the Zoom software license and is permitted for use only for noncommercial, educational, or academic research purposes.