179
MT Bench
📊
Compare model answers to questions
Awesome RLHF
A curated collection of datasets, models, Spaces, and papers on Reinforcement Learning from Human Feedback (RLHF).
Note A multi-turn evaluation benchmark for chatbots which uses GPT-4 as a judge to evaluate the quality of responses.
garage-bAInd/Open-Platypus
Viewer • Updated • 24.9k • 4.05k • 379Note A high quality blend of human and synthetic datasets focused on dialogues and reasoning abilities. A good source for SFT and PPO.
meta-llama/Llama-2-7b-chat-hf
Text Generation • Updated • 1.33M • • 4.21kNote The first series of open access models trained at scale using RLHF. Based on https://huggingface.co/papers/2307.09288
meta-llama/Llama-2-70b-chat-hf
Text Generation • Updated • 29.8k • 2.18kNote The first series of open access models trained at scale using RLHF. Based on https://huggingface.co/papers/2307.09288
lightonai/alfred-40b-0723
Text Generation • Updated • 40 • 45Note An RLHF tuned version of Falcon 40B
Anthropic/hh-rlhf
Viewer • Updated • 169k • 13.6k • 1.27kNote A dataset of dialogues between human annotators and a 52B parameter language model from Anthropic. Contains "helpfulness" and "harmlessness" subsets that can be used for training reward models. Basis for https://huggingface.co/papers/2112.00861 and https://huggingface.co/papers/2204.05862
-
Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedback
Paper • 2204.05862 • Published • 2 -
A General Language Assistant as a Laboratory for Alignment
Paper • 2112.00861 • Published • 2 -
stanfordnlp/SHP
Viewer • Updated • 386k • 1.9k • 297 -
openai/summarize_from_feedback
Viewer • Updated • 194k • 1.69k • 196 -
openai/webgpt_comparisons
Viewer • Updated • 19.6k • 534 • 229