A starter kit for evaluating benchmarks on the 🤗 Hub
['evaluation', 'huggingface', 'machine-learning']
A starter kit for evaluating benchmarks on the 🤗 Hub
 Hugging Face Benchmarks
> A toolkit for evaluating benchmarks on the [Hugging Face Hub](https://huggingface.co)
## Hosted benchmarks
The list of hosted benchmarks is shown in the table below:
| Benchmark | Description | Submission | Leaderboard |
| :---: | :---: | :---: | :---: | 
| RAFT | A benchmark to test few-shot learning in NLP | [`ought/raft-submission`](https://huggingface.co/datasets/ought/raft-submission) | [`ought/raft-leaderboard`](https://huggingface.co/spaces/ought/raft-leaderboard) |
| GEM | A large-scale benchmark for natural language generation | [`GEM/submission-form`](https://huggingface.co/spaces/GEM/submission-form) | [`GEM/results`](https://huggingface.co/spaces/GEM/results) |
## Developer installation
Clone the repository and install the requirements:
```
git clone git@github.com:huggingface/hf_benchmarks.git
cd hf_benchmarks
pip install '.[dev]'
```