Spaces:
Running
Running
Ludwig Stumpp
commited on
Commit
·
6147ea1
1
Parent(s):
e1aeb72
Add llama results on hellaswag zero shot
Browse files
README.md
CHANGED
|
@@ -34,9 +34,9 @@ https://llm-leaderboard.streamlit.app/
|
|
| 34 |
| [gpt-j-6b](https://huggingface.co/EleutherAI/gpt-j-6b) | yes | | [0.683](https://www.mosaicml.com/blog/mpt-7b) | | [0.683](https://www.mosaicml.com/blog/mpt-7b) | [0.261](https://www.mosaicml.com/blog/mpt-7b) | | [0.234](https://www.mosaicml.com/blog/mpt-7b) |
|
| 35 |
| [koala-13b](https://bair.berkeley.edu/blog/2023/04/03/koala/) | no | [1082](https://lmsys.org/blog/2023-05-03-arena/) | | | | | | |
|
| 36 |
| [llama-7b](https://arxiv.org/abs/2302.13971) | no | | [0.738](https://www.mosaicml.com/blog/mpt-7b) | [0.105](https://drive.google.com/file/d/1cN-b9GnWtHzQRoE7M7gAEyivY0kl4BYs/view) | [0.738](https://www.mosaicml.com/blog/mpt-7b) | [0.302](https://www.mosaicml.com/blog/mpt-7b) | | [0.443](https://www.mosaicml.com/blog/mpt-7b) |
|
| 37 |
-
| [llama-13b](https://arxiv.org/abs/2302.13971) | no | [932](https://lmsys.org/blog/2023-05-03-arena/) |
|
| 38 |
-
| [llama-33b](https://arxiv.org/abs/2302.13971) | no | |
|
| 39 |
-
| [llama-65b](https://arxiv.org/abs/2302.13971) | no | |
|
| 40 |
| [mpt-7b](https://huggingface.co/mosaicml/mpt-7b) | yes | | [0.761](https://www.mosaicml.com/blog/mpt-7b) | | [0.702](https://www.mosaicml.com/blog/mpt-7b) | [0.296](https://www.mosaicml.com/blog/mpt-7b) | | [0.343](https://www.mosaicml.com/blog/mpt-7b) |
|
| 41 |
| [oasst-pythia-12b](https://huggingface.co/OpenAssistant/pythia-12b-pre-v8-12.5k-steps) | yes | [1065](https://lmsys.org/blog/2023-05-03-arena/) | | | | | | |
|
| 42 |
| [opt-7b](https://huggingface.co/facebook/opt-6.7b) | no | | [0.677](https://www.mosaicml.com/blog/mpt-7b) | | [0.677](https://www.mosaicml.com/blog/mpt-7b) | [0.251](https://www.mosaicml.com/blog/mpt-7b) | | [0.227](https://www.mosaicml.com/blog/mpt-7b) |
|
|
|
|
| 34 |
| [gpt-j-6b](https://huggingface.co/EleutherAI/gpt-j-6b) | yes | | [0.683](https://www.mosaicml.com/blog/mpt-7b) | | [0.683](https://www.mosaicml.com/blog/mpt-7b) | [0.261](https://www.mosaicml.com/blog/mpt-7b) | | [0.234](https://www.mosaicml.com/blog/mpt-7b) |
|
| 35 |
| [koala-13b](https://bair.berkeley.edu/blog/2023/04/03/koala/) | no | [1082](https://lmsys.org/blog/2023-05-03-arena/) | | | | | | |
|
| 36 |
| [llama-7b](https://arxiv.org/abs/2302.13971) | no | | [0.738](https://www.mosaicml.com/blog/mpt-7b) | [0.105](https://drive.google.com/file/d/1cN-b9GnWtHzQRoE7M7gAEyivY0kl4BYs/view) | [0.738](https://www.mosaicml.com/blog/mpt-7b) | [0.302](https://www.mosaicml.com/blog/mpt-7b) | | [0.443](https://www.mosaicml.com/blog/mpt-7b) |
|
| 37 |
+
| [llama-13b](https://arxiv.org/abs/2302.13971) | no | [932](https://lmsys.org/blog/2023-05-03-arena/) | [0.792](https://arxiv.org/abs/2302.13971) | [0.158](https://drive.google.com/file/d/1cN-b9GnWtHzQRoE7M7gAEyivY0kl4BYs/view) | | | | |
|
| 38 |
+
| [llama-33b](https://arxiv.org/abs/2302.13971) | no | | [0.828](https://arxiv.org/abs/2302.13971) | [0.217](https://drive.google.com/file/d/1cN-b9GnWtHzQRoE7M7gAEyivY0kl4BYs/view) | | | | |
|
| 39 |
+
| [llama-65b](https://arxiv.org/abs/2302.13971) | no | | [0.842](https://arxiv.org/abs/2302.13971) | [0.237](https://drive.google.com/file/d/1cN-b9GnWtHzQRoE7M7gAEyivY0kl4BYs/view) | | | [0.634](https://arxiv.org/abs/2302.13971v1) | |
|
| 40 |
| [mpt-7b](https://huggingface.co/mosaicml/mpt-7b) | yes | | [0.761](https://www.mosaicml.com/blog/mpt-7b) | | [0.702](https://www.mosaicml.com/blog/mpt-7b) | [0.296](https://www.mosaicml.com/blog/mpt-7b) | | [0.343](https://www.mosaicml.com/blog/mpt-7b) |
|
| 41 |
| [oasst-pythia-12b](https://huggingface.co/OpenAssistant/pythia-12b-pre-v8-12.5k-steps) | yes | [1065](https://lmsys.org/blog/2023-05-03-arena/) | | | | | | |
|
| 42 |
| [opt-7b](https://huggingface.co/facebook/opt-6.7b) | no | | [0.677](https://www.mosaicml.com/blog/mpt-7b) | | [0.677](https://www.mosaicml.com/blog/mpt-7b) | [0.251](https://www.mosaicml.com/blog/mpt-7b) | | [0.227](https://www.mosaicml.com/blog/mpt-7b) |
|