Spaces:
Running
Running
Ludwig Stumpp
commited on
Commit
·
f3fd684
1
Parent(s):
fe8088e
For now set PaLM2 commercial use to no until clear
Browse files
README.md
CHANGED
|
@@ -46,11 +46,11 @@ https://llm-leaderboard.streamlit.app/
|
|
| 46 |
| [opt-175b](https://ai.facebook.com/blog/democratizing-access-to-large-scale-language-models-with-opt-175b/) | Meta AI | no | | [0.791](https://crfm.stanford.edu/helm/latest/?group=core_scenarios) | | | | | | | [0.318](https://crfm.stanford.edu/helm/latest/?group=core_scenarios) | | | | |
|
| 47 |
| [palm-540b](https://arxiv.org/abs/2204.02311v5) | Google Research | no | | [0.838](https://arxiv.org/abs/2204.02311v5) | [0.834](https://arxiv.org/abs/2204.02311v5) | [0.836](https://ai.google/static/documents/palm2techreport.pdf) | [0.262](https://drive.google.com/file/d/1cN-b9GnWtHzQRoE7M7gAEyivY0kl4BYs/view) | [0.779](https://arxiv.org/abs/2204.02311v5) | [0.818](https://ai.google/static/documents/palm2techreport.pdf) | | [0.693](https://arxiv.org/abs/2204.02311v5) | | [0.814](https://ai.google/static/documents/palm2techreport.pdf) | [0.837](https://ai.google/static/documents/palm2techreport.pdf) | [0.851](https://arxiv.org/abs/2204.02311) |
|
| 48 |
| [palm-coder-540b](https://arxiv.org/abs/2204.02311) | Google Research | no | | | | | [0.359](https://ai.google/static/documents/palm2techreport.pdf) | | | | | | | | |
|
| 49 |
-
| [palm-2-s](https://ai.google/static/documents/palm2techreport.pdf) | Google Research |
|
| 50 |
-
| [palm-2-s*](https://ai.google/static/documents/palm2techreport.pdf) | Google Research |
|
| 51 |
-
| [palm-2-m](https://ai.google/static/documents/palm2techreport.pdf) | Google Research |
|
| 52 |
-
| [palm-2-l](https://ai.google/static/documents/palm2techreport.pdf) | Google Research |
|
| 53 |
-
| [palm-2-l-instruct](https://ai.google/static/documents/palm2techreport.pdf) | Google Research |
|
| 54 |
| [replit-code-v1-3b](https://huggingface.co/replit/replit-code-v1-3b) | Replit | yes | | | | | [0.219](https://twitter.com/amasad/status/1651019556423598081/photo/2) | | | | | | | | |
|
| 55 |
| [stablelm-base-alpha-7b](https://huggingface.co/stabilityai/stablelm-base-alpha-7b) | Stability AI | yes | | | [0.533](https://www.mosaicml.com/blog/mpt-7b) | | | [0.533](https://www.mosaicml.com/blog/mpt-7b) | | [0.251](https://www.mosaicml.com/blog/mpt-7b) | | [0.049](https://www.mosaicml.com/blog/mpt-7b) | | | |
|
| 56 |
| [stablelm-tuned-alpha-7b](https://huggingface.co/stabilityai/stablelm-tuned-alpha-7b) | Stability AI | no | [858](https://lmsys.org/blog/2023-05-03-arena/) | | | | | | | | | | | | |
|
|
|
|
| 46 |
| [opt-175b](https://ai.facebook.com/blog/democratizing-access-to-large-scale-language-models-with-opt-175b/) | Meta AI | no | | [0.791](https://crfm.stanford.edu/helm/latest/?group=core_scenarios) | | | | | | | [0.318](https://crfm.stanford.edu/helm/latest/?group=core_scenarios) | | | | |
|
| 47 |
| [palm-540b](https://arxiv.org/abs/2204.02311v5) | Google Research | no | | [0.838](https://arxiv.org/abs/2204.02311v5) | [0.834](https://arxiv.org/abs/2204.02311v5) | [0.836](https://ai.google/static/documents/palm2techreport.pdf) | [0.262](https://drive.google.com/file/d/1cN-b9GnWtHzQRoE7M7gAEyivY0kl4BYs/view) | [0.779](https://arxiv.org/abs/2204.02311v5) | [0.818](https://ai.google/static/documents/palm2techreport.pdf) | | [0.693](https://arxiv.org/abs/2204.02311v5) | | [0.814](https://ai.google/static/documents/palm2techreport.pdf) | [0.837](https://ai.google/static/documents/palm2techreport.pdf) | [0.851](https://arxiv.org/abs/2204.02311) |
|
| 48 |
| [palm-coder-540b](https://arxiv.org/abs/2204.02311) | Google Research | no | | | | | [0.359](https://ai.google/static/documents/palm2techreport.pdf) | | | | | | | | |
|
| 49 |
+
| [palm-2-s](https://ai.google/static/documents/palm2techreport.pdf) | Google Research | no | | | | [0.820](https://ai.google/static/documents/palm2techreport.pdf) | | | [0.807](https://ai.google/static/documents/palm2techreport.pdf) | | | | [0.752](https://ai.google/static/documents/palm2techreport.pdf) | [0.779](https://ai.google/static/documents/palm2techreport.pdf) | |
|
| 50 |
+
| [palm-2-s*](https://ai.google/static/documents/palm2techreport.pdf) | Google Research | no | | | | | [0.376](https://ai.google/static/documents/palm2techreport.pdf) | | | | | | | | |
|
| 51 |
+
| [palm-2-m](https://ai.google/static/documents/palm2techreport.pdf) | Google Research | no | | | | [0.840](https://ai.google/static/documents/palm2techreport.pdf) | | | [0.837](https://ai.google/static/documents/palm2techreport.pdf) | | | | [0.817](https://ai.google/static/documents/palm2techreport.pdf) | [0.792](https://ai.google/static/documents/palm2techreport.pdf) | |
|
| 52 |
+
| [palm-2-l](https://ai.google/static/documents/palm2techreport.pdf) | Google Research | no | | | | [0.868](https://ai.google/static/documents/palm2techreport.pdf) | | | [0.869](https://ai.google/static/documents/palm2techreport.pdf) | | | | [0.861](https://ai.google/static/documents/palm2techreport.pdf) | [0.830](https://ai.google/static/documents/palm2techreport.pdf) | |
|
| 53 |
+
| [palm-2-l-instruct](https://ai.google/static/documents/palm2techreport.pdf) | Google Research | no | | | | | | | | | | | | | [0.909](https://ai.google/static/documents/palm2techreport.pdf) |
|
| 54 |
| [replit-code-v1-3b](https://huggingface.co/replit/replit-code-v1-3b) | Replit | yes | | | | | [0.219](https://twitter.com/amasad/status/1651019556423598081/photo/2) | | | | | | | | |
|
| 55 |
| [stablelm-base-alpha-7b](https://huggingface.co/stabilityai/stablelm-base-alpha-7b) | Stability AI | yes | | | [0.533](https://www.mosaicml.com/blog/mpt-7b) | | | [0.533](https://www.mosaicml.com/blog/mpt-7b) | | [0.251](https://www.mosaicml.com/blog/mpt-7b) | | [0.049](https://www.mosaicml.com/blog/mpt-7b) | | | |
|
| 56 |
| [stablelm-tuned-alpha-7b](https://huggingface.co/stabilityai/stablelm-tuned-alpha-7b) | Stability AI | no | [858](https://lmsys.org/blog/2023-05-03-arena/) | | | | | | | | | | | | |
|