This is a Hugging Face transformers-compatible conversion of the original dense 355M-parameter model from the paper "[Efficient Large Scale Language Modeling with Mixtures of Experts](https://arxiv.org/abs/2112.10684)" from Artetxe et al. Please refer to the original model card, which can be found at https://github.com/facebookresearch/fairseq/blob/main/examples/moe_lm/model_card.md.

# [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)
Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_KoboldAI__fairseq-dense-355M)

| Metric                | Value                     |
|-----------------------|---------------------------|
| Avg.                  | 27.99   |
| ARC (25-shot)         | 25.43          |
| HellaSwag (10-shot)   | 46.67    |
| MMLU (5-shot)         | 25.3         |
| TruthfulQA (0-shot)   | 39.19   |
| Winogrande (5-shot)   | 52.88   |
| GSM8K (5-shot)        | 0.0        |
| DROP (3-shot)         | 6.48         |

{"language": "en"}
transformers pytorch safetensors xglm text-generation en arxiv:2112.10684 autotrain_compatible endpoints_compatible has_space region:us
TAGS
#transformers #pytorch #safetensors #xglm #text-generation #en #arxiv-2112.10684 #autotrain_compatible #endpoints_compatible #has_space #region-us 

This is a Hugging Face transformers-compatible conversion of the original dense 355M-parameter model from the paper "Efficient Large Scale Language Modeling with Mixtures of Experts" from Artetxe et al. Please refer to the original model card, which can be found at URL


Open LLM Leaderboard Evaluation Results
=======================================


Detailed results can be found here




TAGS
#transformers #pytorch #safetensors #xglm #text-generation #en #arxiv-2112.10684 #autotrain_compatible #endpoints_compatible #has_space #region-us 

passage: TAGS
#transformers #pytorch #safetensors #xglm #text-generation #en #arxiv-2112.10684 #autotrain_compatible #endpoints_compatible #has_space #region-us 
