Text Generation
Transformers
PyTorch
Safetensors
English
llama
axolotl
Generated from Trainer
conversational
text-generation-inference

Adding Evaluation Results

#1
Files changed (1) hide show
  1. README.md +20 -7
README.md CHANGED
@@ -1,17 +1,17 @@
1
  ---
 
 
2
  license: llama3.1
3
- base_model: meta-llama/Meta-Llama-3.1-8B
4
  tags:
5
  - axolotl
6
  - generated_from_trainer
7
- model-index:
8
- - name: Llama-3.1-8B-Magpie-Align-SFT-v0.1
9
- results: []
10
- language:
11
- - en
12
  datasets:
13
  - Magpie-Align/Magpie-Reasoning-150K
14
  - Magpie-Align/Magpie-Pro-MT-300K-v0.1
 
 
 
15
  ---
16
 
17
  ![Magpie](https://cdn-uploads.huggingface.co/production/uploads/653df1323479e9ebbe3eb6cc/FWWILXrAGNwWr52aghV0S.png)
@@ -177,4 +177,17 @@ special_tokens:
177
 
178
  ```
179
 
180
- </details><be>
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ language:
3
+ - en
4
  license: llama3.1
 
5
  tags:
6
  - axolotl
7
  - generated_from_trainer
8
+ base_model: meta-llama/Meta-Llama-3.1-8B
 
 
 
 
9
  datasets:
10
  - Magpie-Align/Magpie-Reasoning-150K
11
  - Magpie-Align/Magpie-Pro-MT-300K-v0.1
12
+ model-index:
13
+ - name: Llama-3.1-8B-Magpie-Align-SFT-v0.1
14
+ results: []
15
  ---
16
 
17
  ![Magpie](https://cdn-uploads.huggingface.co/production/uploads/653df1323479e9ebbe3eb6cc/FWWILXrAGNwWr52aghV0S.png)
 
177
 
178
  ```
179
 
180
+ </details><be>
181
+ # [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard)
182
+ Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_Magpie-Align__Llama-3.1-8B-Magpie-Align-SFT-v0.1)
183
+
184
+ | Metric |Value|
185
+ |-------------------|----:|
186
+ |Avg. |17.80|
187
+ |IFEval (0-Shot) |47.88|
188
+ |BBH (3-Shot) |26.14|
189
+ |MATH Lvl 5 (4-Shot)| 7.93|
190
+ |GPQA (0-shot) | 1.45|
191
+ |MuSR (0-shot) | 1.87|
192
+ |MMLU-PRO (5-shot) |21.53|
193
+