Hugging Face's logo

prithivMLmods
/
Sombrero-Opus-14B-Elite6

Text Generation
Transformers
Safetensors
English
Chinese
qwen2
text-generation-inference
trl
sambrero
elite6
sombrero
sft
vlm
opus
conversational
Eval Results
Model card Files Community
1
prithivMLmods commited on
Commit
20c6067
·
verified ·
1 Parent(s): c136c98

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +14 -8
README.md CHANGED
@@ -13,6 +13,7 @@ tags:
13
  - sambrero
14
  - elite6
15
  - sombrero
 
16
  model-index:
17
  - name: Sombrero-Opus-14B-Elite6
18
  results:
@@ -30,7 +31,8 @@ model-index:
30
  value: 78.47
31
  name: averaged accuracy
32
  source:
33
- url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard#/?search=prithivMLmods%2FSombrero-Opus-14B-Elite6
 
34
  name: Open LLM Leaderboard
35
  - task:
36
  type: text-generation
@@ -46,7 +48,8 @@ model-index:
46
  value: 50.01
47
  name: normalized accuracy
48
  source:
49
- url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard#/?search=prithivMLmods%2FSombrero-Opus-14B-Elite6
 
50
  name: Open LLM Leaderboard
51
  - task:
52
  type: text-generation
@@ -62,7 +65,8 @@ model-index:
62
  value: 52.64
63
  name: exact match
64
  source:
65
- url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard#/?search=prithivMLmods%2FSombrero-Opus-14B-Elite6
 
66
  name: Open LLM Leaderboard
67
  - task:
68
  type: text-generation
@@ -78,7 +82,8 @@ model-index:
78
  value: 11.52
79
  name: acc_norm
80
  source:
81
- url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard#/?search=prithivMLmods%2FSombrero-Opus-14B-Elite6
 
82
  name: Open LLM Leaderboard
83
  - task:
84
  type: text-generation
@@ -93,7 +98,8 @@ model-index:
93
  value: 13.88
94
  name: acc_norm
95
  source:
96
- url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard#/?search=prithivMLmods%2FSombrero-Opus-14B-Elite6
 
97
  name: Open LLM Leaderboard
98
  - task:
99
  type: text-generation
@@ -110,7 +116,8 @@ model-index:
110
  value: 46.47
111
  name: accuracy
112
  source:
113
- url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard#/?search=prithivMLmods%2FSombrero-Opus-14B-Elite6
 
114
  name: Open LLM Leaderboard
115
  ---
116
  ![2.png](https://cdn-uploads.huggingface.co/production/uploads/65bb837dbfb878f46c77de4c/KnAFhdxFnQj3FDbnjwZjX.png)
@@ -213,5 +220,4 @@ Summarized results can be found [here](https://huggingface.co/datasets/open-llm-
213
  |MATH Lvl 5 (4-Shot)| 52.64|
214
  |GPQA (0-shot) | 11.52|
215
  |MuSR (0-shot) | 13.88|
216
- |MMLU-PRO (5-shot) | 46.47|
217
-
 
13
  - sambrero
14
  - elite6
15
  - sombrero
16
+ - sft
17
  model-index:
18
  - name: Sombrero-Opus-14B-Elite6
19
  results:
 
31
  value: 78.47
32
  name: averaged accuracy
33
  source:
34
+ url: >-
35
+ https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard#/?search=prithivMLmods%2FSombrero-Opus-14B-Elite6
36
  name: Open LLM Leaderboard
37
  - task:
38
  type: text-generation
 
48
  value: 50.01
49
  name: normalized accuracy
50
  source:
51
+ url: >-
52
+ https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard#/?search=prithivMLmods%2FSombrero-Opus-14B-Elite6
53
  name: Open LLM Leaderboard
54
  - task:
55
  type: text-generation
 
65
  value: 52.64
66
  name: exact match
67
  source:
68
+ url: >-
69
+ https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard#/?search=prithivMLmods%2FSombrero-Opus-14B-Elite6
70
  name: Open LLM Leaderboard
71
  - task:
72
  type: text-generation
 
82
  value: 11.52
83
  name: acc_norm
84
  source:
85
+ url: >-
86
+ https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard#/?search=prithivMLmods%2FSombrero-Opus-14B-Elite6
87
  name: Open LLM Leaderboard
88
  - task:
89
  type: text-generation
 
98
  value: 13.88
99
  name: acc_norm
100
  source:
101
+ url: >-
102
+ https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard#/?search=prithivMLmods%2FSombrero-Opus-14B-Elite6
103
  name: Open LLM Leaderboard
104
  - task:
105
  type: text-generation
 
116
  value: 46.47
117
  name: accuracy
118
  source:
119
+ url: >-
120
+ https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard#/?search=prithivMLmods%2FSombrero-Opus-14B-Elite6
121
  name: Open LLM Leaderboard
122
  ---
123
  ![2.png](https://cdn-uploads.huggingface.co/production/uploads/65bb837dbfb878f46c77de4c/KnAFhdxFnQj3FDbnjwZjX.png)
 
220
  |MATH Lvl 5 (4-Shot)| 52.64|
221
  |GPQA (0-shot) | 11.52|
222
  |MuSR (0-shot) | 13.88|
223
+ |MMLU-PRO (5-shot) | 46.47|