Hugging Face's logo

suayptalha
/
Falcon3-Jessi-v0.4-7B-Slerp

Text Generation
Transformers
Safetensors
llama
mergekit
Merge
falcon3
conversational
Eval Results
text-generation-inference
Inference Endpoints
Model card Files Community
1

Adding Evaluation Results

#1
by suayptalha - opened
base: refs/heads/main
←
from: refs/pr/1
Discussion Files changed
+120
-12
Files changed (1) hide show
  1. README.md +120 -12
README.md CHANGED
@@ -1,20 +1,115 @@
1
  ---
2
- base_model:
3
- - neopolita/jessi-v0.4-falcon3-7b-instruct
4
- - tiiuae/Falcon3-7B-Instruct
5
- library_name: transformers
6
- license: other
7
- license_name: falcon-llm-license
8
- license_link: https://falconllm.tii.ae/falcon-terms-and-conditions.html
9
- tags:
10
- - mergekit
11
- - merge
12
- - falcon3
13
  language:
14
  - en
15
  - fr
16
  - es
17
  - pt
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
18
  ---
19
  # Merged Model
20
 
@@ -56,4 +151,17 @@ slices:
56
  model: neopolita/jessi-v0.4-falcon3-7b-instruct
57
  ```
58
 
59
- <a href="https://www.buymeacoffee.com/suayptalha" target="_blank"><img src="https://cdn.buymeacoffee.com/buttons/v2/default-yellow.png" alt="Buy Me A Coffee" style="height: 60px !important;width: 217px !important;" ></a>
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
 
 
 
 
 
 
 
 
 
 
 
2
  language:
3
  - en
4
  - fr
5
  - es
6
  - pt
7
+ license: other
8
+ library_name: transformers
9
+ tags:
10
+ - mergekit
11
+ - merge
12
+ - falcon3
13
+ base_model:
14
+ - neopolita/jessi-v0.4-falcon3-7b-instruct
15
+ - tiiuae/Falcon3-7B-Instruct
16
+ license_name: falcon-llm-license
17
+ license_link: https://falconllm.tii.ae/falcon-terms-and-conditions.html
18
+ model-index:
19
+ - name: Falcon3-Jessi-v0.4-7B-Slerp
20
+ results:
21
+ - task:
22
+ type: text-generation
23
+ name: Text Generation
24
+ dataset:
25
+ name: IFEval (0-Shot)
26
+ type: HuggingFaceH4/ifeval
27
+ args:
28
+ num_few_shot: 0
29
+ metrics:
30
+ - type: inst_level_strict_acc and prompt_level_strict_acc
31
+ value: 76.76
32
+ name: strict accuracy
33
+ source:
34
+ url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=suayptalha/Falcon3-Jessi-v0.4-7B-Slerp
35
+ name: Open LLM Leaderboard
36
+ - task:
37
+ type: text-generation
38
+ name: Text Generation
39
+ dataset:
40
+ name: BBH (3-Shot)
41
+ type: BBH
42
+ args:
43
+ num_few_shot: 3
44
+ metrics:
45
+ - type: acc_norm
46
+ value: 37.29
47
+ name: normalized accuracy
48
+ source:
49
+ url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=suayptalha/Falcon3-Jessi-v0.4-7B-Slerp
50
+ name: Open LLM Leaderboard
51
+ - task:
52
+ type: text-generation
53
+ name: Text Generation
54
+ dataset:
55
+ name: MATH Lvl 5 (4-Shot)
56
+ type: hendrycks/competition_math
57
+ args:
58
+ num_few_shot: 4
59
+ metrics:
60
+ - type: exact_match
61
+ value: 34.59
62
+ name: exact match
63
+ source:
64
+ url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=suayptalha/Falcon3-Jessi-v0.4-7B-Slerp
65
+ name: Open LLM Leaderboard
66
+ - task:
67
+ type: text-generation
68
+ name: Text Generation
69
+ dataset:
70
+ name: GPQA (0-shot)
71
+ type: Idavidrein/gpqa
72
+ args:
73
+ num_few_shot: 0
74
+ metrics:
75
+ - type: acc_norm
76
+ value: 8.28
77
+ name: acc_norm
78
+ source:
79
+ url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=suayptalha/Falcon3-Jessi-v0.4-7B-Slerp
80
+ name: Open LLM Leaderboard
81
+ - task:
82
+ type: text-generation
83
+ name: Text Generation
84
+ dataset:
85
+ name: MuSR (0-shot)
86
+ type: TAUR-Lab/MuSR
87
+ args:
88
+ num_few_shot: 0
89
+ metrics:
90
+ - type: acc_norm
91
+ value: 20.49
92
+ name: acc_norm
93
+ source:
94
+ url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=suayptalha/Falcon3-Jessi-v0.4-7B-Slerp
95
+ name: Open LLM Leaderboard
96
+ - task:
97
+ type: text-generation
98
+ name: Text Generation
99
+ dataset:
100
+ name: MMLU-PRO (5-shot)
101
+ type: TIGER-Lab/MMLU-Pro
102
+ config: main
103
+ split: test
104
+ args:
105
+ num_few_shot: 5
106
+ metrics:
107
+ - type: acc
108
+ value: 34.0
109
+ name: accuracy
110
+ source:
111
+ url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=suayptalha/Falcon3-Jessi-v0.4-7B-Slerp
112
+ name: Open LLM Leaderboard
113
  ---
114
  # Merged Model
115
 
 
151
  model: neopolita/jessi-v0.4-falcon3-7b-instruct
152
  ```
153
 
154
+ <a href="https://www.buymeacoffee.com/suayptalha" target="_blank"><img src="https://cdn.buymeacoffee.com/buttons/v2/default-yellow.png" alt="Buy Me A Coffee" style="height: 60px !important;width: 217px !important;" ></a>
155
+ # [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard)
156
+ Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/suayptalha__Falcon3-Jessi-v0.4-7B-Slerp-details)
157
+
158
+ | Metric |Value|
159
+ |-------------------|----:|
160
+ |Avg. |35.23|
161
+ |IFEval (0-Shot) |76.76|
162
+ |BBH (3-Shot) |37.29|
163
+ |MATH Lvl 5 (4-Shot)|34.59|
164
+ |GPQA (0-shot) | 8.28|
165
+ |MuSR (0-shot) |20.49|
166
+ |MMLU-PRO (5-shot) |34.00|
167
+