Text Generation
Transformers
Safetensors
English
Russian
mistral
conversational
text-generation-inference
MexIvanov commited on
Commit
5c6547b
·
1 Parent(s): 046d180

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +81 -0
README.md CHANGED
@@ -9,6 +9,87 @@ tags:
9
  - python
10
  - code
11
  pipeline_tag: conversational
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
12
  ---
13
 
14
  # Model Card for Model ID
 
9
  - python
10
  - code
11
  pipeline_tag: conversational
12
+ model-index:
13
+ - name: zephyr-python-ru-merged
14
+ results:
15
+ - task:
16
+ type: text-generation
17
+ dataset:
18
+ name: gsm8k
19
+ type: gsm8k
20
+ metrics:
21
+ - name: Grade School Math 8K (5-Shot)
22
+ type: Grade School Math 8K (5-Shot)
23
+ value: 32.52
24
+ source:
25
+ name: Open LLM Leaderboard
26
+ url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard
27
+
28
+ - task:
29
+ type: text-generation
30
+ dataset:
31
+ name: ai2_arc
32
+ type: ai2_arc
33
+ metrics:
34
+ - name: AI2 Reasoning Challenge (25-Shot)
35
+ type: AI2 Reasoning Challenge (25-Shot)
36
+ value: 56.06
37
+ source:
38
+ name: Open LLM Leaderboard
39
+ url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard
40
+
41
+ - task:
42
+ type: text-generation
43
+ dataset:
44
+ name: HellaSwag
45
+ type: HellaSwag
46
+ metrics:
47
+ - name: HellaSwag (10-Shot)
48
+ type: HellaSwag (10-Shot)
49
+ value: 82.06
50
+ source:
51
+ name: Open LLM Leaderboard
52
+ url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard
53
+
54
+ - task:
55
+ type: text-generation
56
+ dataset:
57
+ name: MMLU
58
+ type: MMLU
59
+ metrics:
60
+ - name: MMLU (5-Shot)
61
+ type: MMLU (5-Shot)
62
+ value: 60.02
63
+ source:
64
+ name: Open LLM Leaderboard
65
+ url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard
66
+
67
+ - task:
68
+ type: text-generation
69
+ dataset:
70
+ name: truthfulqa
71
+ type: truthfulqa
72
+ metrics:
73
+ - name: truthfulqa:mc (0-Shot)
74
+ type: truthfulqa:mc (0-Shot)
75
+ value: 52.81
76
+ source:
77
+ name: Open LLM Leaderboard
78
+ url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard
79
+
80
+ - task:
81
+ type: text-generation
82
+ dataset:
83
+ name: winogrande
84
+ type: winogrande
85
+ metrics:
86
+ - name: winogrande (5-Shot)
87
+ type: winogrande (5-Shot)
88
+ value: 76.95
89
+ source:
90
+ name: Open LLM Leaderboard
91
+ url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard
92
+
93
  ---
94
 
95
  # Model Card for Model ID