sanjay920 commited on
Commit
38efac2
·
verified ·
1 Parent(s): 00fefaa

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +56 -16
README.md CHANGED
@@ -1,19 +1,59 @@
1
- ---
2
- {}
3
- ---
4
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
5
  ---
6
 
7
- <!-- This model card has been generated automatically according to the information the Trainer had access to. You
8
- should probably proofread and complete it, then remove this comment. -->
9
-
10
- # run1_short_20000
11
-
12
- This model is a fine-tuned version of [mistralai/Mistral-7B-Instruct-v0.3](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.3) on the rubra_train_v1_mistral_short dataset.
13
-
14
- ### Framework versions
15
-
16
- - Transformers 4.41.2
17
- - Pytorch 2.3.1+cu121
18
- - Datasets 2.19.2
19
- - Tokenizers 0.19.1
 
 
 
 
1
  ---
2
+ model-index:
3
+ - name: Rubra-Mistral-7B-Instruct-v0.3
4
+ results:
5
+ - task:
6
+ type: text-generation
7
+ dataset:
8
+ type: MMLU
9
+ name: MMLU
10
+ metrics:
11
+ - type: 5-shot
12
+ value: 59.12
13
+ verified: false
14
+ - task:
15
+ type: text-generation
16
+ dataset:
17
+ type: GPQA
18
+ name: GPQA
19
+ metrics:
20
+ - type: 0-shot
21
+ value: 29.91
22
+ verified: false
23
+ - task:
24
+ type: text-generation
25
+ dataset:
26
+ type: GSM-8K
27
+ name: GSM-8K
28
+ metrics:
29
+ - type: 8-shot, CoT
30
+ value: 43.29
31
+ verified: false
32
+ - task:
33
+ type: text-generation
34
+ dataset:
35
+ type: MATH
36
+ name: MATH
37
+ metrics:
38
+ - type: 4-shot, CoT
39
+ value: 11.14
40
+ verified: false
41
+ - task:
42
+ type: text-generation
43
+ dataset:
44
+ type: MT-bench
45
+ name: MT-bench
46
+ metrics:
47
+ - type: GPT-4 as Judge
48
+ value: 7.69
49
+ verified: false
50
+ tags:
51
+ - function-calling
52
+ - tool-calling
53
+ - agentic
54
+ - rubra
55
+ language:
56
+ - en
57
  ---
58
 
59
+ # Mistral-7B-Instruct-v0.3