SHasan commited on
Commit
f62abbb
·
verified ·
1 Parent(s): 7a8e7aa

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +19 -0
README.md CHANGED
@@ -41,6 +41,25 @@ as its base model, finetuned on only half of the layers using laserQLoRA. The pr
41
 
42
  ## Evaluation data
43
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
44
  🏆 Evaluation
45
 
46
  | Task |Version| Metric |Value| |Stderr|
 
41
 
42
  ## Evaluation data
43
 
44
+ Task Version Metric Value StdErr
45
+ ---------------------------------------------------------------------
46
+ agieval_aqua_rat 0 acc 28.35% 2.83%
47
+ agieval_aqua_rat 0 acc_norm 26.38% 2.77%
48
+ agieval_logiqa_en 0 acc 38.25% 1.91%
49
+ agieval_logiqa_en 0 acc_norm 38.10% 1.90%
50
+ agieval_lsat_ar 0 acc 23.91% 2.82%
51
+ agieval_lsat_ar 0 acc_norm 23.48% 2.80%
52
+ agieval_lsat_lr 0 acc 52.75% 2.21%
53
+ agieval_lsat_lr 0 acc_norm 53.92% 2.21%
54
+ agieval_lsat_rc 0 acc 66.91% 2.87%
55
+ agieval_lsat_rc 0 acc_norm 67.29% 2.87%
56
+ agieval_sat_en 0 acc 78.64% 2.86%
57
+ agieval_sat_en 0 acc_norm 78.64% 2.86%
58
+ agieval_sat_en_without_passage 0 acc 45.15% 3.48%
59
+ agieval_sat_en_without_passage 0 acc_norm 44.17% 3.47%
60
+ agieval_sat_math 0 acc 33.18% 3.18%
61
+ agieval_sat_math 0 acc_norm 31.36% 3.14%
62
+
63
  🏆 Evaluation
64
 
65
  | Task |Version| Metric |Value| |Stderr|