Update README.md
Browse files
README.md
CHANGED
@@ -41,6 +41,25 @@ as its base model, finetuned on only half of the layers using laserQLoRA. The pr
|
|
41 |
|
42 |
## Evaluation data
|
43 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
44 |
🏆 Evaluation
|
45 |
|
46 |
| Task |Version| Metric |Value| |Stderr|
|
|
|
41 |
|
42 |
## Evaluation data
|
43 |
|
44 |
+
Task Version Metric Value StdErr
|
45 |
+
---------------------------------------------------------------------
|
46 |
+
agieval_aqua_rat 0 acc 28.35% 2.83%
|
47 |
+
agieval_aqua_rat 0 acc_norm 26.38% 2.77%
|
48 |
+
agieval_logiqa_en 0 acc 38.25% 1.91%
|
49 |
+
agieval_logiqa_en 0 acc_norm 38.10% 1.90%
|
50 |
+
agieval_lsat_ar 0 acc 23.91% 2.82%
|
51 |
+
agieval_lsat_ar 0 acc_norm 23.48% 2.80%
|
52 |
+
agieval_lsat_lr 0 acc 52.75% 2.21%
|
53 |
+
agieval_lsat_lr 0 acc_norm 53.92% 2.21%
|
54 |
+
agieval_lsat_rc 0 acc 66.91% 2.87%
|
55 |
+
agieval_lsat_rc 0 acc_norm 67.29% 2.87%
|
56 |
+
agieval_sat_en 0 acc 78.64% 2.86%
|
57 |
+
agieval_sat_en 0 acc_norm 78.64% 2.86%
|
58 |
+
agieval_sat_en_without_passage 0 acc 45.15% 3.48%
|
59 |
+
agieval_sat_en_without_passage 0 acc_norm 44.17% 3.47%
|
60 |
+
agieval_sat_math 0 acc 33.18% 3.18%
|
61 |
+
agieval_sat_math 0 acc_norm 31.36% 3.14%
|
62 |
+
|
63 |
🏆 Evaluation
|
64 |
|
65 |
| Task |Version| Metric |Value| |Stderr|
|