Update README.md
Browse files
README.md
CHANGED
|
@@ -6,4 +6,16 @@ datasets:
|
|
| 6 |
- PleIAs/common_corpus
|
| 7 |
base_model:
|
| 8 |
- tiiuae/Falcon3-10B-Base
|
| 9 |
-
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 6 |
- PleIAs/common_corpus
|
| 7 |
base_model:
|
| 8 |
- tiiuae/Falcon3-10B-Base
|
| 9 |
+
---
|
| 10 |
+
|
| 11 |
+
|
| 12 |
+
hf (pretrained=Lambent/Falcon3-Continued-0.3-10B-Base), gen_kwargs: (None), limit: None, num_fewshot: None, batch_size: auto:4 (4,64,64,64)
|
| 13 |
+
| Tasks |Version|Filter|n-shot| Metric | |Value | |Stderr|
|
| 14 |
+
|-------------|------:|------|-----:|--------|---|-----:|---|-----:|
|
| 15 |
+
|arc_challenge| 1|none | 0|acc |↑ |0.5401|± |0.0146|
|
| 16 |
+
| | |none | 0|acc_norm|↑ |0.5648|± |0.0145|
|
| 17 |
+
|piqa | 1|none | 0|acc |↑ |0.7873|± |0.0095|
|
| 18 |
+
| | |none | 0|acc_norm|↑ |0.7954|± |0.0094|
|
| 19 |
+
|sciq | 1|none | 0|acc |↑ |0.9620|± |0.0060|
|
| 20 |
+
| | |none | 0|acc_norm|↑ |0.9500|± |0.0069|
|
| 21 |
+
|winogrande | 1|none | 0|acc |↑ |0.7332|± |0.0124|
|