Update README.md
Browse files
README.md
CHANGED
@@ -27,6 +27,11 @@ hf (pretrained=Lambent/Falcon3-Continued-0.3-10B-Base,dtype=auto,trust_remote_co
|
|
27 |
|eq_bench| 2.1|none | 0|eqbench |↑ | 64.2105|± |2.1413|
|
28 |
| | |none | 0|percent_parseable|↑ |100.0000|± |0.0000|
|
29 |
|
|
|
|
|
|
|
|
|
|
|
30 |
|
31 |
hf (pretrained=Lambent/Falcon3-Continued-0.3-10B-Base), gen_kwargs: (None), limit: None, num_fewshot: None, batch_size: auto:4 (4,64,64,64)
|
32 |
| Tasks |Version|Filter|n-shot| Metric | |Value | |Stderr|
|
|
|
27 |
|eq_bench| 2.1|none | 0|eqbench |↑ | 64.2105|± |2.1413|
|
28 |
| | |none | 0|percent_parseable|↑ |100.0000|± |0.0000|
|
29 |
|
30 |
+
hf (pretrained=Lambent/Falcon3-Continued-0.3-10B-Base), gen_kwargs: (None), limit: None, num_fewshot: None, batch_size: auto:4
|
31 |
+
|Tasks|Version| Filter |n-shot| Metric | |Value | |Stderr|
|
32 |
+
|-----|------:|----------------|-----:|-----------|---|-----:|---|-----:|
|
33 |
+
|gsm8k| 3|flexible-extract| 5|exact_match|↑ |0.8105|± |0.0108|
|
34 |
+
| | |strict-match | 5|exact_match|↑ |0.8036|± |0.0109|
|
35 |
|
36 |
hf (pretrained=Lambent/Falcon3-Continued-0.3-10B-Base), gen_kwargs: (None), limit: None, num_fewshot: None, batch_size: auto:4 (4,64,64,64)
|
37 |
| Tasks |Version|Filter|n-shot| Metric | |Value | |Stderr|
|