Lambent commited on
Commit
8d4a94d
·
verified ·
1 Parent(s): a824f1e

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +5 -0
README.md CHANGED
@@ -27,6 +27,11 @@ hf (pretrained=Lambent/Falcon3-Continued-0.3-10B-Base,dtype=auto,trust_remote_co
27
  |eq_bench| 2.1|none | 0|eqbench |↑ | 64.2105|± |2.1413|
28
  | | |none | 0|percent_parseable|↑ |100.0000|± |0.0000|
29
 
 
 
 
 
 
30
 
31
  hf (pretrained=Lambent/Falcon3-Continued-0.3-10B-Base), gen_kwargs: (None), limit: None, num_fewshot: None, batch_size: auto:4 (4,64,64,64)
32
  | Tasks |Version|Filter|n-shot| Metric | |Value | |Stderr|
 
27
  |eq_bench| 2.1|none | 0|eqbench |↑ | 64.2105|± |2.1413|
28
  | | |none | 0|percent_parseable|↑ |100.0000|± |0.0000|
29
 
30
+ hf (pretrained=Lambent/Falcon3-Continued-0.3-10B-Base), gen_kwargs: (None), limit: None, num_fewshot: None, batch_size: auto:4
31
+ |Tasks|Version| Filter |n-shot| Metric | |Value | |Stderr|
32
+ |-----|------:|----------------|-----:|-----------|---|-----:|---|-----:|
33
+ |gsm8k| 3|flexible-extract| 5|exact_match|↑ |0.8105|± |0.0108|
34
+ | | |strict-match | 5|exact_match|↑ |0.8036|± |0.0109|
35
 
36
  hf (pretrained=Lambent/Falcon3-Continued-0.3-10B-Base), gen_kwargs: (None), limit: None, num_fewshot: None, batch_size: auto:4 (4,64,64,64)
37
  | Tasks |Version|Filter|n-shot| Metric | |Value | |Stderr|