matchaaaaa commited on
Commit
bfa8a4c
·
verified ·
1 Parent(s): 4022b60

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +12 -1
README.md CHANGED
@@ -36,7 +36,7 @@ Here are some settings ranges that tend to work for me. They aren't strict value
36
  * Temperature: **1.0** (maybe less, a little bit goes a long way with Nemo)
37
  * Min-P: **0.1** to **0.2**
38
  * *(all other samplers disabled)*
39
-
40
  ## Merge Details
41
 
42
  This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
@@ -88,4 +88,15 @@ slices:
88
  tokenizer_source: union
89
  ```
90
 
 
 
 
 
 
 
 
 
 
 
 
91
  And as always, have a great day!
 
36
  * Temperature: **1.0** (maybe less, a little bit goes a long way with Nemo)
37
  * Min-P: **0.1** to **0.2**
38
  * *(all other samplers disabled)*
39
+
40
  ## Merge Details
41
 
42
  This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
 
88
  tokenizer_source: union
89
  ```
90
 
91
+ ## Benchmarks (or Benchmark because I tried only one)
92
+
93
+ I ran EQ bench from [EleutherAI's lm-evaluation-harness](https://github.com/EleutherAI/lm-evaluation-harness) (thank you @FallenMerick).
94
+
95
+ ```
96
+ | Tasks |Version|Filter|n-shot| Metric | | Value | |Stderr|
97
+ |--------|------:|------|-----:|-----------------|---|-------:|---|-----:|
98
+ |eq_bench| 2.1|none | 0|eqbench |↑ | 79.3617|± | 1.637|
99
+ | | |none | 0|percent_parseable|↑ |100.0000|± | 0.000|
100
+ ```
101
+
102
  And as always, have a great day!