Update README.md
Browse files
README.md
CHANGED
@@ -36,7 +36,7 @@ Here are some settings ranges that tend to work for me. They aren't strict value
|
|
36 |
* Temperature: **1.0** (maybe less, a little bit goes a long way with Nemo)
|
37 |
* Min-P: **0.1** to **0.2**
|
38 |
* *(all other samplers disabled)*
|
39 |
-
|
40 |
## Merge Details
|
41 |
|
42 |
This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
|
@@ -88,4 +88,15 @@ slices:
|
|
88 |
tokenizer_source: union
|
89 |
```
|
90 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
91 |
And as always, have a great day!
|
|
|
36 |
* Temperature: **1.0** (maybe less, a little bit goes a long way with Nemo)
|
37 |
* Min-P: **0.1** to **0.2**
|
38 |
* *(all other samplers disabled)*
|
39 |
+
|
40 |
## Merge Details
|
41 |
|
42 |
This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
|
|
|
88 |
tokenizer_source: union
|
89 |
```
|
90 |
|
91 |
+
## Benchmarks (or Benchmark because I tried only one)
|
92 |
+
|
93 |
+
I ran EQ bench from [EleutherAI's lm-evaluation-harness](https://github.com/EleutherAI/lm-evaluation-harness) (thank you @FallenMerick).
|
94 |
+
|
95 |
+
```
|
96 |
+
| Tasks |Version|Filter|n-shot| Metric | | Value | |Stderr|
|
97 |
+
|--------|------:|------|-----:|-----------------|---|-------:|---|-----:|
|
98 |
+
|eq_bench| 2.1|none | 0|eqbench |↑ | 79.3617|± | 1.637|
|
99 |
+
| | |none | 0|percent_parseable|↑ |100.0000|± | 0.000|
|
100 |
+
```
|
101 |
+
|
102 |
And as always, have a great day!
|