Update README.md
Browse files
README.md
CHANGED
|
@@ -18,4 +18,8 @@ vllm (pretrained=/home/mgoin/code/Nemotron-4-340B-Base-hf-FP8,tensor_parallel_si
|
|
| 18 |
| Tasks |Version|Filter|n-shot|Metric| |Value | |Stderr|
|
| 19 |
|--------------|------:|------|-----:|------|---|-----:|---|-----:|
|
| 20 |
|truthfulqa_mc2| 2|none | 0|acc |↑ |0.4869|± |0.0142|
|
| 21 |
-
```
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 18 |
| Tasks |Version|Filter|n-shot|Metric| |Value | |Stderr|
|
| 19 |
|--------------|------:|------|-----:|------|---|-----:|---|-----:|
|
| 20 |
|truthfulqa_mc2| 2|none | 0|acc |↑ |0.4869|± |0.0142|
|
| 21 |
+
```
|
| 22 |
+
|
| 23 |
+
The [original paper](https://arxiv.org/pdf/2407.14679) evals:
|
| 24 |
+
|
| 25 |
+
|