bhenrym14
/

mistral-7b-platypus-fp16

Text Generation

text-generation-inference

Model card Files Files and versions Community

bhenrym14 commited on Oct 2, 2023

Commit

3a211f2

·

1 Parent(s): e3ac5be

Update README.md

Files changed (1) hide show

README.md +2 -2

README.md CHANGED Viewed

@@ -30,9 +30,9 @@ MMLU (5 shot): 64.20
 ## Context Length - Relative Performance (wikitext perplexity)
-| Context (tokens) | <ins>**bhenrym14/platypus-m7b-fp16**</ins> | bhenrym14/airoboros-l2-13b-2.1-YaRN-64k | bhenrym14/airophin-13b-pntk-16k-fp16| bhenrym14/airoboros-13b-gpt4-1.4.1-PI-8192-fp16 |bhenrym14/airoboros-33b-gpt4-1.4.1-lxctx-PI-16384-fp16  | jondurbin/airoboros-l2-13b-gpt4-1.4.1 |
 | --- | --- |--- | ---| ----- | -----|
-| 512 | **7.22** | 7.64| | 7.62  | 7.90 | 7.23 |
 | 1024 | 6.04 | 6.15 | 6.20  | 6.17 | **5.85**  |
 | 2048 | 5.50 | 5.29 | 5.38  | 5.23 | **5.07** |
 | 4096 | 5.05 |4.93 | 5.08 | 4.91 | **4.77** |

 ## Context Length - Relative Performance (wikitext perplexity)
+| Context (tokens) | <ins>**bhenrym14/platypus-m7b-fp16**</ins> | bhenrym14/airoboros-l2-13b-2.1-YaRN-64k | bhenrym14/airophin-13b-pntk-16k-fp16 | bhenrym14/airoboros-33b-gpt4-1.4.1-lxctx-PI-16384-fp16  | jondurbin/airoboros-l2-13b-gpt4-1.4.1 |
 | --- | --- |--- | ---| ----- | -----|
+| 512 | **7.22** | 7.64 | 7.62  | 7.90 | 7.23 |
 | 1024 | 6.04 | 6.15 | 6.20  | 6.17 | **5.85**  |
 | 2048 | 5.50 | 5.29 | 5.38  | 5.23 | **5.07** |
 | 4096 | 5.05 |4.93 | 5.08 | 4.91 | **4.77** |