Lambent commited on
Commit
93ba186
·
verified ·
1 Parent(s): 2fb4218

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +12 -0
README.md CHANGED
@@ -9,6 +9,18 @@ tags:
9
  - merge
10
 
11
  ---
 
 
 
 
 
 
 
 
 
 
 
 
12
  # lisacosmo
13
 
14
  This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
 
9
  - merge
10
 
11
  ---
12
+ Figured the model must have learned the data a somewhat different way for all three training methods.
13
+ Decided to test if merging them would give generalization benefits. I think it didn't hurt at least!
14
+
15
+ | Model |AGIEval|GPT4All|TruthfulQA|Bigbench|Average|
16
+ |-------------------------------------------------------------------------------|------:|------:|---------:|-------:|------:|
17
+ |[CosmoAlpacaLisa-0.3-1b](https://huggingface.co/Lambent/CosmoAlpacaLisa-0.3-1b)| 23.79| 51.61| 40.25| 29.97| 36.41|
18
+
19
+ | Model |AGIEval|GPT4All|TruthfulQA|Bigbench|Average|
20
+ |-------------------------------------------------------------------------|------:|------:|---------:|-------:|------:|
21
+ |[CosmoAlpacaLight-1b](https://huggingface.co/Lambent/CosmoAlpacaLight-1b)| 24.28| 51.31| 40.33| 29.47| 36.35|
22
+
23
+
24
  # lisacosmo
25
 
26
  This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).