Update README.md
Browse files
README.md
CHANGED
@@ -3,6 +3,8 @@ license: other
|
|
3 |
---
|
4 |
# Llama-3 chat vector
|
5 |
|
|
|
|
|
6 |
This is 'modelified' version of _chat vector_ from the paper [Chat Vector: A Simple Approach to Equip LLMs with Instruction Following and Model Alignment in New Languages](https://arxiv.org/abs/2310.04799). So this is not a model, its just weight diff, just for ease to use myself(or you too)!
|
7 |
|
8 |
What I understand here:
|
@@ -21,7 +23,7 @@ So before (my) initial purpose in comparing which method is better, `llama3 →
|
|
21 |
| [kuotient/Llama-3-Ko-8B-dare-ties](https://huggingface.co/kuotient/Llama-3-Ko-8B-dare-ties) | Dare-ties | 0.4950 | 0.5399 |
|
22 |
| [kuotient/Llama-3-Ko-8B-TA](https://huggingface.co/kuotient/Llama-3-Ko-8B-TA) | Task Arithmetic(maybe...? not sure about this) | - |
|
23 |
| WIP | Model stock(I don't read this paper yet but still) | - |
|
24 |
-
|
|
25 |
|---|---|---|---|
|
26 |
| [meta-llama/Meta-Llama-3-8B](https://huggingface.co/meta-llama/Meta-Llama-3-8B) | Base | - | - |
|
27 |
| [meta-llama/Meta-Llama-3-8B-Instruct](https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct) | - | 0.4239 | 0.4931 |
|
|
|
3 |
---
|
4 |
# Llama-3 chat vector
|
5 |
|
6 |
+
Update 0426: A small problem with the deployment of the model 'Llama-3-Seagull-Evo-8B', but we hope to have it back in good time!
|
7 |
+
|
8 |
This is 'modelified' version of _chat vector_ from the paper [Chat Vector: A Simple Approach to Equip LLMs with Instruction Following and Model Alignment in New Languages](https://arxiv.org/abs/2310.04799). So this is not a model, its just weight diff, just for ease to use myself(or you too)!
|
9 |
|
10 |
What I understand here:
|
|
|
23 |
| [kuotient/Llama-3-Ko-8B-dare-ties](https://huggingface.co/kuotient/Llama-3-Ko-8B-dare-ties) | Dare-ties | 0.4950 | 0.5399 |
|
24 |
| [kuotient/Llama-3-Ko-8B-TA](https://huggingface.co/kuotient/Llama-3-Ko-8B-TA) | Task Arithmetic(maybe...? not sure about this) | - |
|
25 |
| WIP | Model stock(I don't read this paper yet but still) | - |
|
26 |
+
| kuotient/Llama-3-Seagull-Evo-8B | Evolutionary Model Merging | **0.6139** | **0.5344** |
|
27 |
|---|---|---|---|
|
28 |
| [meta-llama/Meta-Llama-3-8B](https://huggingface.co/meta-llama/Meta-Llama-3-8B) | Base | - | - |
|
29 |
| [meta-llama/Meta-Llama-3-8B-Instruct](https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct) | - | 0.4239 | 0.4931 |
|