Commit
·
db659da
1
Parent(s):
2120a8e
Create README.md
Browse files
README.md
ADDED
@@ -0,0 +1,15 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
datasets:
|
3 |
+
- togethercomputer/RedPajama-Data-1T-Sample
|
4 |
+
tags:
|
5 |
+
- llama2
|
6 |
+
- llama
|
7 |
+
---
|
8 |
+
A second model merge by chargoddard. A GGML conversion of the previous merge can be found [here](https://huggingface.co/IHaveNoClueAndIMustPost/Llama-2-22B-GGML).<br>
|
9 |
+
I have no idea what I'm doing so if something doesn't work as it should or not at all that's likely on me, not the models themselves.<br><br>
|
10 |
+
Description copied from the [original repo](https://huggingface.co/chargoddard/llama2-22b-blocktriangular) below.
|
11 |
+
|
12 |
+
<i>
|
13 |
+
Similar to llama2-22b, but with BLOCK_DIAGONAL=false in the merge and twice the fine-tuning tokens.
|
14 |
+
|
15 |
+
Again, not intended for direct use - meant as a base for further tuning and merging.</i>
|