Update README.md
Browse files
README.md
CHANGED
@@ -6,13 +6,30 @@ library_name: transformers
|
|
6 |
tags:
|
7 |
- mergekit
|
8 |
- merge
|
|
|
|
|
|
|
|
|
9 |
- NuSLERP
|
10 |
-
|
11 |
---
|
12 |
# matricide-12B-Unslop-Unleashed-v2
|
|
|
|
|
13 |
This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
|
14 |
|
15 |
-
This is my 6th model. Also the first working model using the NuSLERP merge method.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
16 |
|
17 |
## Merge Details
|
18 |
### Merge Method
|
@@ -47,4 +64,4 @@ parameters:
|
|
47 |
int8_mask: true
|
48 |
|
49 |
|
50 |
-
```
|
|
|
6 |
tags:
|
7 |
- mergekit
|
8 |
- merge
|
9 |
+
- 12b
|
10 |
+
- chat
|
11 |
+
- roleplay
|
12 |
+
- creative-writing
|
13 |
- NuSLERP
|
14 |
+
license: apache-2.0
|
15 |
---
|
16 |
# matricide-12B-Unslop-Unleashed-v2
|
17 |
+
> Her ‘Love’ only existed to rein in my ambition. The stagnancy became unbearable.
|
18 |
+
|
19 |
This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
|
20 |
|
21 |
+
This is my 6th model. Also the first working model using the NuSLERP merge method. The original was intended to introduce [UnslopNemo](https://huggingface.co/TheDrummer/UnslopNemo-12B-v4) to combat GPTisms of [NemoMix](https://huggingface.co/MarinaraSpaghetti/NemoMix-Unleashed-12B). I used [UnslopNemo-4](https://huggingface.co/TheDrummer/UnslopNemo-12B-v4) as it supposedly has bigger anti-GPTism effects at the cost of intelligence.
|
22 |
+
|
23 |
+
## Testing stage: early testing
|
24 |
+
I do not know how this model holds up over long term context. Early testing showed stability and viable answers.
|
25 |
+
|
26 |
+
## Parameters
|
27 |
+
- **Context size:** Not more than *20k* recommended - coherency may degrade.
|
28 |
+
- **Chat Template:** *ChatML*; Metharme/Pygmalion (as per UnslopNemo) may work, but effects are untested
|
29 |
+
- **Samplers:** A *Temperature-Last* of 1 and *Min-P* of 0.1 are viable, but haven't been finetuned. Activate *DRY* if repetition appears. *XTC* is untested.
|
30 |
+
|
31 |
+
## Quantization
|
32 |
+
Static **GGUF** Quants available at [redrix/matricide-12B-Unslop-Unleashed-v2-GGUF](https://huggingface.co/redrix/matricide-12B-Unslop-Unleashed-v2-GGUF)
|
33 |
|
34 |
## Merge Details
|
35 |
### Merge Method
|
|
|
64 |
int8_mask: true
|
65 |
|
66 |
|
67 |
+
```
|