Update README.md
Browse files
README.md
CHANGED
@@ -17,7 +17,7 @@ Badger Writer is a *normalized fourier task addition* of [maldv/badger-lambda-ll
|
|
17 |
|
18 |
I also used the first and last layer directly from [dreamgen-preview/opus-v1.2-llama-3-8b-instruct-run3.5-epoch2.5](/dreamgen-preview/opus-v1.2-llama-3-8b-instruct-run3.5-epoch2.5) due to the obvious advantages. I didn't train either the lm_head or embed_tokens layers on the fantasy-writer, but opus is part of lambda ; so they all fit nicely together.
|
19 |
|
20 |
-
Rep-pen 1.1 ; Min-p 0.01 ; Temp 0.7 ; Dynatemp 0.4 ; <s>32k</s>24k context ; llama 3 instruct template
|
21 |
|
22 |
```
|
23 |
<|start_header_id|>system<|end_header_id|>
|
|
|
17 |
|
18 |
I also used the first and last layer directly from [dreamgen-preview/opus-v1.2-llama-3-8b-instruct-run3.5-epoch2.5](/dreamgen-preview/opus-v1.2-llama-3-8b-instruct-run3.5-epoch2.5) due to the obvious advantages. I didn't train either the lm_head or embed_tokens layers on the fantasy-writer, but opus is part of lambda ; so they all fit nicely together.
|
19 |
|
20 |
+
Rep-pen 1.05-1.1 ; Min-p 0.01 ; Temp 0.7 ; Dynatemp 0.4 ; <s>32k</s>24k context ; llama 3 instruct template
|
21 |
|
22 |
```
|
23 |
<|start_header_id|>system<|end_header_id|>
|