Update README.md
Browse files
README.md
CHANGED
@@ -3,7 +3,7 @@ datasets:
|
|
3 |
- jondurbin/airoboros-gpt4-1.4.1
|
4 |
---
|
5 |
|
6 |
-
|
7 |
|
8 |
# RoPE Scaled QLoRA Finetune of airoboros-65b-gpt4-1.4.1 (ggml)
|
9 |
|
|
|
3 |
- jondurbin/airoboros-gpt4-1.4.1
|
4 |
---
|
5 |
|
6 |
+
**NOTE:** set rope freq scale to 0.25
|
7 |
|
8 |
# RoPE Scaled QLoRA Finetune of airoboros-65b-gpt4-1.4.1 (ggml)
|
9 |
|