Update README.md
Browse files
README.md
CHANGED
@@ -4,7 +4,7 @@ tags:
|
|
4 |
- text-generation-inference
|
5 |
- transformers
|
6 |
- unsloth
|
7 |
-
-
|
8 |
- trl
|
9 |
license: apache-2.0
|
10 |
language:
|
@@ -27,7 +27,7 @@ This repository demonstrates how to fine-tune the **Codellama-34b** model to cre
|
|
27 |
|
28 |
This **readme.md** provides step-by-step instructions to:
|
29 |
1. Install and set up the **Unsloth framework**.
|
30 |
-
2. Initialize the **
|
31 |
3. Implement **LoRA Adapters** for memory-efficient fine-tuning.
|
32 |
4. Prepare the **Andy-3.5 dataset** with Minecraft-specific knowledge.
|
33 |
5. Configure and execute training in a resource-efficient manner.
|
|
|
4 |
- text-generation-inference
|
5 |
- transformers
|
6 |
- unsloth
|
7 |
+
- codellama
|
8 |
- trl
|
9 |
license: apache-2.0
|
10 |
language:
|
|
|
27 |
|
28 |
This **readme.md** provides step-by-step instructions to:
|
29 |
1. Install and set up the **Unsloth framework**.
|
30 |
+
2. Initialize the **Codellama 34b** model with **4-bit quantization**.
|
31 |
3. Implement **LoRA Adapters** for memory-efficient fine-tuning.
|
32 |
4. Prepare the **Andy-3.5 dataset** with Minecraft-specific knowledge.
|
33 |
5. Configure and execute training in a resource-efficient manner.
|