End of training

README.md

@@ -18,12 +18,7 @@ should probably proofread and complete it, then remove this comment. -->
 
 This model is a fine-tuned version of [meta-llama/Meta-Llama-3.1-70B](https://huggingface.co/meta-llama/Meta-Llama-3.1-70B) on the None dataset.
 It achieves the following results on the evaluation set:
-- eval_loss: 1.2995
-- eval_runtime: 124.5035
-- eval_samples_per_second: 0.723
-- eval_steps_per_second: 0.185
-- epoch: 1.28
-- step: 200
+- Loss: 1.2883
 
 ## Model description
 
@@ -51,9 +46,21 @@ The following hyperparameters were used during training:
 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
 - lr_scheduler_type: cosine
 - lr_scheduler_warmup_steps: 25
-- training_steps: 500
+- training_steps: 300
 - mixed_precision_training: Native AMP
 
+### Training results
+
+| Training Loss | Epoch | Step | Validation Loss |
+|:-------------:|:-----:|:----:|:---------------:|
+| 1.75          | 0.32  | 50   | 1.3528          |
+| 1.338         | 0.64  | 100  | 1.3195          |
+| 1.3357        | 0.96  | 150  | 1.2975          |
+| 1.2553        | 1.28  | 200  | 1.2956          |
+| 1.2688        | 1.6   | 250  | 1.2909          |
+| 1.2363        | 1.92  | 300  | 1.2883          |
+
+
 ### Framework versions
 
 - PEFT 0.12.0

adapter_config.json

@@ -20,8 +20,8 @@
   "rank_pattern": {},
   "revision": null,
   "target_modules": [
-    "v_proj",
-    "q_proj"
+    "q_proj",
+    "v_proj"
   ],
   "task_type": "CAUSAL_LM",
   "use_dora": false,

adapter_model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:672debd2cb4c939d4e47c9910fd263fcc50243a0dcaeac940407ad2dcd44d71b
+oid sha256:0cdaf3449d16bb48a737baeae4bbaf3a8d47b4f35272c407bbeea4c1af6e0eaa
 size 131115296

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:8eeed5698f354d81db4c64671883f61c1a25510decb8d161c9461bd0fa130b6b
+oid sha256:cfc7577160ce2b660a5a853fb8c289db4aabeeb09e4dcb494f6424ed4e9e60ad
 size 5368