WillLoki/distilbert-base-uncased-lora-text-classification

README.md

@@ -18,8 +18,8 @@ should probably proofread and complete it, then remove this comment. -->
 
 This model is a fine-tuned version of [distilbert-base-uncased](https://huggingface.co/distilbert-base-uncased) on the None dataset.
 It achieves the following results on the evaluation set:
-- Loss: 1.1903
-- Accuracy: {'accuracy': 0.891}
+- Loss: 1.0335
+- Accuracy: {'accuracy': 0.889}
 
 ## Model description
 
@@ -50,16 +50,16 @@ The following hyperparameters were used during training:
 
 | Training Loss | Epoch | Step | Validation Loss | Accuracy            |
 |:-------------:|:-----:|:----:|:---------------:|:-------------------:|
-| No log        | 1.0   | 250  | 0.5397          | {'accuracy': 0.862} |
-| 0.2457        | 2.0   | 500  | 1.2690          | {'accuracy': 0.839} |
-| 0.2457        | 3.0   | 750  | 0.8730          | {'accuracy': 0.852} |
-| 0.1492        | 4.0   | 1000 | 0.9712          | {'accuracy': 0.881} |
-| 0.1492        | 5.0   | 1250 | 1.1036          | {'accuracy': 0.861} |
-| 0.0561        | 6.0   | 1500 | 1.0834          | {'accuracy': 0.895} |
-| 0.0561        | 7.0   | 1750 | 1.1282          | {'accuracy': 0.89}  |
-| 0.0177        | 8.0   | 2000 | 1.1094          | {'accuracy': 0.887} |
-| 0.0177        | 9.0   | 2250 | 1.1538          | {'accuracy': 0.887} |
-| 0.0017        | 10.0  | 2500 | 1.1903          | {'accuracy': 0.891} |
+| No log        | 1.0   | 250  | 0.7278          | {'accuracy': 0.833} |
+| 0.358         | 2.0   | 500  | 0.6268          | {'accuracy': 0.852} |
+| 0.358         | 3.0   | 750  | 0.6568          | {'accuracy': 0.872} |
+| 0.1873        | 4.0   | 1000 | 0.7663          | {'accuracy': 0.883} |
+| 0.1873        | 5.0   | 1250 | 0.7704          | {'accuracy': 0.877} |
+| 0.0437        | 6.0   | 1500 | 0.8981          | {'accuracy': 0.893} |
+| 0.0437        | 7.0   | 1750 | 0.9872          | {'accuracy': 0.886} |
+| 0.0148        | 8.0   | 2000 | 1.0022          | {'accuracy': 0.888} |
+| 0.0148        | 9.0   | 2250 | 1.0471          | {'accuracy': 0.892} |
+| 0.0006        | 10.0  | 2500 | 1.0335          | {'accuracy': 0.889} |
 
 
 ### Framework versions

runs/Mar04_02-45-32_7157d4ee19a0/events.out.tfevents.1741056335.7157d4ee19a0.1159.0

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5e57110de92fd5af8011d3f074cc8fcc45596e86204b379e0d15be464712fa39
+size 9274

runs/Mar04_02-45-32_7157d4ee19a0/events.out.tfevents.1741057738.7157d4ee19a0.1159.1

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:26165070391d9599d41072c39ce8a434a81881f93ad9bca7006044b4ba83ae5b
+size 9323

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:c807c3220ad26920aac509a480ba1b3f92d62fb7572fd2de69c83f6324dcb0c2
+oid sha256:e5c07887cd5f730fb59f90528c549fbfde80ebcbe24340c6b4dc595f9f0adbd3
 size 5432