jackson176/distilbert-base-uncased-lora-text-classification

README.md

@@ -18,8 +18,8 @@ should probably proofread and complete it, then remove this comment. -->
 
 This model is a fine-tuned version of [distilbert-base-uncased](https://huggingface.co/distilbert-base-uncased) on an unknown dataset.
 It achieves the following results on the evaluation set:
-- Loss: 0.8708
-- Accuracy: {'accuracy': 0.889}
+- Loss: 0.9401
+- Accuracy: {'accuracy': 0.894}
 
 ## Model description
 
@@ -50,16 +50,16 @@ The following hyperparameters were used during training:
 
 | Training Loss | Epoch | Step | Validation Loss | Accuracy            |
 |:-------------:|:-----:|:----:|:---------------:|:-------------------:|
-| No log        | 1.0   | 250  | 0.4069          | {'accuracy': 0.88}  |
-| 0.4415        | 2.0   | 500  | 0.4389          | {'accuracy': 0.879} |
-| 0.4415        | 3.0   | 750  | 0.4952          | {'accuracy': 0.888} |
-| 0.2037        | 4.0   | 1000 | 0.5850          | {'accuracy': 0.885} |
-| 0.2037        | 5.0   | 1250 | 0.7044          | {'accuracy': 0.886} |
-| 0.0736        | 6.0   | 1500 | 0.7356          | {'accuracy': 0.884} |
-| 0.0736        | 7.0   | 1750 | 0.7758          | {'accuracy': 0.889} |
-| 0.0186        | 8.0   | 2000 | 0.8229          | {'accuracy': 0.893} |
-| 0.0186        | 9.0   | 2250 | 0.8541          | {'accuracy': 0.886} |
-| 0.008         | 10.0  | 2500 | 0.8708          | {'accuracy': 0.889} |
+| No log        | 1.0   | 250  | 0.4820          | {'accuracy': 0.871} |
+| 0.4484        | 2.0   | 500  | 0.5434          | {'accuracy': 0.858} |
+| 0.4484        | 3.0   | 750  | 0.7357          | {'accuracy': 0.853} |
+| 0.2071        | 4.0   | 1000 | 0.5956          | {'accuracy': 0.899} |
+| 0.2071        | 5.0   | 1250 | 0.8141          | {'accuracy': 0.88}  |
+| 0.0731        | 6.0   | 1500 | 0.8197          | {'accuracy': 0.882} |
+| 0.0731        | 7.0   | 1750 | 0.9412          | {'accuracy': 0.888} |
+| 0.0201        | 8.0   | 2000 | 0.9169          | {'accuracy': 0.894} |
+| 0.0201        | 9.0   | 2250 | 0.9390          | {'accuracy': 0.892} |
+| 0.0111        | 10.0  | 2500 | 0.9401          | {'accuracy': 0.894} |
 
 
 ### Framework versions

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:92a30ebe643aa14f75668e16889cfd1b33ac4e6204e319d6530e3c2915917fbd
+oid sha256:9e78a6dd0513f381b5a362b01278a63b73f2780020493a18050fa51953922e5f
 size 4920