Hugging Face's logo

WillLoki
/
distilbert-base-uncased-lora-text-classification

Text Classification
PEFT
TensorBoard
Safetensors
Generated from Trainer
Model card Files Metrics Community
WillLoki commited on
Commit
aaff8e2
·
verified ·
1 Parent(s): 3ada8f9

WillLoki/distilbert-base-uncased-lora-text-classification

Browse files
Files changed (14) hide show
  1. README.md +12 -12
  2. runs/Mar03_14-15-28_56c03969b1e0/events.out.tfevents.1741011331.56c03969b1e0.1882.0 +3 -0
  3. runs/Mar03_14-15-28_56c03969b1e0/events.out.tfevents.1741011989.56c03969b1e0.1882.1 +3 -0
  4. runs/Mar03_14-37-52_56c03969b1e0/events.out.tfevents.1741012674.56c03969b1e0.1882.2 +3 -0
  5. runs/Mar03_14-37-52_56c03969b1e0/events.out.tfevents.1741013271.56c03969b1e0.1882.3 +3 -0
  6. runs/Mar03_14-37-52_56c03969b1e0/events.out.tfevents.1741014583.56c03969b1e0.1882.4 +3 -0
  7. runs/Mar03_15-22-45_56c03969b1e0/events.out.tfevents.1741015367.56c03969b1e0.1882.5 +3 -0
  8. runs/Mar03_15-22-45_56c03969b1e0/events.out.tfevents.1741015981.56c03969b1e0.1882.6 +3 -0
  9. runs/Mar03_15-22-45_56c03969b1e0/events.out.tfevents.1741016539.56c03969b1e0.1882.7 +3 -0
  10. runs/Mar03_16-05-36_56c03969b1e0/events.out.tfevents.1741017936.56c03969b1e0.1882.8 +3 -0
  11. runs/Mar03_16-05-36_56c03969b1e0/events.out.tfevents.1741019127.56c03969b1e0.1882.9 +3 -0
  12. runs/Mar03_16-05-36_56c03969b1e0/events.out.tfevents.1741020553.56c03969b1e0.1882.10 +3 -0
  13. tokenizer_config.json +1 -0
  14. training_args.bin +1 -1
README.md CHANGED
@@ -18,8 +18,8 @@ should probably proofread and complete it, then remove this comment. -->
18
 
19
  This model is a fine-tuned version of [distilbert-base-uncased](https://huggingface.co/distilbert-base-uncased) on the None dataset.
20
  It achieves the following results on the evaluation set:
21
- - Loss: 0.4675
22
- - Accuracy: {'accuracy': 0.885}
23
 
24
  ## Model description
25
 
@@ -50,16 +50,16 @@ The following hyperparameters were used during training:
50
 
51
  | Training Loss | Epoch | Step | Validation Loss | Accuracy |
52
  |:-------------:|:-----:|:----:|:---------------:|:-------------------:|
53
- | No log | 1.0 | 250 | 0.5274 | {'accuracy': 0.874} |
54
- | 0.2336 | 2.0 | 500 | 0.4621 | {'accuracy': 0.873} |
55
- | 0.2336 | 3.0 | 750 | 0.5047 | {'accuracy': 0.874} |
56
- | 0.2293 | 4.0 | 1000 | 0.4725 | {'accuracy': 0.884} |
57
- | 0.2293 | 5.0 | 1250 | 0.4214 | {'accuracy': 0.881} |
58
- | 0.2034 | 6.0 | 1500 | 0.4845 | {'accuracy': 0.866} |
59
- | 0.2034 | 7.0 | 1750 | 0.4923 | {'accuracy': 0.875} |
60
- | 0.1519 | 8.0 | 2000 | 0.4627 | {'accuracy': 0.886} |
61
- | 0.1519 | 9.0 | 2250 | 0.4626 | {'accuracy': 0.888} |
62
- | 0.1232 | 10.0 | 2500 | 0.4675 | {'accuracy': 0.885} |
63
 
64
 
65
  ### Framework versions
 
18
 
19
  This model is a fine-tuned version of [distilbert-base-uncased](https://huggingface.co/distilbert-base-uncased) on the None dataset.
20
  It achieves the following results on the evaluation set:
21
+ - Loss: 1.1903
22
+ - Accuracy: {'accuracy': 0.891}
23
 
24
  ## Model description
25
 
 
50
 
51
  | Training Loss | Epoch | Step | Validation Loss | Accuracy |
52
  |:-------------:|:-----:|:----:|:---------------:|:-------------------:|
53
+ | No log | 1.0 | 250 | 0.5397 | {'accuracy': 0.862} |
54
+ | 0.2457 | 2.0 | 500 | 1.2690 | {'accuracy': 0.839} |
55
+ | 0.2457 | 3.0 | 750 | 0.8730 | {'accuracy': 0.852} |
56
+ | 0.1492 | 4.0 | 1000 | 0.9712 | {'accuracy': 0.881} |
57
+ | 0.1492 | 5.0 | 1250 | 1.1036 | {'accuracy': 0.861} |
58
+ | 0.0561 | 6.0 | 1500 | 1.0834 | {'accuracy': 0.895} |
59
+ | 0.0561 | 7.0 | 1750 | 1.1282 | {'accuracy': 0.89} |
60
+ | 0.0177 | 8.0 | 2000 | 1.1094 | {'accuracy': 0.887} |
61
+ | 0.0177 | 9.0 | 2250 | 1.1538 | {'accuracy': 0.887} |
62
+ | 0.0017 | 10.0 | 2500 | 1.1903 | {'accuracy': 0.891} |
63
 
64
 
65
  ### Framework versions
runs/Mar03_14-15-28_56c03969b1e0/events.out.tfevents.1741011331.56c03969b1e0.1882.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a5a92475ceb41ffeee94fd7eaa6faa5dd8b0fd9bc24cfa9ed9c81cd7d6ad96d2
3
+ size 9274
runs/Mar03_14-15-28_56c03969b1e0/events.out.tfevents.1741011989.56c03969b1e0.1882.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8b56a947b0526893a6a9f0d4377c15917cd47bb2fbc9e23050872dbe0af4d7ee
3
+ size 9323
runs/Mar03_14-37-52_56c03969b1e0/events.out.tfevents.1741012674.56c03969b1e0.1882.2 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2ddc123b9111dd50d9f025825ace25e8f36e2ca639664817662a3ae629439d1c
3
+ size 9274
runs/Mar03_14-37-52_56c03969b1e0/events.out.tfevents.1741013271.56c03969b1e0.1882.3 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:955fa5b637717177977ae806c87eeae47e28d1bf1ceef12f2a49ee8804dc6c65
3
+ size 9323
runs/Mar03_14-37-52_56c03969b1e0/events.out.tfevents.1741014583.56c03969b1e0.1882.4 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a1422803dc7b7e32f08debbeb20364990a6ab506a0c8fcbeebc472448accd62a
3
+ size 9323
runs/Mar03_15-22-45_56c03969b1e0/events.out.tfevents.1741015367.56c03969b1e0.1882.5 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a495ad33436c928da0be37a5c287784bac3cde3b1e9dc1f158b164f7000d44d5
3
+ size 9274
runs/Mar03_15-22-45_56c03969b1e0/events.out.tfevents.1741015981.56c03969b1e0.1882.6 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ba151d5deb3860c32452ebbb2472329c6a3901aba9b21aa741ffe886ed52001d
3
+ size 9323
runs/Mar03_15-22-45_56c03969b1e0/events.out.tfevents.1741016539.56c03969b1e0.1882.7 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b8d3f9c097615a9fc4a7577b36da2f0abca28052600156df040c95d46fed38da
3
+ size 9323
runs/Mar03_16-05-36_56c03969b1e0/events.out.tfevents.1741017936.56c03969b1e0.1882.8 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d79f856752f6967f8d423e18158999e338f83c5f18e4bfed81d35bc98a307213
3
+ size 9274
runs/Mar03_16-05-36_56c03969b1e0/events.out.tfevents.1741019127.56c03969b1e0.1882.9 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a3ead42372f72165813c08f7a81eda154a522246ea929e1c06e167aeedc3ec83
3
+ size 9323
runs/Mar03_16-05-36_56c03969b1e0/events.out.tfevents.1741020553.56c03969b1e0.1882.10 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:208fd7b62012a484f63c5b51ab5ae31fddc25a5bb7c8fd25edcc39c4f57d7274
3
+ size 9323
tokenizer_config.json CHANGED
@@ -1,4 +1,5 @@
1
  {
 
2
  "added_tokens_decoder": {
3
  "0": {
4
  "content": "[PAD]",
 
1
  {
2
+ "add_prefix_space": true,
3
  "added_tokens_decoder": {
4
  "0": {
5
  "content": "[PAD]",
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:31235710e183ee1c62881989503809c68d9bf825e9d861666ff780b14c9e2055
3
  size 5432
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c807c3220ad26920aac509a480ba1b3f92d62fb7572fd2de69c83f6324dcb0c2
3
  size 5432