kbberendsen commited on
Commit
dd99175
·
verified ·
1 Parent(s): d7eb2ed

End of training

Browse files
README.md ADDED
@@ -0,0 +1,64 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: mit
3
+ base_model: microsoft/deberta-v3-base
4
+ tags:
5
+ - generated_from_trainer
6
+ metrics:
7
+ - matthews_correlation
8
+ model-index:
9
+ - name: deberta-v3-base-finetuned-cola-midterm
10
+ results: []
11
+ ---
12
+
13
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
14
+ should probably proofread and complete it, then remove this comment. -->
15
+
16
+ # deberta-v3-base-finetuned-cola-midterm
17
+
18
+ This model is a fine-tuned version of [microsoft/deberta-v3-base](https://huggingface.co/microsoft/deberta-v3-base) on an unknown dataset.
19
+ It achieves the following results on the evaluation set:
20
+ - Loss: 0.4382
21
+ - Matthews Correlation: 0.6943
22
+
23
+ ## Model description
24
+
25
+ More information needed
26
+
27
+ ## Intended uses & limitations
28
+
29
+ More information needed
30
+
31
+ ## Training and evaluation data
32
+
33
+ More information needed
34
+
35
+ ## Training procedure
36
+
37
+ ### Training hyperparameters
38
+
39
+ The following hyperparameters were used during training:
40
+ - learning_rate: 2e-05
41
+ - train_batch_size: 16
42
+ - eval_batch_size: 16
43
+ - seed: 42
44
+ - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
45
+ - lr_scheduler_type: linear
46
+ - num_epochs: 5
47
+
48
+ ### Training results
49
+
50
+ | Training Loss | Epoch | Step | Validation Loss | Matthews Correlation |
51
+ |:-------------:|:-----:|:----:|:---------------:|:--------------------:|
52
+ | 0.3901 | 1.0 | 535 | 0.3711 | 0.6257 |
53
+ | 0.2265 | 2.0 | 1070 | 0.4382 | 0.6943 |
54
+ | 0.1535 | 3.0 | 1605 | 0.6309 | 0.6652 |
55
+ | 0.0953 | 4.0 | 2140 | 0.7058 | 0.6774 |
56
+ | 0.0686 | 5.0 | 2675 | 0.6853 | 0.6924 |
57
+
58
+
59
+ ### Framework versions
60
+
61
+ - Transformers 4.38.1
62
+ - Pytorch 2.1.0+cu121
63
+ - Datasets 2.17.1
64
+ - Tokenizers 0.15.2
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:678cf18adec740355db3cd270a1dcafcde1ca9f77c194e475dd769b6122bfe5e
3
  size 737719272
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fa31017da0f88d2e65ee21b6b2adcf7e39c3f156ee5154f7690ecbca1f6b648f
3
  size 737719272
runs/Feb29_13-36-44_e1aa4b7a2e4c/events.out.tfevents.1709213877.e1aa4b7a2e4c.252.7 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:7ca5aa4469449ecdd953e7963c4a010729be2fd701aed0eeb868efe2b9c3cf8d
3
- size 5333
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c12a85aa918e027eb07417be73540d322f541eb30476748d76b7b10ce431f645
3
+ size 7871
runs/Feb29_13-36-44_e1aa4b7a2e4c/events.out.tfevents.1709214525.e1aa4b7a2e4c.252.8 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ef44b61e68e54a12bc740d4169b0bc5d6fcfd4361baa2fdea3415a2c86c7fc56
3
+ size 423