Hugging Face's logo

underscore2
/
modernbert_agree_classifier

Text Classification
Transformers
TensorBoard
Safetensors
modernbert
Generated from Trainer
Model card Files Metrics Community
underscore2 commited on
Commit
97d1eb3
·
verified ·
1 Parent(s): ed61774

End of training

Browse files
Files changed (5) hide show
  1. README.md +14 -9
  2. model.safetensors +1 -1
  3. runs/May17_20-27-54_c37340e38ec4/events.out.tfevents.1747513676.c37340e38ec4.8723.0 +3 -0
  4. runs/May17_20-39-25_c37340e38ec4/events.out.tfevents.1747514371.c37340e38ec4.10890.0 +3 -0
  5. training_args.bin +1 -1
README.md CHANGED
@@ -18,8 +18,8 @@ should probably proofread and complete it, then remove this comment. -->
18
 
19
  This model is a fine-tuned version of [answerdotai/ModernBERT-large](https://huggingface.co/answerdotai/ModernBERT-large) on the None dataset.
20
  It achieves the following results on the evaluation set:
21
- - Loss: 0.5401
22
- - Accuracy: 0.7585
23
 
24
  ## Model description
25
 
@@ -38,24 +38,29 @@ More information needed
38
  ### Training hyperparameters
39
 
40
  The following hyperparameters were used during training:
41
- - learning_rate: 1e-05
42
  - train_batch_size: 4
43
  - eval_batch_size: 1
44
  - seed: 42
45
  - gradient_accumulation_steps: 3
46
  - total_train_batch_size: 12
47
  - optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
48
- - lr_scheduler_type: linear
49
- - num_epochs: 2
50
 
51
  ### Training results
52
 
53
  | Training Loss | Epoch | Step | Validation Loss | Accuracy |
54
  |:-------------:|:------:|:----:|:---------------:|:--------:|
55
- | 0.9351 | 0.4286 | 50 | 0.5700 | 0.7687 |
56
- | 1.0926 | 0.8571 | 100 | 0.5485 | 0.7687 |
57
- | 0.8075 | 1.2829 | 150 | 0.5362 | 0.7789 |
58
- | 1.578 | 1.7114 | 200 | 0.5401 | 0.7585 |
 
 
 
 
 
59
 
60
 
61
  ### Framework versions
 
18
 
19
  This model is a fine-tuned version of [answerdotai/ModernBERT-large](https://huggingface.co/answerdotai/ModernBERT-large) on the None dataset.
20
  It achieves the following results on the evaluation set:
21
+ - Loss: 0.5980
22
+ - Accuracy: 0.7721
23
 
24
  ## Model description
25
 
 
38
  ### Training hyperparameters
39
 
40
  The following hyperparameters were used during training:
41
+ - learning_rate: 6.000000000000001e-05
42
  - train_batch_size: 4
43
  - eval_batch_size: 1
44
  - seed: 42
45
  - gradient_accumulation_steps: 3
46
  - total_train_batch_size: 12
47
  - optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
48
+ - lr_scheduler_type: constant
49
+ - num_epochs: 4
50
 
51
  ### Training results
52
 
53
  | Training Loss | Epoch | Step | Validation Loss | Accuracy |
54
  |:-------------:|:------:|:----:|:---------------:|:--------:|
55
+ | 1.8275 | 0.4286 | 50 | 0.5879 | 0.7721 |
56
+ | 1.6712 | 0.8571 | 100 | 0.5567 | 0.7653 |
57
+ | 2.2032 | 1.2829 | 150 | 0.6964 | 0.4626 |
58
+ | 1.4726 | 1.7114 | 200 | 0.4985 | 0.7891 |
59
+ | 1.9443 | 2.1371 | 250 | 0.7351 | 0.4048 |
60
+ | 2.2852 | 2.5657 | 300 | 0.5546 | 0.7721 |
61
+ | 0.9394 | 2.9943 | 350 | 0.5533 | 0.7653 |
62
+ | 4.5893 | 3.42 | 400 | 0.6459 | 0.7925 |
63
+ | 1.466 | 3.8486 | 450 | 0.5980 | 0.7721 |
64
 
65
 
66
  ### Framework versions
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:6fa5c6132a395b9fe376201ecc5dded31c43334debd82a7ee5ee73dfa3b4f7b7
3
  size 1583351632
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1502b104c79235866afe186f34290ea47531be0ffc7717e13d14f6458f248444
3
  size 1583351632
runs/May17_20-27-54_c37340e38ec4/events.out.tfevents.1747513676.c37340e38ec4.8723.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a1637a0c91c49b51bb01adc9168a59e9251fc1f7a192967c91888a463e74a20e
3
+ size 55445
runs/May17_20-39-25_c37340e38ec4/events.out.tfevents.1747514371.c37340e38ec4.10890.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a5914e1bcb8119e9671a638750441d0c47b18f55076b33e6d005f86403e17611
3
+ size 106369
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:c990f0877f146ab646942a8cbad83b219b1bf1c3227ce58aef9694f9aef3995a
3
  size 5304
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e91441c0c7dd4b52b6bb2e5788206a09ed69315a0e06483db75ddb3e2246d539
3
  size 5304