Hugging Face's logo

underscore2
/
modernbert_agree_classifier

Text Classification
Transformers
TensorBoard
Safetensors
modernbert
Generated from Trainer
Model card Files Metrics Community
underscore2 commited on
Commit
ed61774
·
verified ·
1 Parent(s): ba30f2a

End of training

Browse files
Files changed (6) hide show
  1. README.md +12 -13
  2. model.safetensors +1 -1
  3. runs/May17_20-05-45_c37340e38ec4/events.out.tfevents.1747512350.c37340e38ec4.561.0 +3 -0
  4. runs/May17_20-10-59_c37340e38ec4/events.out.tfevents.1747512662.c37340e38ec4.3704.0 +3 -0
  5. runs/May17_20-14-29_c37340e38ec4/events.out.tfevents.1747512873.c37340e38ec4.5142.0 +3 -0
  6. training_args.bin +1 -1
README.md CHANGED
@@ -18,8 +18,8 @@ should probably proofread and complete it, then remove this comment. -->
18
 
19
  This model is a fine-tuned version of [answerdotai/ModernBERT-large](https://huggingface.co/answerdotai/ModernBERT-large) on the None dataset.
20
  It achieves the following results on the evaluation set:
21
- - Loss: 0.0220
22
- - Accuracy: 0.9976
23
 
24
  ## Model description
25
 
@@ -38,25 +38,24 @@ More information needed
38
  ### Training hyperparameters
39
 
40
  The following hyperparameters were used during training:
41
- - learning_rate: 5.7142857142857145e-06
42
- - train_batch_size: 8
43
- - eval_batch_size: 2
44
  - seed: 42
 
 
45
  - optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
46
  - lr_scheduler_type: linear
47
- - training_steps: 350
48
 
49
  ### Training results
50
 
51
  | Training Loss | Epoch | Step | Validation Loss | Accuracy |
52
  |:-------------:|:------:|:----:|:---------------:|:--------:|
53
- | 0.2296 | 0.0597 | 50 | 0.3606 | 0.8215 |
54
- | 0.1907 | 0.1193 | 100 | 0.1346 | 0.9560 |
55
- | 0.0002 | 0.1790 | 150 | 0.1403 | 0.9756 |
56
- | 0.0002 | 0.2387 | 200 | 0.0695 | 0.9804 |
57
- | 0.0006 | 0.2983 | 250 | 0.0290 | 0.9853 |
58
- | 0.0 | 0.3580 | 300 | 0.0209 | 0.9976 |
59
- | 0.0 | 0.4177 | 350 | 0.0220 | 0.9976 |
60
 
61
 
62
  ### Framework versions
 
18
 
19
  This model is a fine-tuned version of [answerdotai/ModernBERT-large](https://huggingface.co/answerdotai/ModernBERT-large) on the None dataset.
20
  It achieves the following results on the evaluation set:
21
+ - Loss: 0.5401
22
+ - Accuracy: 0.7585
23
 
24
  ## Model description
25
 
 
38
  ### Training hyperparameters
39
 
40
  The following hyperparameters were used during training:
41
+ - learning_rate: 1e-05
42
+ - train_batch_size: 4
43
+ - eval_batch_size: 1
44
  - seed: 42
45
+ - gradient_accumulation_steps: 3
46
+ - total_train_batch_size: 12
47
  - optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
48
  - lr_scheduler_type: linear
49
+ - num_epochs: 2
50
 
51
  ### Training results
52
 
53
  | Training Loss | Epoch | Step | Validation Loss | Accuracy |
54
  |:-------------:|:------:|:----:|:---------------:|:--------:|
55
+ | 0.9351 | 0.4286 | 50 | 0.5700 | 0.7687 |
56
+ | 1.0926 | 0.8571 | 100 | 0.5485 | 0.7687 |
57
+ | 0.8075 | 1.2829 | 150 | 0.5362 | 0.7789 |
58
+ | 1.578 | 1.7114 | 200 | 0.5401 | 0.7585 |
 
 
 
59
 
60
 
61
  ### Framework versions
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:c36ea6a5cf431110fce0c1fc8adb98c8abb57ca65bf9120476edf5cca5d3ccea
3
  size 1583351632
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6fa5c6132a395b9fe376201ecc5dded31c43334debd82a7ee5ee73dfa3b4f7b7
3
  size 1583351632
runs/May17_20-05-45_c37340e38ec4/events.out.tfevents.1747512350.c37340e38ec4.561.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:28d165c5944fb1172c0ff1e1a2af7bf041067ead1aef086105785510539bb4c5
3
+ size 8415
runs/May17_20-10-59_c37340e38ec4/events.out.tfevents.1747512662.c37340e38ec4.3704.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ef97e81f61d72ffad5e329c716ffa4eae1be7d6f445ba0135507bdeff53227e0
3
+ size 17840
runs/May17_20-14-29_c37340e38ec4/events.out.tfevents.1747512873.c37340e38ec4.5142.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6cd83e0f1fa96c069a3583bb9ce2e877474c55b00020194594daf189f38239cd
3
+ size 55782
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:597e9e0b7c51b75c73c727590e13a469dcc3ecc9d8aad15eff61c58a670242f2
3
  size 5304
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c990f0877f146ab646942a8cbad83b219b1bf1c3227ce58aef9694f9aef3995a
3
  size 5304