Hugging Face's logo

scbtm
/
ModernBERT_wine_quality_reviews_ft

Text Classification
Transformers
TensorBoard
Safetensors
modernbert
Generated from Trainer
Model card Files Metrics Community
scbtm commited on
Commit
7b13af0
·
verified ·
1 Parent(s): fbe30e5

End of training

Browse files
Files changed (2) hide show
  1. README.md +122 -3
  2. model.safetensors +1 -1
README.md CHANGED
@@ -1,3 +1,122 @@
1
- ---
2
- license: mit
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ library_name: transformers
3
+ license: apache-2.0
4
+ base_model: answerdotai/ModernBERT-base
5
+ tags:
6
+ - generated_from_trainer
7
+ metrics:
8
+ - accuracy
9
+ - f1
10
+ model-index:
11
+ - name: ModernBERT_wine_quality_reviews_ft
12
+ results: []
13
+ ---
14
+
15
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
16
+ should probably proofread and complete it, then remove this comment. -->
17
+
18
+ # ModernBERT_wine_quality_reviews_ft
19
+
20
+ This model is a fine-tuned version of [answerdotai/ModernBERT-base](https://huggingface.co/answerdotai/ModernBERT-base) on the None dataset.
21
+ It achieves the following results on the evaluation set:
22
+ - Loss: 0.4820
23
+ - Accuracy: 0.7864
24
+ - F1: 0.6767
25
+
26
+ ## Model description
27
+
28
+ More information needed
29
+
30
+ ## Intended uses & limitations
31
+
32
+ More information needed
33
+
34
+ ## Training and evaluation data
35
+
36
+ More information needed
37
+
38
+ ## Training procedure
39
+
40
+ ### Training hyperparameters
41
+
42
+ The following hyperparameters were used during training:
43
+ - learning_rate: 8e-05
44
+ - train_batch_size: 32
45
+ - eval_batch_size: 32
46
+ - seed: 42
47
+ - optimizer: Use adamw_torch with betas=(0.9,0.98) and epsilon=1e-06 and optimizer_args=No additional optimizer arguments
48
+ - lr_scheduler_type: linear
49
+ - num_epochs: 3
50
+
51
+ ### Training results
52
+
53
+ | Training Loss | Epoch | Step | Validation Loss | Accuracy | F1 |
54
+ |:-------------:|:------:|:-----:|:---------------:|:--------:|:------:|
55
+ | 0.7593 | 0.0497 | 250 | 0.5938 | 0.7402 | 0.5293 |
56
+ | 0.6378 | 0.0993 | 500 | 0.6212 | 0.7308 | 0.5121 |
57
+ | 0.6001 | 0.1490 | 750 | 0.5726 | 0.7499 | 0.5482 |
58
+ | 0.5945 | 0.1987 | 1000 | 0.5661 | 0.7504 | 0.5390 |
59
+ | 0.5806 | 0.2484 | 1250 | 0.5519 | 0.7513 | 0.5693 |
60
+ | 0.6042 | 0.2980 | 1500 | 0.5528 | 0.7535 | 0.5945 |
61
+ | 0.5719 | 0.3477 | 1750 | 0.5290 | 0.7705 | 0.6045 |
62
+ | 0.5699 | 0.3974 | 2000 | 0.5247 | 0.7637 | 0.5958 |
63
+ | 0.5622 | 0.4470 | 2250 | 0.5318 | 0.7700 | 0.5960 |
64
+ | 0.5597 | 0.4967 | 2500 | 0.5344 | 0.7588 | 0.6152 |
65
+ | 0.5511 | 0.5464 | 2750 | 0.5767 | 0.7373 | 0.5459 |
66
+ | 0.5464 | 0.5961 | 3000 | 0.5078 | 0.7787 | 0.6460 |
67
+ | 0.5375 | 0.6457 | 3250 | 0.5029 | 0.7821 | 0.6175 |
68
+ | 0.5468 | 0.6954 | 3500 | 0.5027 | 0.7835 | 0.6312 |
69
+ | 0.5232 | 0.7451 | 3750 | 0.5053 | 0.7765 | 0.6365 |
70
+ | 0.5459 | 0.7948 | 4000 | 0.4983 | 0.7889 | 0.6723 |
71
+ | 0.5241 | 0.8444 | 4250 | 0.5092 | 0.7826 | 0.6751 |
72
+ | 0.5094 | 0.8941 | 4500 | 0.5215 | 0.7831 | 0.6233 |
73
+ | 0.5223 | 0.9438 | 4750 | 0.4986 | 0.7881 | 0.6243 |
74
+ | 0.5161 | 0.9934 | 5000 | 0.5013 | 0.7869 | 0.6205 |
75
+ | 0.4474 | 1.0431 | 5250 | 0.5010 | 0.7847 | 0.6689 |
76
+ | 0.4417 | 1.0928 | 5500 | 0.4923 | 0.7898 | 0.6251 |
77
+ | 0.4316 | 1.1425 | 5750 | 0.4968 | 0.7903 | 0.6950 |
78
+ | 0.4244 | 1.1921 | 6000 | 0.4958 | 0.7867 | 0.6950 |
79
+ | 0.4479 | 1.2418 | 6250 | 0.4952 | 0.7874 | 0.6864 |
80
+ | 0.4332 | 1.2915 | 6500 | 0.4957 | 0.7801 | 0.6741 |
81
+ | 0.4357 | 1.3411 | 6750 | 0.4887 | 0.7864 | 0.6397 |
82
+ | 0.439 | 1.3908 | 7000 | 0.5425 | 0.7654 | 0.6739 |
83
+ | 0.4298 | 1.4405 | 7250 | 0.4830 | 0.7864 | 0.6849 |
84
+ | 0.4345 | 1.4902 | 7500 | 0.4970 | 0.7821 | 0.6324 |
85
+ | 0.432 | 1.5398 | 7750 | 0.4890 | 0.7874 | 0.6772 |
86
+ | 0.433 | 1.5895 | 8000 | 0.4920 | 0.7893 | 0.6716 |
87
+ | 0.4364 | 1.6392 | 8250 | 0.5033 | 0.7818 | 0.6840 |
88
+ | 0.4196 | 1.6889 | 8500 | 0.4845 | 0.7886 | 0.6674 |
89
+ | 0.4199 | 1.7385 | 8750 | 0.5046 | 0.7814 | 0.6377 |
90
+ | 0.4121 | 1.7882 | 9000 | 0.5066 | 0.7845 | 0.6852 |
91
+ | 0.4222 | 1.8379 | 9250 | 0.4951 | 0.7852 | 0.6669 |
92
+ | 0.4217 | 1.8875 | 9500 | 0.4820 | 0.7864 | 0.6767 |
93
+ | 0.3973 | 1.9372 | 9750 | 0.4964 | 0.7872 | 0.7037 |
94
+ | 0.4297 | 1.9869 | 10000 | 0.4872 | 0.7840 | 0.6811 |
95
+ | 0.3039 | 2.0366 | 10250 | 0.6112 | 0.7755 | 0.6741 |
96
+ | 0.2271 | 2.0862 | 10500 | 0.6606 | 0.7797 | 0.6878 |
97
+ | 0.2149 | 2.1359 | 10750 | 0.6955 | 0.7736 | 0.6823 |
98
+ | 0.2202 | 2.1856 | 11000 | 0.7086 | 0.7772 | 0.6681 |
99
+ | 0.2226 | 2.2352 | 11250 | 0.6691 | 0.7743 | 0.6797 |
100
+ | 0.2162 | 2.2849 | 11500 | 0.6852 | 0.7741 | 0.6702 |
101
+ | 0.198 | 2.3346 | 11750 | 0.7187 | 0.7763 | 0.6592 |
102
+ | 0.2053 | 2.3843 | 12000 | 0.6847 | 0.7782 | 0.6816 |
103
+ | 0.2099 | 2.4339 | 12250 | 0.7302 | 0.7748 | 0.6789 |
104
+ | 0.214 | 2.4836 | 12500 | 0.7198 | 0.7726 | 0.6831 |
105
+ | 0.1938 | 2.5333 | 12750 | 0.7529 | 0.7741 | 0.6390 |
106
+ | 0.1959 | 2.5830 | 13000 | 0.7467 | 0.7724 | 0.6783 |
107
+ | 0.2012 | 2.6326 | 13250 | 0.7245 | 0.7736 | 0.6456 |
108
+ | 0.1915 | 2.6823 | 13500 | 0.7603 | 0.7678 | 0.6823 |
109
+ | 0.2 | 2.7320 | 13750 | 0.7175 | 0.7748 | 0.6795 |
110
+ | 0.1921 | 2.7816 | 14000 | 0.7458 | 0.7755 | 0.6809 |
111
+ | 0.1895 | 2.8313 | 14250 | 0.7607 | 0.7729 | 0.6603 |
112
+ | 0.1855 | 2.8810 | 14500 | 0.7625 | 0.7736 | 0.6705 |
113
+ | 0.1878 | 2.9307 | 14750 | 0.7598 | 0.7709 | 0.6707 |
114
+ | 0.1899 | 2.9803 | 15000 | 0.7604 | 0.7729 | 0.6714 |
115
+
116
+
117
+ ### Framework versions
118
+
119
+ - Transformers 4.48.0
120
+ - Pytorch 2.5.1+cu121
121
+ - Datasets 3.2.0
122
+ - Tokenizers 0.21.0
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:6f9e167d725ee61078a133d5aa9c2e7efd795c07fe593ccaf38ed12fa9e7fa02
3
  size 598445936
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c56132c943c728a05f5c6b5b6d3f4d07f92ab70231d7fd2606c7aa339dd1201b
3
  size 598445936