Jsevisal commited on
Commit
ee62985
·
verified ·
1 Parent(s): a255210

Model save

Browse files
Files changed (3) hide show
  1. README.md +62 -11
  2. model.safetensors +1 -1
  3. tokenizer.json +1 -6
README.md CHANGED
@@ -1,14 +1,65 @@
1
  ---
2
- datasets:
3
- - Jsevisal/go_emotions_ekman
4
- language:
5
- - en
 
6
  metrics:
7
- - accuracy
8
  - f1
9
- - roc_auc
10
- pipeline_tag: text-classification
11
- base_model:
12
- - answerdotai/ModernBERT-base
13
- library_name: transformers
14
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ library_name: transformers
3
+ license: apache-2.0
4
+ base_model: answerdotai/ModernBERT-base
5
+ tags:
6
+ - generated_from_trainer
7
  metrics:
 
8
  - f1
9
+ - accuracy
10
+ model-index:
11
+ - name: ModernEMO-base
12
+ results: []
13
+ ---
14
+
15
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
16
+ should probably proofread and complete it, then remove this comment. -->
17
+
18
+ # ModernEMO-base
19
+
20
+ This model is a fine-tuned version of [answerdotai/ModernBERT-base](https://huggingface.co/answerdotai/ModernBERT-base) on an unknown dataset.
21
+ It achieves the following results on the evaluation set:
22
+ - Loss: 0.2224
23
+ - F1: 0.7037
24
+ - Roc Auc: 0.8143
25
+ - Accuracy: 0.6226
26
+
27
+ ## Model description
28
+
29
+ More information needed
30
+
31
+ ## Intended uses & limitations
32
+
33
+ More information needed
34
+
35
+ ## Training and evaluation data
36
+
37
+ More information needed
38
+
39
+ ## Training procedure
40
+
41
+ ### Training hyperparameters
42
+
43
+ The following hyperparameters were used during training:
44
+ - learning_rate: 8e-05
45
+ - train_batch_size: 16
46
+ - eval_batch_size: 16
47
+ - seed: 42
48
+ - optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.98) and epsilon=1e-06 and optimizer_args=No additional optimizer arguments
49
+ - lr_scheduler_type: linear
50
+ - num_epochs: 2
51
+
52
+ ### Training results
53
+
54
+ | Training Loss | Epoch | Step | Validation Loss | F1 | Roc Auc | Accuracy |
55
+ |:-------------:|:-----:|:----:|:---------------:|:------:|:-------:|:--------:|
56
+ | 0.2162 | 1.0 | 2714 | 0.2049 | 0.6920 | 0.7979 | 0.6010 |
57
+ | 0.1553 | 2.0 | 5428 | 0.2224 | 0.7037 | 0.8143 | 0.6226 |
58
+
59
+
60
+ ### Framework versions
61
+
62
+ - Transformers 4.49.0.dev0
63
+ - Pytorch 2.5.1+cu124
64
+ - Datasets 3.2.0
65
+ - Tokenizers 0.21.0
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:9ef3c90d7a78d881b279c8c21ada25873ca6633594c8f8ca34842a37a15e124f
3
  size 598455164
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:49477a8674a736e164c40cc9b1ce84b25cf79b6827ef2491b8e8f568d93f4c4a
3
  size 598455164
tokenizer.json CHANGED
@@ -1,11 +1,6 @@
1
  {
2
  "version": "1.0",
3
- "truncation": {
4
- "direction": "Right",
5
- "max_length": 8192,
6
- "strategy": "LongestFirst",
7
- "stride": 0
8
- },
9
  "padding": null,
10
  "added_tokens": [
11
  {
 
1
  {
2
  "version": "1.0",
3
+ "truncation": null,
 
 
 
 
 
4
  "padding": null,
5
  "added_tokens": [
6
  {