AirrStorm commited on
Commit
86ede6f
·
verified ·
1 Parent(s): e468a64

Final push of DistilBERT fine-tuned on IMDb.

Browse files
Files changed (1) hide show
  1. README.md +7 -7
README.md CHANGED
@@ -1,7 +1,7 @@
1
  ---
2
  library_name: transformers
3
  license: apache-2.0
4
- base_model: bert-base-cased
5
  tags:
6
  - generated_from_trainer
7
  model-index:
@@ -14,10 +14,10 @@ should probably proofread and complete it, then remove this comment. -->
14
 
15
  # DistilBERT-MLM-IMDb
16
 
17
- This model is a fine-tuned version of [bert-base-cased](https://huggingface.co/bert-base-cased) on an unknown dataset.
18
  It achieves the following results on the evaluation set:
19
- - Loss: 1.9568
20
- - Model Preparation Time: 0.0093
21
 
22
  ## Model description
23
 
@@ -49,9 +49,9 @@ The following hyperparameters were used during training:
49
 
50
  | Training Loss | Epoch | Step | Validation Loss | Model Preparation Time |
51
  |:-------------:|:-----:|:----:|:---------------:|:----------------------:|
52
- | 2.2075 | 1.0 | 985 | 2.0081 | 0.0093 |
53
- | 2.0945 | 2.0 | 1970 | 1.9688 | 0.0093 |
54
- | 2.0508 | 3.0 | 2955 | 1.9517 | 0.0093 |
55
 
56
 
57
  ### Framework versions
 
1
  ---
2
  library_name: transformers
3
  license: apache-2.0
4
+ base_model: distilbert-base-uncased
5
  tags:
6
  - generated_from_trainer
7
  model-index:
 
14
 
15
  # DistilBERT-MLM-IMDb
16
 
17
+ This model is a fine-tuned version of [distilbert-base-uncased](https://huggingface.co/distilbert-base-uncased) on an unknown dataset.
18
  It achieves the following results on the evaluation set:
19
+ - Loss: 2.2924
20
+ - Model Preparation Time: 0.0018
21
 
22
  ## Model description
23
 
 
49
 
50
  | Training Loss | Epoch | Step | Validation Loss | Model Preparation Time |
51
  |:-------------:|:-----:|:----:|:---------------:|:----------------------:|
52
+ | 2.5364 | 1.0 | 958 | 2.3577 | 0.0018 |
53
+ | 2.426 | 2.0 | 1916 | 2.3132 | 0.0018 |
54
+ | 2.3902 | 3.0 | 2874 | 2.2983 | 0.0018 |
55
 
56
 
57
  ### Framework versions