moro01525 commited on
Commit
7bb152e
·
verified ·
1 Parent(s): d95ad0d

Versione 1 epoch

Browse files
README.md CHANGED
@@ -1,6 +1,6 @@
1
  ---
2
  license: apache-2.0
3
- base_model: moro01525/BERT_MLM
4
  tags:
5
  - generated_from_trainer
6
  model-index:
@@ -13,7 +13,7 @@ should probably proofread and complete it, then remove this comment. -->
13
 
14
  # BERT_MLM
15
 
16
- This model is a fine-tuned version of [moro01525/BERT_MLM](https://huggingface.co/moro01525/BERT_MLM) on an unknown dataset.
17
 
18
  ## Model description
19
 
@@ -32,7 +32,7 @@ More information needed
32
  ### Training hyperparameters
33
 
34
  The following hyperparameters were used during training:
35
- - learning_rate: 0.0001
36
  - train_batch_size: 8
37
  - eval_batch_size: 4
38
  - seed: 42
 
1
  ---
2
  license: apache-2.0
3
+ base_model: distilbert/distilbert-base-uncased
4
  tags:
5
  - generated_from_trainer
6
  model-index:
 
13
 
14
  # BERT_MLM
15
 
16
+ This model is a fine-tuned version of [distilbert/distilbert-base-uncased](https://huggingface.co/distilbert/distilbert-base-uncased) on an unknown dataset.
17
 
18
  ## Model description
19
 
 
32
  ### Training hyperparameters
33
 
34
  The following hyperparameters were used during training:
35
+ - learning_rate: 0.0002
36
  - train_batch_size: 8
37
  - eval_batch_size: 4
38
  - seed: 42
config.json CHANGED
@@ -1,5 +1,5 @@
1
  {
2
- "_name_or_path": "moro01525/BERT_MLM",
3
  "activation": "gelu",
4
  "architectures": [
5
  "DistilBertForMaskedLM"
 
1
  {
2
+ "_name_or_path": "distilbert/distilbert-base-uncased",
3
  "activation": "gelu",
4
  "architectures": [
5
  "DistilBertForMaskedLM"
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:5606072a6c56b6c46b552e65e4fd2d93d00184a40c7c3dfd7d21a5ef73888ea6
3
  size 267954768
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:417e7ffdff07acff4345d69ce9d6da9cb1e31238a03bf3f1c336db192b270bc2
3
  size 267954768
runs/Jul23_08-58-37_90dbed34a13e/events.out.tfevents.1721725124.90dbed34a13e.867.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:946a4479b3663fe4ed638146adda55cf2f3471c40505429ff1bf33e9d031c86f
3
+ size 15391
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:1cdd0403aa791c2388905859f7ad88315a040e6656821d02861e3b0144b2b499
3
  size 5176
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4caa973c086811eadfdf003582e16c44ea403dc7e4e73a3f4ab68756847b608c
3
  size 5176