kostissz commited on
Commit
57e8e75
·
verified ·
1 Parent(s): 8544554

End of training

Browse files
README.md CHANGED
@@ -1,35 +1,80 @@
1
  ---
2
- base_model: openai/whisper-small
3
- datasets:
4
- - mozilla-foundation/common_voice_17_0
5
- language: el
6
  library_name: transformers
7
  license: apache-2.0
 
 
 
 
 
 
 
8
  model-index:
9
- - name: Finetuned openai/whisper-small on Greek
10
  results:
11
  - task:
 
12
  type: automatic-speech-recognition
13
- name: Speech-to-Text
14
  dataset:
15
- name: Common Voice (Greek)
16
- type: common_voice
 
 
 
17
  metrics:
18
- - type: wer
19
- value: 30.644
 
20
  ---
21
 
22
- # Finetuned openai/whisper-small on 3620 Greek training audio samples from mozilla-foundation/common_voice_17_0.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
23
 
24
- This model was created from the Mozilla.ai Blueprint:
25
- [speech-to-text-finetune](https://github.com/mozilla-ai/speech-to-text-finetune).
 
 
26
 
27
- ## Evaluation results on 1701 audio samples of Greek:
28
 
29
- ### Baseline model (before finetuning) on Greek
30
- - Word Error Rate: 46.401
31
- - Loss: 0.902
32
 
33
- ### Finetuned model (after finetuning) on Greek
34
- - Word Error Rate: 30.644
35
- - Loss: 0.387
 
 
1
  ---
 
 
 
 
2
  library_name: transformers
3
  license: apache-2.0
4
+ base_model: openai/whisper-small
5
+ tags:
6
+ - generated_from_trainer
7
+ datasets:
8
+ - common_voice_17_0
9
+ metrics:
10
+ - wer
11
  model-index:
12
+ - name: whisper-small-el
13
  results:
14
  - task:
15
+ name: Automatic Speech Recognition
16
  type: automatic-speech-recognition
 
17
  dataset:
18
+ name: common_voice_17_0
19
+ type: common_voice_17_0
20
+ config: el
21
+ split: None
22
+ args: el
23
  metrics:
24
+ - name: Wer
25
+ type: wer
26
+ value: 45.63223714682724
27
  ---
28
 
29
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
30
+ should probably proofread and complete it, then remove this comment. -->
31
+
32
+ # whisper-small-el
33
+
34
+ This model is a fine-tuned version of [openai/whisper-small](https://huggingface.co/openai/whisper-small) on the common_voice_17_0 dataset.
35
+ It achieves the following results on the evaluation set:
36
+ - Loss: 0.8687
37
+ - Model Preparation Time: 0.0059
38
+ - Wer: 45.6322
39
+
40
+ ## Model description
41
+
42
+ More information needed
43
+
44
+ ## Intended uses & limitations
45
+
46
+ More information needed
47
+
48
+ ## Training and evaluation data
49
+
50
+ More information needed
51
+
52
+ ## Training procedure
53
+
54
+ ### Training hyperparameters
55
+
56
+ The following hyperparameters were used during training:
57
+ - learning_rate: 1e-05
58
+ - train_batch_size: 32
59
+ - eval_batch_size: 8
60
+ - seed: 42
61
+ - optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
62
+ - lr_scheduler_type: linear
63
+ - lr_scheduler_warmup_steps: 50
64
+ - training_steps: 14
65
+ - mixed_precision_training: Native AMP
66
+
67
+ ### Training results
68
 
69
+ | Training Loss | Epoch | Step | Validation Loss | Model Preparation Time | Wer |
70
+ |:-------------:|:------:|:----:|:---------------:|:----------------------:|:-------:|
71
+ | 0.8509 | 0.0439 | 5 | 0.9019 | 0.0059 | 46.4382 |
72
+ | 0.8082 | 0.0877 | 10 | 0.8687 | 0.0059 | 45.6322 |
73
 
 
74
 
75
+ ### Framework versions
 
 
76
 
77
+ - Transformers 4.48.3
78
+ - Pytorch 2.5.1+cu124
79
+ - Datasets 3.3.1
80
+ - Tokenizers 0.21.0
generation_config.json CHANGED
@@ -250,5 +250,5 @@
250
  "transcribe": 50359,
251
  "translate": 50358
252
  },
253
- "transformers_version": "4.48.0"
254
  }
 
250
  "transcribe": 50359,
251
  "translate": 50358
252
  },
253
+ "transformers_version": "4.48.3"
254
  }
runs/Feb18_15-35-04_52522ad1ab90/events.out.tfevents.1739893609.52522ad1ab90.3137.0 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:3da2e1d6e2bb45ad184fda99d9bbfb84cf1dd210a955de4f31eb325b4277df25
3
- size 8339
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:eec942918fc9ef8e2969fcb689088c21d029529edee660e7a46d1e23218b1676
3
+ size 8687
runs/Feb18_15-35-04_52522ad1ab90/events.out.tfevents.1739896002.52522ad1ab90.3137.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c8d0e220299c86321faf4bf443c7a01c59bbdc8ff029be1d1e41f2937119ff8e
3
+ size 465