Hugging Face's logo

Spaces:
ivrit-ai
/
hebrew-transcription-leaderboard
Running

App Files Community
1
benderrodriguez commited on
Commit
5985572
·
1 Parent(s): 59a1c27

Updated results after better normalization.

Browse files
Files changed (36) hide show
  1. benchmark.csv +7 -7
  2. results/amazon-transcribe-batch/common_voice_17.csv +0 -0
  3. results/amazon-transcribe-batch/fleurs.csv +0 -0
  4. results/amazon-transcribe-batch/hebrew_speech_kan.csv +0 -0
  5. results/amazon-transcribe-batch/ivrit_ai_eval_d1.csv +0 -0
  6. results/amazon-transcribe-batch/saspeech.csv +0 -0
  7. results/amazon-transcribe-stream/common_voice_17.csv +0 -0
  8. results/amazon-transcribe-stream/fleurs.csv +0 -0
  9. results/amazon-transcribe-stream/hebrew_speech_kan.csv +0 -0
  10. results/amazon-transcribe-stream/ivrit_ai_eval_d1.csv +0 -0
  11. results/amazon-transcribe-stream/saspeech.csv +0 -0
  12. results/faster-whisper-ivrit-ai-v2-d3-e3/common_voice_17.csv +0 -0
  13. results/faster-whisper-ivrit-ai-v2-d3-e3/fleurs.csv +0 -0
  14. results/faster-whisper-ivrit-ai-v2-d3-e3/hebrew_speech_kan.csv +0 -0
  15. results/faster-whisper-ivrit-ai-v2-d3-e3/ivrit_ai_eval_d1.csv +0 -0
  16. results/faster-whisper-ivrit-ai-v2-d3-e3/saspeech.csv +0 -0
  17. results/faster-whisper-ivrit-ai-v2-d4/common_voice_17.csv +0 -0
  18. results/faster-whisper-ivrit-ai-v2-d4/fleurs.csv +0 -0
  19. results/faster-whisper-ivrit-ai-v2-d4/hebrew_speech_kan.csv +0 -0
  20. results/faster-whisper-ivrit-ai-v2-d4/ivrit_ai_eval_d1.csv +0 -0
  21. results/faster-whisper-ivrit-ai-v2-d4/saspeech.csv +0 -0
  22. results/faster-whisper-large-v2/common_voice_17.csv +0 -0
  23. results/faster-whisper-large-v2/fleurs.csv +0 -0
  24. results/faster-whisper-large-v2/hebrew_speech_kan.csv +0 -0
  25. results/faster-whisper-large-v2/ivrit_ai_eval_d1.csv +0 -0
  26. results/faster-whisper-large-v2/saspeech.csv +0 -0
  27. results/faster-whisper-large-v3/common_voice_17.csv +0 -0
  28. results/faster-whisper-large-v3/fleurs.csv +0 -0
  29. results/faster-whisper-large-v3/hebrew_speech_kan.csv +0 -0
  30. results/faster-whisper-large-v3/ivrit_ai_eval_d1.csv +0 -0
  31. results/faster-whisper-large-v3/saspeech.csv +0 -0
  32. results/google-speech/common_voice_17.csv +0 -0
  33. results/google-speech/fleurs.csv +0 -0
  34. results/google-speech/hebrew_speech_kan.csv +0 -0
  35. results/google-speech/ivrit_ai_eval_d1.csv +0 -0
  36. results/google-speech/saspeech.csv +0 -0
benchmark.csv CHANGED
@@ -1,8 +1,8 @@
1
  model,ivrit-ai/eval-d1,ivrit-ai/saspeech,google/fleurs/he,mozilla-foundation/common_voice_17_0/he,imvladikon/hebrew_speech_kan
2
- ivrit-ai/whisper-large-v2-d4,0.063,0.080,0.242,0.207,0.179
3
- ivrit-ai/whisper-v2-d3-e3,0.069,0.086,0.256,0.214,0.174
4
- openai/whisper-large-v2,0.083,0.100,0.276,0.234,0.209
5
- openai/whisper-large-v3,0.101,0.096,0.262,0.232,0.174
6
- openai/whisper-large-v3-turbo,0.085,0.103,0.302,0.279,0.203
7
- aws-transcribe-batch-20241205,0.069,0.087,0.230,0.141,0.092
8
- aws-transcribe-stream-20241205,0.082,0.092,0.287,0.199,0.132
 
1
  model,ivrit-ai/eval-d1,ivrit-ai/saspeech,google/fleurs/he,mozilla-foundation/common_voice_17_0/he,imvladikon/hebrew_speech_kan
2
+ faster-whisper-ivrit-ai-v2-d4,0.062,0.080,0.241,0.207,0.113
3
+ faster-whisper-ivrit-ai-v2-d3-e3,0.070,0.086,0.255,0.214,0.139
4
+ amazon-transcribe-batch,0.068,0.085,0.230,0.141,0.090
5
+ faster-whisper-large-v2,0.080,0.098,0.266,0.233,0.164
6
+ amazon-transcribe-stream,0.081,0.090,0.287,0.200,0.131
7
+ faster-whisper-large-v3,0.096,0.094,0.262,0.231,0.134
8
+ google-speech,0.212,0.189,0.385,0.380,0.292
results/amazon-transcribe-batch/common_voice_17.csv ADDED
The diff for this file is too large to render. See raw diff
 
results/amazon-transcribe-batch/fleurs.csv ADDED
The diff for this file is too large to render. See raw diff
 
results/amazon-transcribe-batch/hebrew_speech_kan.csv ADDED
The diff for this file is too large to render. See raw diff
 
results/amazon-transcribe-batch/ivrit_ai_eval_d1.csv ADDED
The diff for this file is too large to render. See raw diff
 
results/amazon-transcribe-batch/saspeech.csv ADDED
The diff for this file is too large to render. See raw diff
 
results/amazon-transcribe-stream/common_voice_17.csv ADDED
The diff for this file is too large to render. See raw diff
 
results/amazon-transcribe-stream/fleurs.csv ADDED
The diff for this file is too large to render. See raw diff
 
results/amazon-transcribe-stream/hebrew_speech_kan.csv ADDED
The diff for this file is too large to render. See raw diff
 
results/amazon-transcribe-stream/ivrit_ai_eval_d1.csv ADDED
The diff for this file is too large to render. See raw diff
 
results/amazon-transcribe-stream/saspeech.csv ADDED
The diff for this file is too large to render. See raw diff
 
results/faster-whisper-ivrit-ai-v2-d3-e3/common_voice_17.csv ADDED
The diff for this file is too large to render. See raw diff
 
results/faster-whisper-ivrit-ai-v2-d3-e3/fleurs.csv ADDED
The diff for this file is too large to render. See raw diff
 
results/faster-whisper-ivrit-ai-v2-d3-e3/hebrew_speech_kan.csv ADDED
The diff for this file is too large to render. See raw diff
 
results/faster-whisper-ivrit-ai-v2-d3-e3/ivrit_ai_eval_d1.csv ADDED
The diff for this file is too large to render. See raw diff
 
results/faster-whisper-ivrit-ai-v2-d3-e3/saspeech.csv ADDED
The diff for this file is too large to render. See raw diff
 
results/faster-whisper-ivrit-ai-v2-d4/common_voice_17.csv ADDED
The diff for this file is too large to render. See raw diff
 
results/faster-whisper-ivrit-ai-v2-d4/fleurs.csv ADDED
The diff for this file is too large to render. See raw diff
 
results/faster-whisper-ivrit-ai-v2-d4/hebrew_speech_kan.csv ADDED
The diff for this file is too large to render. See raw diff
 
results/faster-whisper-ivrit-ai-v2-d4/ivrit_ai_eval_d1.csv ADDED
The diff for this file is too large to render. See raw diff
 
results/faster-whisper-ivrit-ai-v2-d4/saspeech.csv ADDED
The diff for this file is too large to render. See raw diff
 
results/faster-whisper-large-v2/common_voice_17.csv ADDED
The diff for this file is too large to render. See raw diff
 
results/faster-whisper-large-v2/fleurs.csv ADDED
The diff for this file is too large to render. See raw diff
 
results/faster-whisper-large-v2/hebrew_speech_kan.csv ADDED
The diff for this file is too large to render. See raw diff
 
results/faster-whisper-large-v2/ivrit_ai_eval_d1.csv ADDED
The diff for this file is too large to render. See raw diff
 
results/faster-whisper-large-v2/saspeech.csv ADDED
The diff for this file is too large to render. See raw diff
 
results/faster-whisper-large-v3/common_voice_17.csv ADDED
The diff for this file is too large to render. See raw diff
 
results/faster-whisper-large-v3/fleurs.csv ADDED
The diff for this file is too large to render. See raw diff
 
results/faster-whisper-large-v3/hebrew_speech_kan.csv ADDED
The diff for this file is too large to render. See raw diff
 
results/faster-whisper-large-v3/ivrit_ai_eval_d1.csv ADDED
The diff for this file is too large to render. See raw diff
 
results/faster-whisper-large-v3/saspeech.csv ADDED
The diff for this file is too large to render. See raw diff
 
results/google-speech/common_voice_17.csv ADDED
The diff for this file is too large to render. See raw diff
 
results/google-speech/fleurs.csv ADDED
The diff for this file is too large to render. See raw diff
 
results/google-speech/hebrew_speech_kan.csv ADDED
The diff for this file is too large to render. See raw diff
 
results/google-speech/ivrit_ai_eval_d1.csv ADDED
The diff for this file is too large to render. See raw diff
 
results/google-speech/saspeech.csv ADDED
The diff for this file is too large to render. See raw diff