Spaces:
Running
on
Zero
Running
on
Zero
Dataset link fix
Browse files- app/messages.py +8 -5
app/messages.py
CHANGED
@@ -7,32 +7,34 @@ from .models import *
|
|
7 |
|
8 |
MUST_BE_LOGGEDIN = "Please login with Hugging Face to participate in the TTS Arena."
|
9 |
DESCR = """
|
10 |
-
# TTS Arena: Benchmarking TTS Models
|
11 |
-
Vote to help the community find the best available text-to-speech model!
|
12 |
""".strip()
|
|
|
13 |
BATTLE_INSTR = """
|
14 |
-
## Battle
|
15 |
Choose 2 candidates and vote on which one is better! Currently in beta.
|
16 |
* Input text (English only) to synthesize audio (or press π² for random text).
|
17 |
* Listen to the two audio clips, one after the other.
|
18 |
* Vote on which audio sounds more natural to you.
|
19 |
"""
|
|
|
20 |
INSTR = """
|
21 |
* Press β‘ to quickly get cached sample pairs you've yet to vote on. (Fast π)
|
22 |
* Or press π² to randomly use a sentence from the list. (Slow π’)
|
23 |
* Or input text (πΊπΈ English only) to synthesize audio. (Slowest π)
|
24 |
* _Listen to the two audio clips, one after the other and then vote on which audio sounds more natural to you._
|
25 |
* Model names are revealed after the vote is cast.
|
|
|
26 |
β Note: It **may take up to 30 seconds** to ***synthesize*** audio.
|
27 |
""".strip()
|
|
|
28 |
request = ""
|
29 |
if SPACE_ID:
|
30 |
request = f"""
|
31 |
### Request a model
|
32 |
Please [create a Discussion](https://huggingface.co/spaces/{SPACE_ID}/discussions/new) to request a model.
|
33 |
"""
|
|
|
34 |
ABOUT = f"""
|
35 |
-
## About
|
36 |
The TTS Arena evaluates leading speech synthesis models. It is inspired by LMsys's [Chatbot Arena](https://chat.lmsys.org/).
|
37 |
### Motivation
|
38 |
The field of speech synthesis has long lacked an accurate method to measure the quality of different models. Objective metrics like WER (word error rate) are unreliable measures of model quality, and subjective measures such as MOS (mean opinion score) are typically small-scale experiments conducted with few listeners. As a result, these measurements are generally not useful for comparing two models of roughly similar quality. To address these drawbacks, we are inviting the community to rank models in an easy-to-use interface, and opening it up to the public in order to make both the opportunity to rank models, as well as the results, more easily accessible to everyone.
|
@@ -58,7 +60,8 @@ We may store text you enter and generated audio. We store a unique ID for each s
|
|
58 |
Generated audio clips cannot be redistributed and may be used for personal, non-commercial use only.
|
59 |
Random sentences are sourced from a filtered subset of the [Harvard Sentences](https://www.cs.columbia.edu/~hgs/audio/harvard.html).
|
60 |
""".strip()
|
61 |
-
|
|
|
62 |
Vote to help the community determine the best text-to-speech (TTS) models.
|
63 |
The leaderboard displays models in descending order of how natural they sound (based on votes cast by the community).
|
64 |
Important: In order to help keep results fair, the leaderboard hides results by default until the number of votes passes a threshold. Tick the `Reveal preliminary results` to show models without sufficient votes. Please note that preliminary results may be inaccurate. [This dataset is public](https://huggingface.co/datasets/{DB_DATASET_ID}) and only saves the hardcoded sentences while keeping the voters anonymous.
|
|
|
7 |
|
8 |
MUST_BE_LOGGEDIN = "Please login with Hugging Face to participate in the TTS Arena."
|
9 |
DESCR = """
|
10 |
+
# TTS Arena: Benchmarking TTS Models on HuggingFace
|
|
|
11 |
""".strip()
|
12 |
+
|
13 |
BATTLE_INSTR = """
|
|
|
14 |
Choose 2 candidates and vote on which one is better! Currently in beta.
|
15 |
* Input text (English only) to synthesize audio (or press π² for random text).
|
16 |
* Listen to the two audio clips, one after the other.
|
17 |
* Vote on which audio sounds more natural to you.
|
18 |
"""
|
19 |
+
|
20 |
INSTR = """
|
21 |
* Press β‘ to quickly get cached sample pairs you've yet to vote on. (Fast π)
|
22 |
* Or press π² to randomly use a sentence from the list. (Slow π’)
|
23 |
* Or input text (πΊπΈ English only) to synthesize audio. (Slowest π)
|
24 |
* _Listen to the two audio clips, one after the other and then vote on which audio sounds more natural to you._
|
25 |
* Model names are revealed after the vote is cast.
|
26 |
+
|
27 |
β Note: It **may take up to 30 seconds** to ***synthesize*** audio.
|
28 |
""".strip()
|
29 |
+
|
30 |
request = ""
|
31 |
if SPACE_ID:
|
32 |
request = f"""
|
33 |
### Request a model
|
34 |
Please [create a Discussion](https://huggingface.co/spaces/{SPACE_ID}/discussions/new) to request a model.
|
35 |
"""
|
36 |
+
|
37 |
ABOUT = f"""
|
|
|
38 |
The TTS Arena evaluates leading speech synthesis models. It is inspired by LMsys's [Chatbot Arena](https://chat.lmsys.org/).
|
39 |
### Motivation
|
40 |
The field of speech synthesis has long lacked an accurate method to measure the quality of different models. Objective metrics like WER (word error rate) are unreliable measures of model quality, and subjective measures such as MOS (mean opinion score) are typically small-scale experiments conducted with few listeners. As a result, these measurements are generally not useful for comparing two models of roughly similar quality. To address these drawbacks, we are inviting the community to rank models in an easy-to-use interface, and opening it up to the public in order to make both the opportunity to rank models, as well as the results, more easily accessible to everyone.
|
|
|
60 |
Generated audio clips cannot be redistributed and may be used for personal, non-commercial use only.
|
61 |
Random sentences are sourced from a filtered subset of the [Harvard Sentences](https://www.cs.columbia.edu/~hgs/audio/harvard.html).
|
62 |
""".strip()
|
63 |
+
|
64 |
+
LDESC = f"""
|
65 |
Vote to help the community determine the best text-to-speech (TTS) models.
|
66 |
The leaderboard displays models in descending order of how natural they sound (based on votes cast by the community).
|
67 |
Important: In order to help keep results fair, the leaderboard hides results by default until the number of votes passes a threshold. Tick the `Reveal preliminary results` to show models without sufficient votes. Please note that preliminary results may be inaccurate. [This dataset is public](https://huggingface.co/datasets/{DB_DATASET_ID}) and only saves the hardcoded sentences while keeping the voters anonymous.
|