clefourrier HF Staff commited on
Commit
7b23f5c
·
verified ·
1 Parent(s): 7019d20

Update content.py

Browse files
Files changed (1) hide show
  1. content.py +1 -1
content.py CHANGED
@@ -19,7 +19,7 @@ See below for submissions.
19
 
20
  SUBMISSION_TEXT = """
21
  ## Submissions
22
- Results can be submitted for both validation and test. Scores are expressed as the percentage of correct answers for a given split.
23
 
24
  Each question calls for an answer that is either a string (one or a few words), a number, or a comma separated list of strings or floats, unless specified otherwise. There is only one correct answer.
25
  Hence, evaluation is done via quasi exact match between a model’s answer and the ground truth (up to some normalization that is tied to the “type” of the ground truth).
 
19
 
20
  SUBMISSION_TEXT = """
21
  ## Submissions
22
+ Results can be submitted for the test set (we closed the validation leaderboard, as it was no longer informative). Scores are expressed as the percentage of correct answers for a given split.
23
 
24
  Each question calls for an answer that is either a string (one or a few words), a number, or a comma separated list of strings or floats, unless specified otherwise. There is only one correct answer.
25
  Hence, evaluation is done via quasi exact match between a model’s answer and the ground truth (up to some normalization that is tied to the “type” of the ground truth).