galtimur commited on
Commit
20ef3c6
Β·
verified Β·
1 Parent(s): 3ae0643

Update src/tasks_content.py

Browse files
Files changed (1) hide show
  1. src/tasks_content.py +1 -1
src/tasks_content.py CHANGED
@@ -28,7 +28,7 @@ TASKS_DESCRIPTIONS = {
28
 
29
  We use Pass@1 metric for CI repair.
30
  Models can be evaluated in three task types:
31
- * `full` – *no* ground truth diffs are used for model evaluation;
32
  * `oracle: files` – ground truth diffs are used to select files that should be corrected to fix the issue;
33
  * `oracle: files, lines` – ground truth diffs are used to select files and code blocks that should be corrected to fix the issue;
34
 
 
28
 
29
  We use Pass@1 metric for CI repair.
30
  Models can be evaluated in three task types:
31
+ * `full` – **no** ground truth diffs are used for model evaluation;
32
  * `oracle: files` – ground truth diffs are used to select files that should be corrected to fix the issue;
33
  * `oracle: files, lines` – ground truth diffs are used to select files and code blocks that should be corrected to fix the issue;
34