Spaces:

evaluate
/

evaluation-suite-ci

Running

mathemakitten commited on Nov 8, 2022

Commit

17791be

1 Parent(s): 4a28069

imdb

Files changed (1) hide show

evaluation-suite-ci.py CHANGED Viewed

@@ -18,7 +18,7 @@ class Suite(evaluate.EvaluationSuite):
                     "metric": "accuracy",
                     "input_column": "text",
                     "label_column": "label",
-                    "label_mapping": {"negative": 0.0, "positive": 1.0}
                 }
             ),
             SubTask(
@@ -30,7 +30,7 @@ class Suite(evaluate.EvaluationSuite):
                     "metric": "accuracy",
                     "input_column": "text",
                     "label_column": "label",
-                    "label_mapping": {"negative": 0.0, "positive": 1.0}
                 }
             )
         ]

                     "metric": "accuracy",
                     "input_column": "text",
                     "label_column": "label",
+                    "label_mapping": {"NEGATIVE": 0.0, "POSITIVE": 1.0}
                 }
             ),
             SubTask(
                     "metric": "accuracy",
                     "input_column": "text",
                     "label_column": "label",
+                    "label_mapping": {"NEGATIVE": 0.0, "POSITIVE": 1.0}
                 }
             )
         ]