PySpark Crossvalidation error
For some reason in cross validation we also need to set the label column of the evaluator (even tho it's already set for the estimator. So all you need to do is change BinaryClassificationEvaluator() into BinaryClassificationEvaluator().setLabelCol(&quot;churn&quot;) where &quot;churn&quot; is the name of your target variable.