How to build confusion matrix , when predicted value and actual value is in sentence?
You could create 2 new columns (1 for the truth, 1 for the prediction) which have a more generalised value like PROCESS_RESUMED. You can then use those columns to create the confusion matrix.