Precision or Recall when dealing with critical cases? I have to create an AI that classifies mutliple objects in order to accept them or not inside a machine.
The problem is that some objects could be really harmful to the machine if they get accepted.
Should I focus on an high Precision or an high Recall, in order to not accept this kind of objects?
Let us say your target variable &quot;1&quot; represents &quot;Harmful Object&quot;.
Precision answers the question - Of all objects predicted as Harmful - How many are really harmful ?
Recall answers the question - Of all the Harmful objects out there - How many were correctly identified ?
You want to increase on Recall in your case - since that reduces the overall risk to the machine.