Negative Feedback to GradCam method I use EfficientNetB0 for performing image classification with one of the class as &quot;stone countertop table&quot;, the other class is &quot;not stone countertop table&quot;. I use the reddest part in gradCAM to put a point saying that this is the &quot;stone countertop table&quot;. But in some cases, it is pointing to the basin (as most of the stone countertop accompany with a basin, and lead efficientNETB0 focus on the wrong thing). Is there a way to tell EfficientNetB0 not to use basin as a hint to look for &quot;stone countertop table&quot;, and therefore the reddest part in gradCAM will always point to the surface of &quot;stone countertop table&quot;?
This is what is desired:

This is not:

This is not as well:
From these 2 pictures alone, I feel that the algorithm is focusing on the table color. Your second table is black but the basin is silver. Can you add more black table images?