Can bounding boxes further improve the performance of a CNN classifier?
Another way to ask the question is: Does sound get clearer when you remove the background noise? 

The obvious answer is yes and in the case of image classification, the answer is also generally yes.

In most cases reducing the noise (irrelevant pixels) will strengthen the signal (activations) the neural network is trying to find.