What are good counter-examples when training an apple classifier?
A standard approach is to pick a standard image bank of other images that you might run into that aren't apples, and use that as your other class.  The way you figure out what kind of images you need is: figure out what kind of images your classifier might be run on, and try to make the training set as similar as possible to the kinds of images that it will be run on in production.