How can I infer no target in a target classification problem based on deep learning?
What you are looking for is anomaly detection, or novelty detection.

This cannot always be solved by labeling some images as "no letter", since all kind of images having no letters may not be available for labeling, or maybe too costly to exhaustively label.

This link has some directions you can look at for a start.