What are the possible ways to handle class unbalance in a large scale image recognition problem with Deep Neural Nets?
You can also modify your cost function so that instances in the smaller class have more weight. This makes training computationally less demanding, when compared to your option 1.