Sklearn: How to adjust data set proportion during training, but not testing
Try to use predictor option class_weight='balanced' or auto. It worked really well for me for SGDClassifier in a similar situation.