Building a model in two stages
This is a bad idea. The cross validation score that you obtained from your first model is valid only for that model. If you train a new model there is no guarantee that it will have similar performance, you have to test each and every model.

This could work only if you can guarantee that the data for the second model will be very similar to the data of the first model. You would have to be very sure of that.