Augmenting the validation set in Ensemble Model
Have you considered freezing the ensemble models themselves and allowing only the weights in final layer to change? Then the overfitting shouldn't be so pronounced...
You might also want to consider cross validation procedure.