Ensembles in Python
You have different ways to create an ensemble using your weak classifiers:
-Bagging: You can average the output of the 4 classifiers.
-Stacking: Your final output could be a linear combination of the 4 individual outputs. You can use the output of your 4 models as the input of a another algorithm or you can directly use different weights by choose the ones with better accuracy.
I have implemented 4 classifiers using scikit-learn in Python. But, the performance on all of them is not very good. I want to implement an ensemble of these classifiers. I looked up the ensembles on scikit-learn but it has Random Forests and Adaboost. How should I create an ensemble of my weak classifiers?