Creating a classifier for simpler classifiers trained on few training samples
The voting technique that you described is called Ensemble Learning and its improvement over time is guaranteed if each classifier is at least a little better than random.