6883e621_ws___Machine_Learning__Theory___3
[0] Online Learning with Experts [1] You make many base predictors and then a master algorithm automatically switches between the use of these predictors so as to minimize regret. [2] This is an effective automated method to extract performance from a pool of predictors. [3] 
Computational intractability can be a problem. This approach lives and dies on the effectiveness of the experts, but it provides little or no guidance in their construction.
All Models of Learning have Flaws « Machine Learning (Theory)
3