AdaBoost is another successful algorithm from the category of 'Bagging-Boosting' classifiers, and are often seen as a 'random' forest of forests . While the RF optimizes the Gini index for each tree, AdaBoost considers a stage-wise optimization for the full ensemble . It has the ability not only to model nonlinear behavior, much like RF but also be effective for sparse datasets .