Gradient boosting how can accuracy increase when we lower the depth of tree?
In boosting, a low biased &amp; low variance model is ensembled by additively combining high biased &amp; low variant models. Here, biases are gradually diminished while keeping variances low. Therefore, a tree with a single depth, that is highly biased, isn't an issue because additively errors will be reduced.