Why is large decision tree likely to overfit
Overfitting means that a model is giving a good fit on a dataset (whatever the measure you use to assess fit), but this is not a general case (i.e. when new data comes in or on another dataset, the error will explode. Or said otherwise, the model variance is high).
In the case of trees, adding a node to a leave based on one feature should be done only if the feature really brings information at this level. The feature could be random though and this would deteriorate greatly the fit.
As a simplistic example on a classification task; if we want to sort out apples and oranges based on some features, including one of the features that is a value, 0 or 1 chosen at random.
If it happens that in our dataset the values 1 correspond in 80% of the time to apples, then we would be tempted to add a node saying &quot;if value is 1, then apple&quot;, but you can see that this is absolutely not a generality: the tree wouldn't fit at all to another dataset.
Hence this node shouldn't be added, i.e. the tree should be pruned.