9.4 - How deep?

If we grow an overly complex tree, as shown in Figure 9.6, we tend to overfit to our training data resulting in poor generalization performance.

Consequently, there is a balance to be achieved in the depth and complexity of the tree to optimize predictive performance on future unseen data. To find this balance, we have two primary approaches: (1) early stopping and (2) pruning.