20.1 Ensembling

• Aggregating predictions of multiple models together to make one prediction.
• We’ve already seen some ensembling within 1 type of model:
  • Random forest
  • Bagging & boosting
• Model stacking allows for aggregating many different types of models (lm + rf + svm, …), to assemble a new model, which generates a new prediction, informed by its members.