prediction model that is composed of a set of models is called a model ensemble. Models must be different
can help both Overfitting and Underfitting
Bagging, Boosting & Stacking
How to Ensemble/ Aggregation
- weighted aggregation of prediction
- weights can be some confidence factor of each model
- majority or max voting (for classification)
- average (for regression)