Overview

Ensemble learning studies how to combine predictions from multiple models, from Random Forests and boosting to stacking, voting, and mixtures of experts. Methods may average outputs, learn weights from validation data, or select and route among specialists for each example, with applications ranging from tabular prediction and medical imaging to weather forecasting and language models. Combining models can reduce errors and quantify uncertainty, but gains depend on whether their mistakes are complementary rather than correlated. Current work also weighs accuracy against calibration, computational cost, distribution shifts, and leakage-safe evaluation, while developing theoretical guarantees for aggregation and boosting.

Latest papers

CardsList

302 papers27 papers in the last four weeks, down 7% on the four weeks before. 0.2% of all new papers.

  1. Cross-Cluster Weighted Forests

    May 17, 2021Maya Ramchandran, Rajarshi Mukherjee, Giovanni ParmigianiCancer GenomicsEnsemble Learning

  2. Ensemble Learning Based Classification Algorithm Recommendation

    Jan 15, 2021Guangtao Wang, Qinbao Song, Xiaoyan Zhu +1Algorithm SelectionEnsemble Learning