Overview

Ensemble learning studies how to combine predictions from multiple models, from Random Forests and boosting to stacking, voting, and mixtures of experts. Methods may average outputs, learn weights from validation data, or select and route among specialists for each example, with applications ranging from tabular prediction and medical imaging to weather forecasting and language models. Combining models can reduce errors and quantify uncertainty, but gains depend on whether their mistakes are complementary rather than correlated. Current work also weighs accuracy against calibration, computational cost, distribution shifts, and leakage-safe evaluation, while developing theoretical guarantees for aggregation and boosting.

Latest papers

CardsList

302 papers27 papers in the last four weeks, down 7% on the four weeks before. 0.2% of all new papers.

  1. Optimal Autoregressive Chain-of-Thought Learning via Bagging

    Nov 16, 2026Awni Altabaa, John Lafferty, Omar MontasserAutoregressive Language ModelingStructured Reasoning in Language Models

  2. Explaining Cross-Label Decision Structure in Multi-Output Tree Ensembles

    Nov 16, 2026Sylvio Barbon Junior, Hiago F. F. Oliveira, Rafael Figueira Gonçalves +2Interpretable MLMulti-Label Classification

  3. SPARC: Evidence-guided adaptive model composition for materials discovery

    Nov 14, 2026Sissi Feng, Yuchen Han, Runze Zhang +7Materials DiscoveryMaterials Property Prediction

  4. Clustering-Based Artificial Tree Ensembles for Random Forest Approximation

    Nov 13, 2026Lea L. Kronziel, Maren S. Wieder, Silke Szymczak +1Surrogate ModelingExplainable Artificial Intelligence

  5. Do Mixture-of-Experts Routers Benefit from Ensembling?

    Nov 12, 2026Viktor Veselý, Sebastian JitaruMixture-of-Experts ModelsEnsemble Learning

  6. Nested Ensemble Learning with Topological Data Analysis for Graph Classification and Regression

    Nov 11, 2026Innocent Abaa, Umar IslambekovGraph ClassificationEnsemble Learning

  7. When Are Predictions Enough? An Evaluation Protocol for Frozen Expert Composition

    Nov 9, 2026Alessandro Pereira, Keith J Ransom, Lewis MitchellEnsemble LearningStacked Ensemble Learning

  8. Generalized Adaptive Boosting and the Geometry of Mistakes

    Nov 9, 2026Marco Bressan, Nataly Brukhim, Nicolò Cesa-Bianchi +4Statistical Learning TheoryEnsemble Learning

  9. Prediction with Foundation Models under Deployment Budgets

    Nov 9, 2026Zhaohui Xu, Xiaofei Xu, Doudou ZhouCost-Aware InferenceEnsemble Learning

  10. Robust Satisficing Ensemble: Scalable Model Aggregation Under Distribution Shifts

    Nov 7, 2026Ahmet Faruk Cetinkaya, Enes Agirman, Cem TekinDistribution Shift RobustnessEnsemble Learning

  11. Ensemble Methodology for Reference-Free Confidence Estimation in LLM-based Code Summarization

    Nov 6, 2026Marco Colombo, Balaji A Jayaram, Sowmyakumari Selvaraj +5Confidence Estimation in Language ModelsSummarization Evaluation

  12. Random Symbolic Boosting: A Geometric Approach to Symbolic Regression

    Nov 5, 2026José R. Ortegaa, José Manuel Muñoz Contreras, Leonardo TrujilloSymbolic RegressionEnsemble Learning

  13. BUMP: Brief Unexpected Mid-Interpolation Peak

    Nov 5, 2026Melinda Flóra Kiss, Márton Muntag, Adrián Csiszárik +1Weight-Space LearningEnsemble Learning

  14. A Hybrid Visitor Prediction Framework using Interpretable Temporal features, Integrating IQR and Anomaly Detection in Lakes in Nebraska

    Nov 2, 2026Israt Zarin, Christopher ChizinskiTime Series ForecastingEnsemble Learning

  15. Poisson Super Learning For Survival And Competing Risks On A Discretized Time Scale

    Nov 2, 2026Gabriele Pittarello, Thomas Gerds, Pernille Falberg Rønn +1Survival AnalysisEnsemble Learning

  16. Sonny-ENS: demystifying machine-learning ensemble weather forecasting

    Nov 1, 2026Minjong CheonWeather ForecastingProbabilistic Forecasting

  17. Benchmarking Classical Machine Learning Models for Shading-Fault Detection in Rooftop Photovoltaic Systems Using Real Sensor Data

    Oct 31, 2026Zablon Ombiro, Bernard ShibwaboFault DetectionEnsemble Learning

  18. Robust Learning of Multi-Index Models under Logconcave Distributions via Weak Partial Learners

    Oct 30, 2026Ilias Diakonikolas, Daniel M. Kane, Mingchen MaStatistical Learning TheoryClassification

  19. Rethinking Neural Thickets Without Weight Perturbations

    Oct 29, 2026Nicolas Dufour, Elouan Gardès, Amil Dravid +2LLM ReasoningEnsemble Learning

  20. CBE: A Complexity-adaptive Boundary-aware Ensemble Method for Imbalanced Data

    Oct 29, 2026Xun WeiClass-Imbalanced LearningClassification

  21. ReForest: Interpretability Meets Reasoning in Isolation Forest

    Oct 27, 2026Juyoung Seo, Geonwoo Bang, Dongho Kim +1Contextual Anomaly DetectionAnomaly Detection

  22. Selective Transfer Learning for Groundwater Level Anomaly Forecasting: Accuracy-Risk Trade-offs

    Oct 27, 2026Yaxuan Wu, Ali Mohammed Mansoor Alsahag, Seyed Sahand Mohammadi ZiabariTransfer LearningCross-Domain Transfer Learning

  23. Recall or Relearn? A Mixture of In-Context Experts for Recurring Concept Drift

    Oct 27, 2026Zhangkai Wu, Xu Zhang, Zhihong Cui +2Concept DriftOnline Continual Learning

  24. Joint End-to-End Training of Weighted BP Decoder Ensembles

    Oct 24, 2026Felix Krieg, Paul Bezner, Stephan ten BrinkError-Correcting CodesBelief Propagation

  25. Evaluation of Uncertainty-Aware Multi-Software Ensembles for Hippocampal Segmentation

    Oct 22, 2026Gabriel Oliveira-Stahl, Anna Schroder, James Moggridge +6Medical Image SegmentationSegmentation Uncertainty Estimation

  26. Circuits of LLM Classifiers

    Oct 21, 2026Hadi Khalaf, Sajani Vithana, Kunal Talreja +3Large Language Model-Based Text ClassificationLanguage Model Ensembles

  27. Logit Averaging During Training Sets a New State of the Art for Non-Invasive Speech BCI

    Oct 19, 2026Miran Özdogan, Gereon Elvers, Michael Bronstein +1Brain-Computer InterfacesNeural Decoding

  28. Dynamic self-ensemble on multi-exit residual vision transformer for small-data image classification

    Oct 17, 2026Stephen Ekaputra Limantoro, Yan-Kai Wang, Ching-Chun Huang +4Vision TransformerEnsemble Learning