Ensemble Learning

Follow this topic Ask about this topic

Momentum

18 papers in the last four weeks, up 38% on the four weeks before. 0.2% of all new papers.

Jul 13Week of Sep 28

Latest papers 168

All topics

Covariance Last-Layer Ensembles: Function-Space Diversity for Efficient Uncertainty Quantification
Jul 26, 2026H. Martin Gillis, Isaac Xu, Gabriel Spadon +1Uncertainty Quantification Ensemble Learning
Dalhousie University Halifax, Nova Scotia, Canada
A Leakage-Free Stacked Ensemble Method for Multiclass Classification
Jul 24, 2026S. P. Sharmila, Aruna TiwariEnsemble Learning Multiclass Classification
Indian Institute of Technology Indore, Madhya Pradesh, India. · Siddaganga Institute of Technology, Tumakuru, Karnataka, India.
Climate-resilient electric vehicle charging infrastructure for sustainable cities: An interpretable causal-ensemble framework for preventive maintenance and low-carbon mobility
Jul 23, 2026Cande Lian, Wentao Zeng, Jiabin Wu +2Ensemble Learning Conditional Average Treatment Effect Estimation
School of Management, Foshan University, Foshan, China · School of Management, Foshan University, Foshan 528000, China · School of Mathematics, Foshan University, Foshan 528000, China +5
ADABORD: a novel AdaBoost approach for ordinal classification
Jul 23, 2026Rafael Ayllón-Gavilán, Francisco José Martínez-Estudillo, David Guijo-Rubio +2Ensemble Learning Ordinal Regression
Department of Clinical-Epidemiological Research in Primary Care, IMIBIC, Avda. Menéndez Pidal S/N, Córdoba, 14004, Spain · Programa de doctorado en Computación Avanzada, Energía y Plasmas, Universidad de Córdoba, Campus de Rabanales, Ctra. N-IVa, Km. 396, Córdoba, 14071, Spain · Departmento de Ciencia de la Computación e Inteligencia Artificial, Universidad de Córdoba, Campus de Rabanales, Ctra. N-IVa, Km. 396, Córdoba, 14071. +2
Multi-stage Dynamic Selection for Cross-Project Defect Prediction
Jul 22, 2026Juscimara G. Avelino, Juscelino S. A. Junior, George D. C. Cavalcanti +1Ensemble Learning Cross-Domain Transfer Learning
Centro de Inform´atica, Universidade Federal de Pernambuco, Recife, Brazil · ´Ecole de Technologie Sup´erieure, University of Quebec, Montreal, Canada
Autonomous Collaborative Learning Among an Ensemble of Tsetlin Machines with Consensus-Based Inference
Jul 22, 2026Yehuda Rudin, Osnat Keren, Michal Yemini +1Ensemble Learning Multi-Agent Collaboration
Faculty of Engineering, Bar Ilan University, Ramat Gan 5290002, Israel.
Harnessing Disagreement: Detecting Correlated Agreement Blindness in Multi-Agent Triage
Jul 22, 2026Shay Seiya McDonnell, Avantika Singh, Quoc-Viet Pham +2Ensemble Learning Multi-Agent Systems
School of Computer Science & Statistics, Trinity College Dublin, College Green, Dublin 2, Ireland · ADAPT Centre, Trinity College Dublin, College Green, Dublin 2, Ireland · CKDelta, 28/29 Sir John Rogerson’s Quay, Dublin 2, Ireland
Rethinking Heterogeneous LLM Merging: A Weighted Model Averaging Perspective
Jul 20, 2026Jiahe Fan, Yinghao Hou, Si Chen +3Ensemble Learning Language Model Merging
University of Science and Technology of China · School of Information Science and Technology, Department of Automation, University of Science and Technology of China · School of Computer Science and Technology, University of Science and Technology of China
Trustworthy Protein-Ligand Binding Affinity Prediction via Reliability-Aware Multi-Engine Fusion
Jul 20, 2026Yongchan Hong, Defu Cao, Wenjin Liu +6Protein-Ligand Binding Affinity Prediction Evidential Deep Learning
Department of Quantitative & Computational Biology University of Southern California Los Angeles, California, USA · Department of Computer Science University of Southern California Los Angeles, California, USA · Department of Chemistry University of California, Berkeley Berkeley, California, USA
Quantifying Diversity of Thought: A Predictive Law of Weighted LLM Ensemble Lift
Jul 19, 2026Junade AliEnsemble Learning Language Model Ensembles
Defence and National Security Programme The Alan Turing Institute London, United Kingdom
Increasing Line Outage Localization Performance with Ensemble Classifiers
Jul 18, 2026Daniel Flores, Yuanrui Sang, Michael P. McGarryEnsemble Learning Power Systems
Dept. of Electrical and Computer Engineering University of Massachusetts Amherst Amherst, MA, United States · Dept. of Electrical and Computer Engineering University of Texas at El Paso El Paso, TX, United States
Hierarchical Specialised Ensembles for Classification of Zebrafish Phenotypes Using the Selected Image Recognition Methods
Jul 17, 2026Piotr S. Maciąg, Monika Maciąg, Magdalena MajdanHierarchical Classification Multi-Label Classification
Institute of Computer Science, Warsaw University of Technology, Nowowiejska 15/19, 00-665 Warsaw, Poland · Laboratory of Neuronal Plasticity, Nencki Institute of Experimental Biology of the Polish Academy of Sciences, Warsaw, Poland · Laboratory of Behavioral Studies, Medical University of Lublin, Lublin, Poland +1
Analytical study of the optimal combination of binary classifiers based on classifiers-induced partitioning of the training set
Jul 16, 2026Jean-Marc Brossier, Olivier LafitteEnsemble Learning Binary Classification
CNRS, Univ. Grenoble Alpes, Grenoble-INP, GIPSA-lab, Grenoble, France. · Universit´e Sorbonne Paris Nord, LAGA, UMR 7539. IRL CNRS-CRM 3457. Universit´e de Montr´eal. Canada.
Parallel gradient boosting for flexible estimation of conditional distributions
Jul 15, 2026Rémy Chapelle, Nicolas Vayatis, Bruno Falissard +1Ensemble Learning Conditional Distribution Estimation
CESP, CB, EVDG · Université Paris-Saclay, UVSQ, Inserm, CESP, 94807, Villejuif, France · CB +2
Diachronic Sample Integration: Robust Tail-Risk Estimation with Generative Models
Jul 12, 2026Shuning Zhao, Patrick Wong, Leran Zhang +1Ensemble Learning Generative Modeling
Department of Computer Science and Technology, BNRist, Tsinghua University, China · Department of Econometrics and Business Statistics, Monash Business School, Monash University, Australia · School of Mathematics and Statistics, University of Melbourne, Australia
TabLoRA: Parameter-Efficient Low-Rank Ensemble Learning for Large-Scale Tabular Data
Jul 11, 2026Jiaqi Luo, Shixin XuEnsemble Learning Low-Rank Adaptation
School of Mathematical Sciences, Soochow University, No.1 Shizi Street, Suzhou, 215006, Jiangsu Province, China · Digital innovation research center, Duke Kunshan University, No.8 Duke Avenue, Kunshan, 215000, Jiangsu Province, China
Reliability-Aware Ensemble Classification Under Class Imbalance: A Calibration Study on Liquid-Based Cervical Cytology
Jul 10, 2026Nisreen Albzour, Sarah S. LamClass-Imbalanced Learning Computational Pathology
School of Systems Science and Industrial Engineering, Binghamton University, Binghamton, NY 13902, USA
Ensemble Diversity Optimization for Subjective Supervision
Jul 9, 2026Xia Cui, Ziyi Huang, N. R. AbeynayakeAnnotator Disagreement Ensemble Learning
School of Computing and Mathematics, Manchester Metropolitan University, Manchester, UK. · School of Computer Science, Hubei University, Wuhan, China.
Boosting with List-Decodable Codes
Jul 7, 2026Addison Prairie, Li-Yang TanEnsemble Learning Statistical Learning Theory
Stanford
TabPack: Efficient Hyperparameter Ensembles for Tabular Deep Learning
Jul 6, 2026Yury Gorishniy, Akim Kotelnikov, Ivan Rubachev +1Multilayer Perceptrons Ensemble Learning
1Yandex · 2HSE University
Choosing a parallel heterogeneous ensemble method for tabular classification
Jul 6, 2026Vassili Maillet, Gustavo, Angulo +1Ensemble Learning Tabular Classification
Jesus · Mines Paris, PSL University, France
Optimal Mixture-of-Experts Model Averaging for Conditional Generative Models
Jul 5, 2026Shijin Gong, Baihua He, Xinyu ZhangEnsemble Learning Mixture-of-Experts Models
School of Management, University of Science and Technology of China · Academy of Mathematics and Systems Science, Chinese Academy of Sciences
USE: A Unified Self-Ensembling Framework for Test-Time Prompt Tuning
Jul 4, 2026Siru Jiang, Jian Liang, Ran He +1Ensemble Learning VLM Adaptation
School of Advanced Interdisciplinary Sciences, University of Chinese Academy of Sciences · NLPR & MAIS, Institute of Automation, Chinese Academy of Sciences · School of Artificial Intelligence, University of Chinese Academy of Sciences +1
Aggregation with Exponential Weights is Optimal in Expectation
Jul 2, 2026Mikael Møller Høgsgaard, Patrick Rebeschini, Tobias WegelEnsemble Learning Minimax Estimation
Department of Statistics, University of Oxford · Department of Computer Science, ETH Zurich
AdaBoosting Text Prompts for Vision-Language Models
Jul 1, 2026Seokhee Jin, Changhwan Sung, Sunung Mun +2Vision-Language Models Ensemble Learning
KT Corporation, Republic of Korea · Pohang University of Science and Technology (POSTECH), Republic of Korea · National AI Research Lab, Republic of Korea
Multistage Defer Trees for Hybrid Interpretability: If at First You Can't Succeed, Tree Again
Jun 30, 2026Zakk Heile, Hayden McTavish, Margo Seltzer +1Ensemble Learning Learning to Defer
Department of Computer Science · Duke University · Durham, USA +2
Consensus Clustering of Free-Viewing Gaze Data: New Insights into Human-Information Interaction
Jun 29, 2026Beryl Gnanaraj, Jaya Sreevalsan-Nair, Saqib Alam Ansari +1Ensemble Learning Clustering
Graphics-Visualization-Computing Lab, International Institute of Information Technology Bangalore, Karnataka 560100, India. · 2PSG College of Technology, Coimbatore, Tamin Nadu, India.
A Kernel Fisher Discriminant Analysis-Based Tree Ensemble Classifier: KFDA Forest
Jun 27, 2026Donghwan Kim, Seung Hwan Park, Jun-Geol BaekEnsemble Learning Classification
School of Industrial Management Engineering, Korea University Seoul, Korea · School of Mechanical Engineering, Chungnam National University Daejeon, Korea
Reliability-Guided Adaptive Ensembling for Robust Test-Time Adaptation
Jun 21, 2026Adam Koziak, Yuhong GuoTest-Time Adaptation Ensemble Learning
School of Computer Science, Carleton University, Ottawa, Canada · Canada CIFAR AI Chair, Amii, Canada
Selective Ensemble Based on Preference-Directed Multi-Objective Bandits
Jun 20, 2026Lanjihong Ma, Zhen-Yu Zhang, Masashi Sugiyama +1Multi-Armed Bandits Ensemble Learning
Department of Computer Science, Zhejiang Gongshang University, China · Center for Advanced Intelligence Project, RIKEN, Japan · Graduate School of Frontier Sciences, The University of Tokyo, Japan +1

Jul 26, 2026, cs.LGJ/K move · Enter open · S save

Covariance Last-Layer Ensembles: Function-Space Diversity for Efficient Uncertainty Quantification

H. Martin Gillis, Isaac Xu, Gabriel Spadon, Thomas Trappenberg

Dalhousie University Halifax, Nova Scotia, Canada

Uncertainty Quantification Ensemble Learning Deep Ensembles OOD Detection

Open paper AskPDF arXiv

A Last-Layer Ensemble (LLE),

K

linear units on one shared frozen feature map, is an efficient single-pass approach to the disagreement-based epistemic uncertainty for out-of-distribution (OOD) detection. Its weakness is that members share the backbone gradient and can converge toward the same function, collapsing the inter-member diversity the signal depends on. Whether last-layer diversity can be restored, and what mitigates the collapse, is an open question. The weight-orthonormality defining Orthonormal Certificates (OC), the weight-orthonormal special case of the LLE, is only an indirect correction; it decorrelates the weights of the members, not their predictions. Here, we instead target the collapse directly in function space, with a Covariance Last-Layer Ensemble (cov-LLE) that places a direct covariance penalty on member activations. Cov-LLE restores the function-space diversity that weight-orthonormality cannot, and at matched

K

recovers much of the diversity and calibration of a deep ensemble at

1\times

backbone cost (in-distribution prediction variance

0.05\!\to\!9.3

vs.

22.1

(

\times10^{-3}

), and ECE

0.135\!\to\!0.090

vs.

0.035

, for a

K\times

-cost deep ensemble), at no cost to accuracy. Viewing OC as a last-layer ensemble also organizes detectors into a two-axis taxonomy (by how their units are trained and how their outputs are scored) and exposes the OC score as a magnitude, motivating a scale-invariant, label-free direction score that repairs its near-OOD failure, adding

+0.16

+0.18

ROC AUC on every backbone.

Momentum

Related topics

Latest papers 168