cs.LGNov 7, 2026

Robust Satisficing Ensemble: Scalable Model Aggregation Under Distribution Shifts

Authors: Ahmet Faruk Cetinkaya, Enes Agirman, Cem Tekin

Organizations: Dept. of Electrical and Electronics Eng., Bilkent University, Ankara, Türkiye

Abstract

Standard ensemble methods can improve robustness by mitigating individual model stochasticity, but they frequently fail to generalize beyond the training distribution, leaving systems vulnerable to out-of-distribution (OOD) data. We introduce the Robust Satisficing Ensemble (RSE), a scalable probabilistic aggregation framework designed to secure model combinations by minimizing their fragility against distributional changes. By bridging a robust satisficing objective with a quadratic risk surrogate, RSE derives an analytical inner adversary. This fundamental reformulation enables highly efficient weight updates without the computational bottleneck of standard minimax optimization, crucially decoupling optimization complexity from sample size to scale effectively to large datasets. In particular, we prove a geometrically decaying truncation error for the fragility approximation via Lagrange-Burmann expansion and establish stationarity guarantees for RSE. We evaluate RSE across a comprehensive spectrum of distribution shifts, including adversarial label shift (SST-5, TREC), natural subpopulation and temporal shifts (CivilComments, HuffPost). Our results demonstrate that RSE consistently outperforms strong robust baselines, including GroupDRO, IRM, and SRM. These findings establish RSE as a practical, theoretically grounded safeguard for reliable model aggregation in dynamic environments.

Figures & tables

Appendix figures & tables13 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Statistical Properties of Robust Learning under Distributional Shifts

    Aug 13, 2026Zhiyi Li, Xiaojie Mao, Yunbei Xu +1Distribution Shift RobustnessDistributionally Robust Optimization

  2. Unification and Optimization of Robust Supervised Learning

    May 27, 2026Jonas Hanselle, Valentin Margraf, Clemens Damke +1Distribution Shift RobustnessRobust Optimization

  3. Learning the Robustness Mechanism with Bilevel Optimization

    Sep 28, 2026Yiyang Shen, Qihang Lin, Weiran WangDistribution Shift RobustnessGroup Distributionally Robust Optimization