Algorithmic Stability

Follow this topic Ask about this topic

Momentum

3 papers in the last four weeks, against 2 the four weeks before. 0.0% of all new papers.

Jul 13Week of Sep 28

Latest papers 35

All topics

Certification-Enhanced Generalization Bounds
Oct 5, 2026Leo Elmecker-Plakolm, Matthew WickerAlgorithmic Stability Generalization Bounds
Department of Computing Imperial College London London, SW7 2AZ, UK
Stable Policy Learning
Sep 16, 2026Harvey Barnhard, Giacomo Opocher, Rahul SinghAlgorithmic Stability Policy Learning
Harvard University · University of Mannheim
Stable Filters for Generative Modeling of Graph Signals
Sep 16, 2026Martin Schmidt, Gonzalo MateosGraph Signal Processing Algorithmic Stability
University of Rochester, Rochester, NY, USA
Algorithmic stability via ensembling
Sep 9, 2026Rina Foygel Barber, Richard J. SamworthEnsemble Learning Algorithmic Stability
University of Chicago · University of Cambridge
The Sharp Tail of Uniform Stability
Aug 25, 2026Pahan DewasurendraAlgorithmic Stability Generalization Bounds
Johns Hopkins University
Logarithmic-Free Moment and Generalization Bounds for Uniformly Stable Algorithms
Aug 10, 2026Thanh Nguyen-Cung, Binh T. NguyenAlgorithmic Stability Statistical Learning Theory
VinUniversity
Stability of Ranking-dependent Pair-wise Comparison Patterns in the Analytic Hierarchy Process
Aug 6, 2026Vitaliy Tsyganok, Sergii Kadenko, Oleh AndriichukPairwise Comparison Pairwise Preference Evaluation
Institute for Information Recording National Academy of Sciences of Ukraine Kyiv, Ukraine 03113
Feature Bagging Provides Stability
Jul 29, 2026Yuheng Ma, Qiang SunEnsemble Learning Algorithmic Stability
School of Statistics, East China Normal University · University of Toronto · MBZUAI
Learning Dynamics of Strategic Publishers in Generative AI Ecosystems
Jul 28, 2026Sagie Dekel, Omer Madmon, Moshe Tennenholtz +1Generative Engine Optimization Algorithmic Stability
Technion - Israel Institute of Technology
Stabilizing Deep Reconstruction Operators with Contractive Anchoring
Jul 25, 2026Arghya Sinha, Trishit Mukherjee, Kunal N. ChaudhuryAlgorithmic Stability Image Reconstruction
Indian Institute of Science, Bengalore, India
Mechanism and Stability Analysis of Metabolic Closed-Loop Metaheuristics
Jul 2, 2026Jinliang Xu, Liping MaMulti-Agent System Optimization Algorithmic Stability
independent researcher in Beijing, China
Dangerous Liaisons of Convex Learning and Non-Affine Aggregation
Jun 26, 2026Thomas Boudou, Batiste Le Bars, Nirupam Gupta +1Optimization Convergence Analysis Algorithmic Stability
PreMeDICaL team, Inria, Idesp, Inserm, Universit´e de Montpellier, Montpellier, France · Univ. Lille, Inria, CNRS, Centrale Lille, UMR 9189, CRIStAL, F-59000 Lille, France · Department of Computer Science, University of Copenhagen, Copenhagen, Danemark
Stabilizing black-box algorithms through task-oriented randomization
Jun 24, 2026Yali Wang, Zhaojun WangAlgorithmic Stability
GRAIN: Group Aggregation via Min-Norm Objective
Jun 22, 2026Nghia Bui, Jiarui Yao, Lijing WangAlgorithmic Stability Neural Network Training Dynamics
Department of Data Science New Jersey Institute of Technology · Boston Children’s Hospital Harvard Medical School
Mirror Descent Beyond Euclidean Stability: An Exponential Separation in Initialization Sensitivity
Jun 9, 2026Shira Vansover-Hager, Matan Schliserman, Ofir Schlisselberg +1Algorithmic Stability Mirror Descent
Blavatnik School of Computer Science and AI, Tel Aviv University · Google Research
Generalization in Nonlinear Least Squares via Learned Feature Geometry
Jun 7, 2026Ayub Kharel, Ilja Kuzborskij, Patrick Rebeschini +1Neural Representation Geometry Algorithmic Stability
University of Oxford · Google DeepMind · Sapient Intelligence
Stable and Scalable Probabilistic Numerical Solvers for Stiff and High-Dimensional ODEs
Jun 6, 2026Nathanael BoschDynamical Systems Uncertainty Quantification
EPFL, Lausanne, Switzerland
Uniform Stability and Generalization Error of GD and SGD on Fixed-Point Parameters
Jun 5, 2026Jonghyun Shin, Sejun ParkAlgorithmic Stability Gradient Descent
Department of Artificial Intelligence Korea University Seoul, Korea
Stability beyond Bounded Differences: Sharp Generalization Bounds under Finite $L_p$ Moments
Jun 5, 2026Qianqian Lei, Soham Bonnerjee, Yuefeng Han +1Algorithmic Stability Generalization Bounds
Department of Statistics, The University of Chicago, Chicago, IL 60637, USA. · Department of Applied and Computational Mathematics and Statistics, University of Notre Dame, Notre Dame, IN 46556, USA.
FOAM: Frequency and Operator Error-Based Adaptive Damping Method for Reducing Staleness-Oriented Error for Shampoo
Jun 1, 2026Kyunghun Nam, Sumyeong AhnDeep Learning Optimization Optimization Convergence Analysis
KENTECH, Naju, Republic of Korea.
A Note on Stability for Orthogonalized Matrix Momentum with Client Sampling
Jun 1, 2026Da Chang, Qiankun Shi, Lvgang Zhang +2Algorithmic Stability Distributed Optimization
University of Chinese Academy of Sciences · Sun Yat-sen University · Southern University of Science and Technology +1
Implicit Regularization in Perturbed Deep Matrix Factorization: Spectral Conditions and Stability
May 27, 2026Jingzhe Wang, Hung-Hsu ChouAlgorithmic Stability Low-Rank Matrix Decomposition
Department of Informatics and Networked Systems, University of Pittsburgh · Department of Mathematics, University of Pittsburgh
Stochastic Gradient Descent with Momentum is Algorithmically Stable
May 27, 2026Yunwen Lei, Zimeng Wang, Xiaoming YuanMomentum Methods Algorithmic Stability
Department of Mathematics, The University of Hong Kong, Hong Kong, China · Department of Mathematics and Mathematical Statistics, Umeå University, Sweden
Smooth Partial Lotteries for Stable Randomized Selection
May 19, 2026Alexander Goldberg, Giulia Fanti, Nihar B. ShahAlgorithmic Stability Algorithmic Fairness
Carnegie Mellon University
Unveiling High-Probability Generalization in Decentralized SGD
May 11, 2026Jiahuan Wang, Ping Luo, Ziqing Wen +2Algorithmic Stability Decentralized Learning
College of Computer Science and Technology National University of Defense Technology Changsha, Hunan 410073, China
A Unified Lyapunov-IQC Framework for Uniform Stability of Smooth Quadratic First-Order Accelerated Optimizers
May 8, 2026Don Li, Dacian DaescuLyapunov Stability Algorithmic Stability
Department of Mathematics & Statistics, Portland State University, Portland, OR 97201, USA
A Flexible Adaptive Stable Clustering Algorithm for Archive-Scale Online Mass Spectrometry
May 8, 2026Shao Shi, Xin Yang, Huiran Feng +8Algorithmic Stability Clustering
Shenzhen Key Laboratory of Precision Measurement and Early Warning Technology for Urban Environmental Health Risks, School of Environmental Science and Engineering, Southern University of Science and Technology, 1088 Xueyuan Avenue, Shenzhen, 518055, Guangdong, China. · Guangdong Provincial Observation and Research Station for Coastal Atmosphere and Climate of the Greater Bay Area, Southern University of Science and Technology, 1088 Xueyuan Avenue, Shenzhen, 518055, Guangdong, China.
Misclassification Rate and Privacy-Utility Trade-offs in Graph Convolutional Networks via Subsampling Stability
May 3, 2026Yexin Zhang, Zhongtian Ma, Qiaosheng Zhang +1Algorithmic Stability Privacy-Preserving ML
School of Cybersecurity, Northwestern Polytechnical University, Xi’an, China · Shanghai Artificial Intelligence Laboratory, Shanghai, China · Shanghai Innovation Institute, Shanghai, China
Stability and Generalization for Decentralized Markov SGD
May 3, 2026Jiahuan Wang, Ziqing Wen, Ping Luo +2Algorithmic Stability Decentralized Optimization
National Key Laboratory of Parallel and Distributed Computing, National University of Defense Technology, Changsha, 410073, China
Improving reproducibility by controlling random seed stability in machine learning based estimation via bagging
Apr 20, 2026Nicholas Williams, Alejandro SchulerDebiased ML Ensemble Learning
Division of Biostatistics, University of California, Berkeley, California, U.S.A.

Oct 5, 2026, cs.LGJ/K move · Enter open · S save

Certification-Enhanced Generalization Bounds

Leo Elmecker-Plakolm, Matthew Wicker

Department of Computing Imperial College London London, SW7 2AZ, UK

Algorithmic Stability Generalization Bounds

Open paper AskPDF arXiv

We investigate the use of formal methods to provide tight and sound generalization bounds for learning algorithms. By casting the traditional notion of algorithmic stability as a specification to be verified, we demonstrate that recent advances in reachability analysis can yield provable bounds on the generalization of a given model and algorithm on a sample dataset. As sample-specific algorithmic stability is insufficient to bound the usual distributional notion of generalization, we develop a novel concentration inequality to connect the sample-specific results of formal certification algorithms to the required distributional analysis for bounding the expected generalization gap. The resulting framework enables the analysis of prior generalization bounds to extend far beyond their original restrictive assumptions. Our approach computes sound bounds on the expected generalization gap in a constant number of algorithm runs without making any analytical assumptions on the algorithm; to achieve non-vacuous bounds we only require that the certified reachable parameter set is bounded --- a condition that we do not assume but formally verify. In practice, we demonstrate that our framework provides formal generalization guarantees that are orders of magnitude tighter than alternative sound computational approaches at scales ranging from toy datasets to fine-tuning classification heads on top of modern large language models. While we implement certification-enhanced versions of several well-known stability results, future extensions of our approach will enable tighter bounds and enhanced practical adoption across the spectrum of modern generalization bounds.

Momentum

Related topics

Latest papers 35