Overview

Generalization bounds estimate how well a model trained on finite data will perform on new examples, helping explain when learning is reliable. Common tools include VC and Rademacher complexity, covering numbers, PAC-Bayes and information-theoretic bounds, and algorithmic stability. For deep networks and modern settings, analyses increasingly use learned feature geometry, optimization dynamics, and structure in data, while extending guarantees to distribution shift, generative models, and dependent or distributed samples. A central tension is that broad worst-case guarantees can be too loose to be useful, whereas tighter, non-vacuous bounds often rely on assumptions about the algorithm, data geometry, or shift between training and test distributions.

Latest papers

CardsList

172 papers12 papers in the last four weeks, down 50% on the four weeks before. 0.1% of all new papers.

  1. Fine-grained Analysis of Stability and Generalization for Stochastic Bilevel Optimization

    Apr 5, 2026Xuelin Zhang, Hong Chen, Bin Gu +2Stochastic Bilevel OptimizationBilevel Optimization

  2. Generalization Bounds and Statistical Guarantees for Multi-Task and Multiple Operator Learning with MNO Networks

    Apr 2, 2026Adrien Weihs, Hayden SchaefferOperator LearningGeneralization Bounds

  3. Generalization Bounds for Spectral GNNs via Fourier Domain Analysis

    Apr 1, 2026Vahan A. Martirosyan, Daniele Malitesta, Hugues Talbot +2Generalization BoundsNeural Network Generalization

  4. Minimum Norm Interpolation via the Local Theory of Banach Spaces: The Role of 22-Uniform Convexity

    Mar 30, 2026Gil Kur, Pierre BizeulGeneralization BoundsLinear Regression

  5. Expectation Error Bounds for Transfer Learning in Linear Regression and Linear Neural Networks

    Mar 30, 2026Meitong Liu, Christopher Jung, Rui Li +2Transfer LearningGeneralization Bounds

  6. Uniform Laws of Large Numbers in Product Spaces

    Mar 25, 2026Ron Holzman, Shay Moran, Alexander ShlimovichVC DimensionStatistical Learning Theory

  7. Generalization Bounds for Physics-Informed Neural Networks for the Incompressible Navier-Stokes Equations

    Mar 24, 2026Sebastien Andre-Sloan, Dibyakanti Kumar, Alejandro F Frangi +1Generalization BoundsPhysics-Informed ML

  8. A PAC-Bayesian approach to generalization for quantum models

    Mar 24, 2026Pablo Rodriguez-Grasa, Matthias C. Caro, Jens Eisert +3Generalization BoundsPAC-Bayesian Generalization Bounds

  9. Feature Incremental Clustering with Generalization Bounds

    Mar 23, 2026Jing Zhang, Chenping HouClusteringGeneralization Bounds

  10. Sharper Generalization Bounds for Transformer

    Mar 23, 2026Yawen Li, Tao Hu, Zhouhui Lian +4Generalization BoundsTransformer

  11. Rigorous Error Certification for Neural PDE Solvers: From Empirical Residuals to Solution Guarantees

    Mar 19, 2026Amartya Mukherjee, Maxwell Fitzsimmons, David C. Del Rey Fernández +1Neural Network GeneralizationNeural PDE Solvers

  12. Seasoning Generative Models for a Generalization Aftertaste

    Mar 19, 2026Hisham Husain, Valentin De Bortoli, Richard NockGenerative ModelingGeneralization Bounds

  13. On-Average Stability of Multipass Preconditioned SGD and Effective Dimension

    Mar 12, 2026Simon Vary, Tyler Farghly, Ilja Kuzborskij +1Stochastic Gradient DescentGeneralization Bounds

  14. Upper Generalization Bounds for Neural Oscillators

    Mar 10, 2026Zifeng Huang, Konstantin M. Zuev, Yong Xia +1Generalization BoundsNeural Network Generalization

  15. Transductive Generalization for GNNs via Optimal Transport

    Mar 10, 2026MoonJeong Park, Seungbeom Lee, Kyungmin Kim +5Transductive LearningGeneralization Bounds

  16. Sparsity and Out-of-Distribution Generalization

    Mar 8, 2026Scott Aaronson, Lin Lin Lee, Jiawei LiOOD GeneralizationGeneralization Bounds

  17. Directional Neural Collapse Explains Few-Shot Transfer in Self-Supervised Learning

    Mar 3, 2026Achleshwar Luthra, Yash Salunkhe, Tomer GalantiNeural CollapseTransfer Learning

  18. The Price of Robustness: Stable Classifiers Need Overparameterization

    Mar 3, 2026Jonas von Berg, Adalbert Fono, Massimiliano Datres +2OverparameterizationRobust Classification

  19. Multiplicative Oracle Inequalities for Transductive Learning via Level-Set Aggregation

    Mar 2, 2026Jian Qian, Jiachen XuTransductive LearningStatistical Learning Theory

  20. A short tour of operator learning theory: Convergence rates, statistical limits, and open questions

    Feb 28, 2026Simone Brugiapaglia, Nicola Rares Franco, Nicholas H. NelsenOperator LearningStatistical Learning Theory

  21. Bound to Disagree: Generalization Bounds via Certifiable Surrogates

    Feb 26, 2026Mathieu Bazinet, Valentina Zantedeschi, Pascal GermainGeneralization Bounds

  22. Does Order Matter : Connecting The Law of Robustness to Robust Generalization

    Feb 24, 2026Mihir More, Aritra Das, Jaee Ponde +3Generalization BoundsStatistical Learning Theory

  23. On Compatible Generalization Bounds of Deep Residual Networks From a Dynamical System Perspective

    Feb 24, 2026Jinshu Huang, Mingfei Sun, Chunlin WuNeural Network GeneralizationGeneralization Bounds

  24. Omitted Variable Bias in Language Models Under Distribution Shift

    Feb 18, 2026Victoria Lin, Louis-Philippe Morency, Eli Ben-MichaelOOD GeneralizationGeneralization Bounds

  25. Uniform error bounds for quantized dynamical models

    Feb 17, 2026Abdelkader Metakalard, Fabien Lauer, Kevin Colin +1System IdentificationGeneralization Bounds

  26. Scenario Approach with Post-Design Certification of User-Specified Properties

    Feb 17, 2026Algo Carè, Marco C. Campi, Simone GarattiGeneralization BoundsStatistical Learning Theory