Overview

Generalization bounds estimate how well a model trained on finite data will perform on new examples, helping explain when learning is reliable. Common tools include VC and Rademacher complexity, covering numbers, PAC-Bayes and information-theoretic bounds, and algorithmic stability. For deep networks and modern settings, analyses increasingly use learned feature geometry, optimization dynamics, and structure in data, while extending guarantees to distribution shift, generative models, and dependent or distributed samples. A central tension is that broad worst-case guarantees can be too loose to be useful, whereas tighter, non-vacuous bounds often rely on assumptions about the algorithm, data geometry, or shift between training and test distributions.

Latest papers

CardsList

172 papers12 papers in the last four weeks, down 50% on the four weeks before. 0.1% of all new papers.

  1. The geometry of invariant learning: an information-theoretic analysis of data augmentation and generalization

    Feb 16, 2026Abdelali Bouyahia, Frédéric LeBlanc, Mario MarchandData AugmentationGeneralization Bounds

  2. A Function-Space Stability Boundary for Generalization in Interpolating Learning Systems

    Feb 3, 2026Ronald KatendeNeural Network GeneralizationAlgorithmic Stability

  3. To Grok Grokking: Provable Grokking in Ridge Regression

    Jan 27, 2026Mingyue Xu, Gal Vardi, Itay SafranNeural Network GeneralizationRidge Regression

  4. A Unified and Stable Risk Minimization Framework for Weakly Supervised Learning with Theoretical Guarantees

    Nov 28, 2025Miao Zhang, Junpeng Li, Changchun Hua +1Weakly Supervised LearningStatistical Learning Theory

  5. Tuning without Peeking: Provable Generalization Bounds and Robust LLM Post-Training

    Jul 2, 2025Ismail Labiad, Mathurin Videau, Matthieu Kowalski +4Privacy-Preserving Language ModelsEvolutionary Optimization

  6. Tight Stability Bounds for Robust Distributed Learning: Byzantine Failures Hurt Generalization More than Data Poisoning

    Jun 22, 2025Thomas Boudou, Batiste Le Bars, Nirupam Gupta +1Byzantine-Robust Federated LearningAlgorithmic Stability

  7. Interpretability and Generalization Bounds for Learning Spatial Physics

    Jun 18, 2025Alejandro Francisco Queiruga, Theo Gutman-Solo, Shuai JiangNeural Network GeneralizationMechanistic Interpretability

  8. Generalization in VAE and Diffusion Models: A Unified Information-Theoretic Analysis

    Jun 1, 2025Qi Chen, Jierui Zhu, Florian ShkurtiVariational AutoencodersNeural Network Generalization

  9. Generalization Bounds for Markov Algorithms through Entropy Flow Computations

    Feb 11, 2025Benjamin Dupuis, Maxime Haddouche, George Deligiannidis +1Information-Theoretic Generalization BoundsGeneralization Bounds

  10. Weight Space Learning for Certifiable Few-shot Transfer Learning

    Feb 10, 2025Fady Rezk, Royson Lee, Henry Gouk +2Transfer LearningWeight-Space Learning

  11. Universality of Benign Overfitting in Binary Linear Classification

    Jan 17, 2025Ichiro Hashimoto, Stanislav Volgushev, Piotr ZwiernikNeural Network GeneralizationLinear Classification

  12. The Method of Gaps: Exact Expressions for the Generalization Error of Supervised Learning Algorithms

    Nov 18, 2024Samir M. Perlaza, Xinying ZouInformation-Theoretic Generalization BoundsStatistical Learning Theory

  13. On Generalisation Error Bounds for Transformers

    Oct 15, 2024Lan V. TruongTransformerStatistical Learning Theory

  14. A Generalization Bound for Nearly-Linear Networks

    Jul 9, 2024Eugene GolikovNeural Network GeneralizationGeneralization Bounds

  15. Branch Scaling Manifests as Implicit Architectural Regularization for Improving Generalization in Overparameterized ResNets

    Mar 7, 2024Zixiong Yu, Guhan Chen, Jianfa Lai +2Neural Network GeneralizationResidual Learning

  16. Adversarial Rademacher Complexity of Deep Neural Networks

    Nov 27, 2022Jiancong Xiao, Yanbo Fan, Ruoyu Sun +1Neural Network GeneralizationNeural Network Robustness

  17. Learning Non-Vacuous Generalization Bounds from Optimization

    Jun 9, 2022Chengli Tan, Jiangshe Zhang, Junmin Liu +1Neural Network GeneralizationStatistical Learning Theory

  18. The Limits of Post-Selection Generalization

    Jun 15, 2018Kobbi Nissim, Adam Smith, Thomas Steinke +2Adaptive Data AnalysisGeneralization Bounds