Overview

Generalization bounds estimate how well a model trained on finite data will perform on new examples, helping explain when learning is reliable. Common tools include VC and Rademacher complexity, covering numbers, PAC-Bayes and information-theoretic bounds, and algorithmic stability. For deep networks and modern settings, analyses increasingly use learned feature geometry, optimization dynamics, and structure in data, while extending guarantees to distribution shift, generative models, and dependent or distributed samples. A central tension is that broad worst-case guarantees can be too loose to be useful, whereas tighter, non-vacuous bounds often rely on assumptions about the algorithm, data geometry, or shift between training and test distributions.

Latest papers

CardsList

172 papers12 papers in the last four weeks, down 50% on the four weeks before. 0.1% of all new papers.

  1. Can Domain Generalization be Guaranteed in Small-Sample Learning?

    Sep 30, 2026Hong ZhengDomain GeneralizationSmall-Data Learning

  2. How Many Samples Are Enough for Learning Across Domains?

    Sep 30, 2026Hong ZhengSample ComplexityDomain Generalization

  3. Into the danger zone: stable extrapolation in high-dimensional function and operator learning

    Sep 29, 2026Ben Adcock, Simone Brugiapaglia, Xuemeng WangOOD GeneralizationGeneralization Bounds

  4. Preferent Compression Bounds Are Tight

    Sep 28, 2026Dario Paccagnan, Marius TirleaSample CompressionStatistical Learning Theory

  5. Information-Theoretic Analysis of Next-Token Prediction under Markovian Data

    Sep 28, 2026Masoud Kavian, Abdellatif Zaidi, Milad SefidgaranInformation-Theoretic Generalization BoundsNext-Token Prediction

  6. Even Sharper Bounds for Transductive Learning and Its Applications

    Sep 23, 2026Yingzhen YangTransductive LearningStatistical Learning Theory

  7. General Quantification of Covariate and Concept Shifts

    Sep 10, 2026Hongbo Chen, Li Charlie XiaDistribution ShiftConcept Drift

  8. Length Generalization for Transformers via Compression

    Sep 8, 2026Georg Zetzsche, Hongjian Jiang, Andy Yang +4Transformer ExpressivityTransformer

  9. A Theoretical Analysis of Generalization Dynamics in Neural Networks under Gradient Descent with Weight Decay

    Sep 7, 2026Yuqing Wang, Ioannis G. Kevrekidis, Mikhail BelkinNeural Network GeneralizationNeural Network Training Dynamics

  10. Exact Risk-Complexity Laws for Projective Boundaries in Scenario Optimization and Distribution-Free Certification

    Sep 1, 2026Giuseppe C. CalafioreConformal PredictionGeneralization Bounds

  11. Generalization as a robust performance property of learning-enabled dynamical systems

    Aug 31, 2026Filippo FabianiData-Driven ControlGeneralization Bounds

  12. The Sharp Tail of Uniform Stability

    Aug 25, 2026Pahan DewasurendraAlgorithmic StabilityGeneralization Bounds

  13. Tight Bounds for Data-driven Multiple Hyper-parameter Tuning with Structured Loss Function

    Aug 18, 2026Anh Tuan Nguyen, Viet Anh NguyenHyperparameter OptimizationGeneralization Bounds

  14. Operator-Theoretic Generalization Bounds for Multitask Deep Learning

    Aug 17, 2026Mahdi Mohammadigohari, Thomas Borsani, Giuseppe Di FattaGeneralization BoundsMulti-Task Learning

  15. Drift and Dependence: Layer-wise Information-Theoretic Bounds for Replay-Based Continual Learning

    Aug 12, 2026Tieliang Gong, Zhongbo Zhang, Wen Wen +1Information-Theoretic Generalization BoundsReplay-Based Continual Learning

  16. Optimistic Rates for Multiclass PAC Learning

    Aug 11, 2026Xiaoyu Li, Andi Han, Jiaojiao Jiang +1Sample CompressionMulticlass Classification

  17. An Optimal Agnostic PAC Algorithm

    Aug 6, 2026Markus Engelund Mathiasen, Jian Qian, Nikita ZhivotovskiyPAC LearningStatistical Learning Theory

  18. Variational Bounds for Perceptron Learning from Structured Data

    Aug 5, 2026Francesco Camilli, Pierluigi Contucci, Federica Gerace +1Statistical Physics of LearningStatistical Learning Theory

  19. Generalization Bounds on Optimal Control for Transformer Training and Wasserstein Distributional Robustness

    Jul 30, 2026Kağan Akman, Naci Saldi, Serdar YükselTransformerWasserstein Distributionally Robust Optimization

  20. Tight Generalization Bound for AdaBoost

    Jul 29, 2026Mikael Møller HøgsgaardEnsemble LearningGeneralization Bounds

  21. H2(Ω)H^2(Ω) A Priori Error Bounds for Boundary-Adapted PINNs Solving Elliptic Dirichlet Problems

    Jul 21, 2026Nathanael Tepakbong, Jun Fan, Xiang Zhou +1PDE SolvingNeural Network Approximation Theory

  22. Hierarchical Domain Generalization

    Jul 17, 2026Chenxiao Yang, Zhiyuan Li, Shai Ben-David +1Domain GeneralizationStatistical Learning Theory

  23. Generalization Theory for Through-the-Wall Radar Human Activity Recognition

    Jul 9, 2026Weicheng GaoHuman Activity RecognitionOOD Generalization

  24. An exact information theory of generalization phase transitions in Bayesian diffusion models

    Jul 9, 2026Henry Hunt, Mason Kamb, Surya GanguliMemorization in Generative ModelsDiffusion Models

  25. Any-Dimensional Learning by Sampling

    Jul 8, 2026Eitan Levin, Venkat ChandrasekaranRandomized SketchingGeneralization Bounds