Overview

Generalization bounds estimate how well a model trained on finite data will perform on new examples, helping explain when learning is reliable. Common tools include VC and Rademacher complexity, covering numbers, PAC-Bayes and information-theoretic bounds, and algorithmic stability. For deep networks and modern settings, analyses increasingly use learned feature geometry, optimization dynamics, and structure in data, while extending guarantees to distribution shift, generative models, and dependent or distributed samples. A central tension is that broad worst-case guarantees can be too loose to be useful, whereas tighter, non-vacuous bounds often rely on assumptions about the algorithm, data geometry, or shift between training and test distributions.

Latest papers

CardsList

172 papers12 papers in the last four weeks, down 50% on the four weeks before. 0.1% of all new papers.

  1. Large Dimensional Kernel Ridge Regression: Extending to Product Kernels

    May 14, 2026Yang Zhou, Yicheng Li, Yuqian Cheng +1Generalization BoundsKernel Ridge Regression

  2. On Kernel Eigen-alignments of KRR: Reconstruction and Generalization

    May 14, 2026Yang Liu, Ernest Fokoue, Richard Lange +1Kernel Ridge RegressionGeneralization Bounds

  3. Scale-Sensitive Shattering: Learnability and Evaluability at Optimal Scale

    May 13, 2026Shashaank Aiyer, Yishay Mansour, Shay Moran +2Agnostic LearningStatistical Learning Theory

  4. Rethinking Generalization in Graph Neural Networks: A Structural Complexity Perspective

    May 13, 2026Peiyao Wang, Liang Bai, Xian Yang +2Neural Network GeneralizationGraph Neural Networks

  5. A Survey on Data-Dependent Worst-Case Generalization Bounds

    May 13, 2026Hubert Leroux, Jean Marcus, Julien RogerNeural Network GeneralizationPAC-Bayesian Generalization Bounds

  6. On the Generalization of Knowledge Distillation: An Information-Theoretic View

    May 13, 2026Bingying Li, Haiyun HeInformation-Theoretic Generalization BoundsStatistical Learning Theory

  7. Information-Theoretic Generalization Bounds for Sequential Decision Making

    May 12, 2026Futoshi Futami, Masahiro FujisawaInformation-Theoretic Generalization BoundsGeneralization Bounds

  8. Adaptive Context Matters: Towards Provable Multi-Modality Guidance for Super-Resolution

    May 11, 2026Jinyi Luo, Minghao Liu, Yifan Li +2Mixture of ExpertsMultimodal Fusion

  9. Generalization Error Bounds for Picard-Type Operator Learning in Nonlinear Parabolic PDEs

    May 11, 2026Koichi Taniguchi, Sho SonodaPDE SolvingPDE Operator Learning

  10. Unveiling High-Probability Generalization in Decentralized SGD

    May 11, 2026Jiahuan Wang, Ping Luo, Ziqing Wen +2Algorithmic StabilityDecentralized Learning

  11. When and How to Canonize: A Generalization Perspective

    May 10, 2026Yonatan Sverdlov, Benjamin Friedman, Snir Hordan +1Invariant Representation LearningGeneralization Bounds

  12. Tight Generalization Bounds for Noiseless Inverse Optimization

    May 9, 2026Pouria Fatemi, Hoomaan Maskan, Suvrit Sra +1Parameter EstimationLearning to Optimize

  13. Bounded Fitting for Expressive Description Logics

    May 8, 2026Maurice Funk, Jean Christoph Jung, Tom VoellmerLogical ReasoningOntology Learning

  14. Spectrum-Adaptive Generalization Bounds for Trained Deep Transformers

    May 8, 2026Mana Sakai, Masaaki ImaizumiTransformerGeneralization Bounds

  15. A Fine-Grained Understanding of Uniform Convergence for Halfspaces

    May 7, 2026Aryeh Kontorovich, Kasper Green LarsenHalfspace LearningStatistical Learning Theory

  16. Optimal Confidence Band for Kernel Gradient Flow Estimator

    May 7, 2026Yuqian Cheng, Zhuo Chen, Qian LinKernel RegressionKernel Methods

  17. Expert Routing for Communication-Efficient MoE via Finite Expert Banks

    May 6, 2026Mohammad Reza Deylam Salehi, Ali KhalesiMixture of ExpertsInformation-Theoretic Generalization Bounds

  18. A Hierarchical Sampling Framework for bounding the Generalization Error of Federated Learning

    May 5, 2026Dario Filatrella, Ragnar Thobaben, Mikael SkoglundHierarchical Federated LearningFederated Learning

  19. Stability and Generalization for Decentralized Markov SGD

    May 3, 2026Jiahuan Wang, Ziqing Wen, Ping Luo +2Algorithmic StabilityDecentralized Optimization

  20. Information-Theoretic Generalization Bounds for Stochastic Gradient Descent with Predictable Virtual Noise

    Apr 30, 2026Mohammad PartohaghighiInformation-Theoretic Generalization BoundsStochastic Gradient Descent

  21. Generalization Bounds of Spiking Neural Networks via Rademacher Complexity

    Apr 26, 2026Shao-Qun Zhang, Zhi-Hua ZhouSpiking Neural NetworksStatistical Learning Theory

  22. On the Stability and Generalization of First-order Bilevel Minimax Optimization

    Apr 22, 2026Xuelin Zhang, Peipei YuanMin-Max OptimizationBilevel Optimization

  23. Generalization at the Edge of Stability

    Apr 21, 2026Mario Tuci, Caner Korkmaz, Umut Şimşekli +1Intrinsic DimensionalityNeural Network Generalization

  24. Separating Geometry from Probability in the Analysis of Generalization

    Apr 21, 2026Maxim Raginsky, Benjamin RechtStatistical Learning TheorySensitivity Analysis

  25. On the Generalization Bounds of Symbolic Regression with Genetic Programming

    Apr 19, 2026Masahiro Nomura, Ryoki Hamano, Isao OnoGenetic ProgrammingStatistical Learning Theory

  26. An Optimal Sauer Lemma Over kk-ary Alphabets

    Apr 14, 2026Steve Hanneke, Qinglin Meng, Shay Moran +1Multiclass ClassificationGeneralization Bounds