Neural Network Generalization

Ask about this topic

Momentum

21 papers in the last four weeks, up 600% on the four weeks before. 0.2% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 204

All topics
CardsList

  1. Tunneling the Loss Landscape: Bypassing Memorization with Monte Carlo Parameter Swapping

    Aug 3, 2026Lai Shun Chan, Xiaotian Zhang, Yue Shang +2Neural Network GeneralizationMarkov Chain Monte Carlo

    Department of Physics, City University of Hong Kong, Hong Kong, China · Department of Physics and Astronomy, University of Pennsylvania, Philadelphia, PA, USA · 3Innovation Campus Delaware, Air Liquide, Newark, DE, USA

  2. On the robustness of noisy solutions in non-convex neural networks

    Jul 29, 2026Enrico M. Malatesta, Alessandra Passalacqua, Riccardo ZecchinaStochastic OptimizationNeural Network Generalization

    Department of Computing Sciences, Bocconi University, Milano, Italy · Bocconi Institute for Data Science and Analytics (BIDSA)

  3. More Data, Worse Decisions? Preference Reversals in Neural Networks under Gram Incompatibility

    Jul 28, 2026Yanli Yan, Yuanzheng Li, Yong Zhao +2Neural Network GeneralizationNeural Representation Geometry

    Huazhong University of Science and Technology Wuhan, China

  4. Mechanisms of Width Scaling in Normalized Residual Networks: The Effective Alignment Dimension

    Jul 27, 2026Jinhao Zhang, Zeyu Liu, Zicheng Yan +4Neural Network GeneralizationResidual Learning

    Beijing University of Posts and Telecommunications · Institute of Computing Technology, Chinese Academy of Sciences · University of Science and Technology of China +1

  5. Grokking on the Weight-Decay Clock: A Rate Hierarchy from Softly Broken Symmetries

    Jul 27, 2026Taeyoung KimNeural Network GeneralizationWeight Decay

    Center for AI and Natural Sciences Korea Institute for Advanced Study Seoul 02455, Republic of Korea

  6. A Statistical Difference between Single-Layer Learning and Hierarchical Learning in Wide Neural Networks

    Jul 26, 2026Sumio WatanabeNeural Network GeneralizationHierarchical Representation Learning

    RIKEN Center for Advanced Intelligence Project 1-4-1 Nihonbashi, Chuo-ku, 103-0027, Tokyo, Japan

  7. Cautious optimism for deep parameterized quantum circuits

    Jul 23, 2026Marie Kempkes, Elies Gil-Fuster, Carlos Bravo-Prieto +5Double DescentNeural Network Generalization

    Leiden University, Niels Bohrweg 1, 2333 CA Leiden, Netherlands · Volkswagen Group Innovation, Berliner Ring 2, 38440 Wolfsburg, Germany · Dahlem Center for Complex Quantum Systems, Freie Universität Berlin, 14195 Berlin, Germany +4

  8. NSMA: Neuro-Symbolic Manifold Alignment for Generalizable Adaptive Bitrate Streaming under Texture Shift

    Jul 21, 2026Zhiqiang He, Zhi LiuNeural Network GeneralizationDomain Generalization

    The University of Electro-Communications Tokyo, Japan

  9. Requential Coding: Pushing the Limits of Model Compression with Self-Generated Training Data

    Jul 13, 2026Shikai Qiu, Marc Finzi, Yujia Zheng +2Model CompressionNeural Network Generalization

    New York University · Carnegie Mellon University

  10. How to Tame Grokking: Representation Geometry as a Control Signal

    Jul 13, 2026Maksim A KazanskiiNeural Network GeneralizationSpectral Regularization

    Independent Researcher

  11. Random Label Prediction Heads for Studying Memorization in Deep Neural Networks

    Jul 13, 2026Marlon Becker, Jonas Konrad, Luis Garcia Rodriguez +1Neural Network GeneralizationNeural Network Memorization

    University of Münster, Germany

  12. Emergent Generalization by Representation Learning in Artificial Neural Networks

    Jul 11, 2026Hardik Rajpal, Dan GoodmanNeural Network GeneralizationRepresentation Learning

    1I-X Centre for AI in Science, Imperial College London, W12 0BZ, UK · Department of Electrical and Electronic Engineering, Imperial College London, SW7 2AZ, UK

  13. Similarity search generalisation in contrastive learning with InfoNCE loss

    Jul 10, 2026Nick WhiteleyNeural Network GeneralizationContrastive Learning

    School of Mathematics, University of Bristol, U.K.

  14. A law of robustness for two-layer neural networks with arbitrary weights

    Jul 8, 2026Yitzchak ShmaloNeural Network GeneralizationMultilayer Perceptrons

  15. Architecture Generalization with MetaNCA

    Jul 8, 2026Meet Barot, Daniel Berenberg, Sina KhajehabdollahiNeural Cellular AutomataNeural Network Generalization

    Mythos Scientific, New York, USA · Independent Scholar

  16. A Function-Space Dichotomy for Compositional Learning: Exponential Sub-Optimality of the Neural Tangent Kernel

    Jul 7, 2026Arkaprabha Ganguli, Emil ConstantinescuNeural Network GeneralizationKernel Regression

    Mathematics & Computer Science Division, Argonne National Laboratory, Lemont, IL, USA

  17. Leveraging Extragradient for Effective Sharpness-Aware Minimization in Deep Learning

    Jul 7, 2026Yao Fu, Chunxia Zhang, Junmin Liu +3Neural Network GeneralizationSharpness-Aware Minimization

    School of Mathematics and Statistics, Xi’an Jiaotong University, Xi’an, 710049, China · SGIT AI Lab, State Grid Corporation of China, Xi’an, 710054, China · School of Software, Xi’an Jiaotong University, Xi’an, 710049, China +2

  18. Drift Happens: An Empirical Study of Neural Architecture Robustness to Temporal Distribution Shift

    Jul 7, 2026Robin Holzinger, Riccardo CollettiDistribution Shift RobustnessNeural Network Generalization

    Department of Electrical Engineering and Computer Sciences, University of California, Berkeley, USA

  19. Width-Robust Learnability in Mean-Field Bayesian Neural Networks

    Jul 7, 2026Dmitry Vaintrob, Kaarel HänniBayesian Neural NetworksNeural Network Generalization

    Principles of Intelligence

  20. Broken Ergodicity and the Violation of the Fluctuation-Dissipation Theorem Lead to Generalization Beyond Overfitting in Machine Learning

    Jul 5, 2026Chan Li, Nigel GoldenfeldDouble DescentStatistical Physics of Learning

    Department of Physics, University of California San Diego, 9500 Gilman Drive, La Jolla, California 92093, USA. · Halıcıoğlu Data Science Institute, University of California San Diego, 9500 Gilman Drive, La Jolla, California 92093, USA

  21. Statistically Meaningful Geometry (SMG) Beyond the Euclidean Paradigm, with Application to Generative AI

    Jul 3, 2026Bing Cheng, Yi-Shuai Niu, Howell Tong +1Neural Network GeneralizationInformation Geometry

    Academy of Mathematics and Systems Science, Chinese Academy of Sciences, Beijing, China · AMSS Center for Forecasting Science, Chinese Academy of Sciences, Beijing, China · Beijing Institute of Mathematical Sciences and Applications (BIMSA), Beijing, China +4

  22. Benign Overfitting Does Not Occur in Diffusion Models

    Jul 2, 2026Tyler Farghly, Benjamin Dupuis, Alain Durmus +1Double DescentNeural Network Generalization

    1INRIA - École Normale Supérieure - PSL Research University - CNRS, France · 2 École Polytechnique - CMAP - IP Paris, France

  23. Born Discrete, Made Smooth: Variational Formulation of Shallow Neural Networks

    Jul 2, 2026Matej Benko, Pierre Bousquet, Iwona Chlebicka +1Shallow Neural NetworksNeural Network Generalization

    Institute of Mathematics, Faculty of Mechanical Engineering, Brno University of Technology · Technická 2896/2, 616 69, Brno, Czech Republic · Université de Toulouse, INSA Toulouse, CNRS, IMT, F-31062 Toulouse Cedex 9, France +2

  24. From Approximation to Emergence: A Theory of Deep Learning

    Jul 1, 2026Zhilin ZhaoNeural Network GeneralizationDeep Learning Optimization

    Sun Yat-sen University

  25. Radial Suppression Accelerates Algorithmic Generalization: A Geometric Analysis of Delayed Generalization

    Jun 30, 2026Srijan Tiwari, Aditya Chauhan, Manjot SinghNeural Network GeneralizationNeural Representation Geometry

    Indian Institute of Technology Roorkee

  26. Revisiting the Volume Hypothesis

    Jun 30, 2026Ari Pakman, Lior Kreimer, Yakir BerchenkoNeural Network GeneralizationStochastic Gradient Descent

    Department of Industrial Engineering and Management, Ben-Gurion University of the Negev, Beer Sheva, Israel.

  27. Informational Frustration in Neural Manifolds: Shannon Bottlenecks and the Limits of Learnability

    Jun 29, 2026Srinivasa Rao P., Vangmayi P ReddyStatistical Physics of LearningNeural Network Generalization

    Curlvee Technolabs, India, Former Scientist, C-DAC · Former Scientist, C-DAC · Indian Institute of Technology Madras, India

  28. A Stochastic--Geometric Theory of Scaling Laws in Grokking

    Jun 29, 2026Róisín Luo, Christian Gagné, Jonas Ngnawé +2Neural Network GeneralizationNeural Network Optimization

    Research Ireland – Centre for Research Training in AI · University of Galway · Universit´e Laval +2

  29. Generalization Analysis of Transformers in Distribution Regression

    Jun 28, 2026Peilin Liu, Ding-Xuan ZhouNeural Network GeneralizationTransformer Attention

    School of Mathematics and Statistics, University of Sydney, Sydney, NSW 2006, Australia

  30. How Far Can Sharpness and Complexity Jointly Explain Generalization?

    Jun 27, 2026Ziyu Cheng, Xitong Zhang, Longxiu Huang +1Neural Network GeneralizationStatistical Learning Theory

    Michigan State University