Neural Network Generalization

Ask about this topic

Momentum

21 papers in the last four weeks, up 600% on the four weeks before. 0.2% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 204

All topics
CardsList

  1. How Width and Data Shape Generalization Scaling Laws in Quadratic Neural Networks

    Jun 26, 2026Julius Girardin, Emanuele Troiani, Yizhou Xu +3Neural Network GeneralizationScaling Laws

    1Statistical Physics of Computation Laboratory, École Polytechnique Fédérale de Lausanne (EPFL) · 2Information, Learning and Physics Laboratory, École Polytechnique Fédérale de Lausanne (EPFL)

  2. Applicability of memorization indicators for early spotting of overfitting while recalibrating sEMG-decoders on low sample sizes

    Jun 26, 2026Stephan J. Lehmler, Tobias Glasmachers, Ioannis IossifidisNeural Network GeneralizationNeural Decoding

    German Aerospace Center (DLR), Institute for AI Safety and Security, Ulm, Germany · Faculty of Electrical Engineering and Information Technology, Ruhr University Bochum, Bochum, Germany · Institute for Neural Computation, Ruhr University Bochum, Bochum, Germany +1

  3. The Generalization Spectrum: A Chromatographic Approach to Evaluating Learning Algorithms

    Jun 24, 2026Jinghan Zhang, Zerui Cheng, Shiqi Chen +5Neural Network GeneralizationReinforcement Learning

    1ByteDance Seed · 2Hong Kong University of Science and Technology · 3Princeton University +1

  4. Certification of Machine Learning Models via Directional Sharpness

    Jun 23, 2026Gefei Tan, Adria Gascon, Sarah Meiklejohn +1Neural Network GeneralizationNeural Network Verification

    Northwestern University & Google · Google · University College London

  5. Trimming the Long-Tail of Visual World Modeling Evaluation

    Jun 23, 2026Bingxuan Li, Yining Hong, Cheng Qian +6Neural Network GeneralizationPhysical Consistency in Video Generation

    University of Illinois Urbana-Champaign · Stanford University · Columbia University

  6. DREG: A Layer-Wise Jacobian Regularization as a General-Purpose Penalty

    Jun 22, 2026Rowan MartnishnNeural Network GeneralizationJacobian Regularization

  7. Sublinearly Structured Deep Neural Networks Achieve Feature Learning Consistency for Compositional Functions

    Jun 22, 2026Sehwan Kim, Yan Sun, Faming LiangNeural Network GeneralizationHierarchical Representation Learning

    Ewha Womans University, Seoul 03760, Republic of Korea · New Jersey Institute of Technology, Newark, NJ 07102, USA · Purdue University, West Lafayette, IN 47907, USA

  8. Statistical Properties of Training & Generalization

    Jun 18, 2026Itay Lavie, Noam Levi, Yonatan KahnNeural Network GeneralizationScientific ML

    John A. Paulson School of Engineering and Applied Sciences, Harvard University, Cambridge, MA, USA · Tel Aviv University, Tel Aviv, Israel · Department of Physics, University of Toronto and Vector Institute, Toronto, ON, Canada

  9. Smoothness-Based Derandomization of PAC-Bayes Bounds

    Jun 17, 2026Alexandre Lemire Paquin, Brahim Chaib-Draa, Philippe GiguèreNeural Network GeneralizationPAC-Bayesian Generalization Bounds

    Department of Computer Science and Software Engineering Université Laval, Québec, Canada

  10. Experimental Analysis of Neural Network-Based Image Classification on the CIFAR-10 Dataset

    Jun 17, 2026Necati Kagan Erkek, Emre Balci, Berkin HalayNeural Network GeneralizationConvolutional Neural Networks

    Department of Electronics and Communication Engineering, Istanbul Technical University, Istanbul, Turkey

  11. What Does the Weight Norm Control in Grokking? Logit-Scale Mediation under Cross-Entropy

    Jun 16, 2026Truong Xuan KhanhNeural Network GeneralizationNeural Network Training Dynamics

    H&K Research Studio, Clevix LLC · Hanoi, Vietnam

  12. Upper Bounds on the Generalization Error of Deep Learning Models via Local Robustness and Stability

    Jun 15, 2026Abdul-Rauf Nuhu, Parham M. Kebria, Vahid Hemmati +3Neural Network GeneralizationNeural Network Robustness

    aNorth Carolina Agricultural and Technical State University, Dept. Electrical and Computer Engineering 1601 E Market St., Greensboro, 27411, NC, USA · bUniversity of Alabama, Dept. Computer Science, Tuscaloosa, 35487, AL, USA · cSouthwest Research Institute, San Antonio, 78238, TX, USA

  13. Noise-Driven Escape from Metastable Phases explains Grokking in Deep Neural Networks

    Jun 15, 2026Ibrahim Talha Ersoy, Karoline WiesnerStatistical Physics of LearningNeural Network Generalization

    Complexity Science Group, Institute of Physics and Astronomy, University of Potsdam, Potsdam, Germany

  14. How Post-Training Shapes Biological Reasoning Models

    Jun 15, 2026Lukas Fesser, Hanlin Zhang, Michelle M. Li +5Neural Network GeneralizationSupervised Fine-Tuning

    Harvard University · Google DeepMind · Google Research

  15. LiFT: Local Search via Linear Programming for Overfitting-Controlled Transformers

    Jun 15, 2026Abhishek Shukla, Anikeit Khanna, Ankur Sinha +1Neural Network GeneralizationLLM Fine-Tuning

    Department of Management Sciences, Indian Institute of Technology Kanpur, Kanpur-208016, Uttar Pradesh, India · Brij Disa Centre for Data Science and AI, Indian Institute of Management Ahmedabad, Ahmedabad-380015, Gujarat, India · Department of Civil Engineering, Indian Institute of Technology Kanpur, Kanpur-208016, Uttar Pradesh, India +1

  16. Uncertainty Estimation and Generalization Bounds for Modern Deep Learning

    Jun 11, 2026Luis A. OrtegaBayesian Neural NetworksNeural Network Generalization

    Department of Computer Science Machine Learning Group Madrid

  17. The Weight Norm Sets the Grokking Timescale: A Causal Delay Law

    Jun 11, 2026Truong Xuan Khanh, Doan Hoang Viet, Luu Duc Trung +1Neural Network GeneralizationNeural Network Training Dynamics

    H&K Research Studio / Clevix LLC, Hanoi, Vietnam · Bac A Bank, Hanoi · Banking Academy of Vietnam

  18. Simplicity Suffices for Parameter Noise Injection in Stochastic Gradient Descent

    Jun 10, 2026Benjamin Leblanc, Louis-Jacob Lebel, Teddy Kana +1Neural Network GeneralizationDeep Learning Optimization

    Universit´e Laval

  19. Learning from almost nothing: How neural networks survive heavy input corruption

    Jun 9, 2026Justin Tahmassebpur, Asadullah Bhuiyan, Hyejin Kim +1Neural Network GeneralizationMultilayer Perceptrons

    Department of Applied and Engineering Physics, Cornell University, Ithaca, NY 14853, USA · Department of Physics, Cornell University, Ithaca, NY 14853, USA

  20. A Theory on Flow Matching with Neural Networks

    Jun 8, 2026Yihan He, Qishuo Yin, Yuan Cao +2Neural Network GeneralizationFlow Matching

    Princeton University, Princeton, NJ, USA. · The University of Hong Kong, Hong Kong. · Northwestern University, Evanston, IL, USA.

  21. Fourier Neural Operators with rank-1 lattice points and hyperbolic cross

    Jun 7, 2026Jakob Dilen, Alexander Keller, Frances Y. Kuo +1Neural Network GeneralizationFourier Neural Operator

  22. Fourier fractal dimension to predict the generalization of deep neural networks

    Jun 6, 2026Joao B. Florindo, Davi Wanderley MisturiniNeural Network GeneralizationNeural Network Training Dynamics

    Institute of Mathematics, Statistics and Scientific Computing - University of Campinas Rua Sérgio Buarque de Holanda, 651, Cidade Universitária “Zeferino Vaz” - Distr. Barão Geraldo, CEP 13083-859, Campinas, SP, Brasil

  23. Layer-wise Derivative Controlled Networks Achieve Competitive Accuracy and Gradient Stability Across Data Regimes

    Jun 6, 2026Rowan MartnishnNeural Network GeneralizationPolynomial Neural Networks

  24. Generalization in Deep Neural Networks: Minimax Rates for Gradient Methods

    Jun 4, 2026Junyu Zhou, Puyu Wang, Yunwen Lei +2Neural Network GeneralizationGradient Descent Dynamics

    Mathematical Institute for Machine Learning and Data Science, Catholic University of Eichstätt-Ingolstadt · Department of Computer Science, RPTU Kaiserslautern-Landau · Department of Mathematics, The University of Hong Kong +1

  25. Optimal Rates for Generalization of Gradient Descent Methods with Deep Neural Networks

    Jun 4, 2026Junyu Zhou, Puyu Wang, Yunwen Lei +2Neural Network GeneralizationReLU Neural Networks

    Mathematical Institute for Machine Learning and Data Science, KU Eichstätt-Ingolstadt, Ingolstadt, Germany · Department of Computer Science, RPTU Kaiserslautern-Landau, Kaiserslautern, Germany · Department of Mathematics, University of Hong Kong, Hong Kong, China +1

  26. Flatness and Generalization: Learning Multi-Index Models with Homogeneous Neural Networks

    Jun 3, 2026Harsh Vardhan, Hossein Taheri, Arya MazumdarNeural Network GeneralizationFlat Minima

  27. An Empirical Study of Data Scale, Model Complexity, and Input Modalities in Visual Generalization

    Jun 3, 2026Yidi ZhouluoNeural Network GeneralizationAI Scaling Laws

    School of Medical Information and Artificial Intelligence, Shandong First Medical University, Taian 271000, Shandong, China

  28. An Asymptotic Theory of Chain-of-Thought in In-Context Learning

    Jun 2, 2026Kaito Takanami, Cengiz PehlevanNeural Network GeneralizationCoT Reasoning

    Department of Physics, Graduate School of Science, The University of Tokyo · John A. Paulson School of Engineering and Applied Sciences, Harvard University · Kempner Institute for the Study of Natural and Artificial Intelligence, Harvard University +1

  29. Fast Generalization after Interpolation via Critically Damped Momentum Optimization

    Jun 1, 2026Luca Muscarnera, Silas Ruhrberg Estévez, Yuanzhang Xiao +1Neural Network GeneralizationMomentum Methods

  30. RADE: Random Add-Drop Edge as a Regularizer

    May 30, 2026Danial Saber, Amirali Salehi-AbariNeural Network GeneralizationGraph Neural Networks

    Ontario Tech University, Oshawa, Ontario, Canada.