Neural Network Generalization

Ask about this topic

Momentum

21 papers in the last four weeks, up 600% on the four weeks before. 0.2% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 204

All topics
CardsList

  1. Information Plane Analysis of Binary Neural Networks

    May 5, 2026Maximilian Nothnagel, Bernhard C. GeigerNeural Network GeneralizationBinary Neural Networks

    Graz University of Technology, Graz, Austria · Know Center Research GmbH, Graz, Austria · Signal Processing and Speech Communication Laboratory, Graz University of Technology, Graz, Austria +1

  2. A Theory of Generalization in Deep Learning

    May 2, 2026Elon Litman, Gabe GuoNeural Network GeneralizationBenign Overfitting

    Stanford University

  3. Benchmarking ResNet Backbones in RT-DETR: Impact of Depth and Regularization under environmental conditions

    May 1, 2026Pamela Barboza, Víctor Castelli, Belén Pereira +3Neural Network GeneralizationDetection Transformer

    1, Robotics and Artificial Intelligence Laboratory, Technological University of Uruguay, Rivera, Uruguay

  4. Adaptive Norm-Based Regularization for Neural Networks

    Apr 30, 2026Muhammad Qasim, Farrukh JavedNeural Network Generalization

    Department of Statistics, Lund University, Lund, Sweden

  5. Decoupled Descent: Exact Test Error Tracking Via Approximate Message Passing

    Apr 30, 2026Max LovigNeural Network GeneralizationGradient Descent

    Statistics and Data Science, Yale University

  6. Multiple Additive Neural Networks for Structured and Unstructured Data

    Apr 29, 2026Janis Mohr, Jörg FrochteNeural Network Generalization

    Interdisciplinary Institute for Applied Artificial Intelligence and Data Science Ruhr Bochum University of Applied Sciences 42579 Heiligenhaus, Germany

  7. Investigation into In-Context Learning Capabilities of Transformers

    Apr 28, 2026Rushil Chandrupatla, Leo Bangayan, Sebastian LengNeural Network GeneralizationTransformer

  8. Unveiling the Backdoor Mechanism Hidden Behind Catastrophic Overfitting in Fast Adversarial Training

    Apr 27, 2026Mengnan Zhao, Lihe Zhang, Tianhang Zheng +2Adversarial TrainingNeural Network Generalization

    School of Computer Science and Technology, Anhui University, Hefei 230601, China · School of Information and Communication Engineering, Dalian University of Technology (DUT), Dalian 116024, China · School of Computer Science and Technology, Zhejiang University, Hangzhou 310058, China +1

  9. Mitigating Error Amplification in Fast Adversarial Training

    Apr 27, 2026Mengnan Zhao, Lihe Zhang, Bo Wang +3Adversarial TrainingNeural Network Generalization

    Anhui University, Anhui, China · Dalian University of Technology, Liaoning, China · Zhejiang University, Zhejiang, China +1

  10. Self-Abstraction Learning for Effective and Stable Training of Deep Neural Networks

    Apr 27, 2026Wonyong Cho, Taemin Kim, Jungmin Kim +2Neural Network GeneralizationNeural Network Optimization

    Department of Mathematics, University of Seoul, Seoul 02504, South Korea · Department of Applied Artificial Intelligence, Hansung University, Seoul 02876, South Korea

  11. L-System Genetic Encoding for Scalable Neural Network Evolution: A Comparison with Direct Matrix Encoding

    Apr 23, 2026Alexander Stuy, Nodin WeddingtonNeural Network GeneralizationEvolutionary Optimization

    Florida State University

  12. Explicit Dropout: Deterministic Regularization for Transformer Architectures

    Apr 22, 2026Vidhi Agrawal, Illia Oleksiienko, Alexandros IosifidisNeural Network Generalization

    Faculty of Information Technology and Communications,Tampere University, Tampere, 33720, Finland · Department of Electrical and Computer Engineering, Aarhus University, Aarhus, 8000, Denmark

  13. ILDR: Geometric Early Detection of Grokking

    Apr 22, 2026Shreel GolwalaNeural Network GeneralizationEarly Stopping

    Virginia Tech

  14. Generalization and Membership Inference Attack a Practical Perspective

    Apr 21, 2026Fateme Rahmani, Mahdi Jafari Siavoshani, Mohammad Hossein RohbanNeural Network GeneralizationMembership Inference Attacks

    Department of Computer Engineering Sharif University of Technology Tehran, Iran

  15. Generalization at the Edge of Stability

    Apr 21, 2026Mario Tuci, Caner Korkmaz, Umut Şimşekli +1Intrinsic DimensionalityNeural Network Generalization

    INRIA, CNRS, Département d’Informatique de l’Ecole Normale Supérieure / PSL, France · Department of Computing, Imperial College London, United Kingdom

  16. Benign Overfitting in Adversarial Training for Vision Transformers

    Apr 21, 2026Jiaming Zhang, Meng Ding, Shaopeng Fu +2Adversarial TrainingNeural Network Generalization

    Division of CEMSE, King Abdullah University of Science and Technology · School of Statistics, Renmin University of China · Department of Computer Science and Engineering, State University of New York at Buffalo +1

  17. PAC-Bayes Bounds for Gibbs Posteriors via Singular Learning Theory

    Apr 19, 2026Chenyang Wang, Yun YangNeural Network GeneralizationPAC-Bayesian Generalization Bounds

    Department of Statistics, University of Illinois Urbana-Champaign · Department of Mathematics, University of Maryland, College Park

  18. When Do Early-Exit Networks Generalize? A PAC-Bayesian Theory of Adaptive Depth

    Apr 17, 2026Dongxin Guo, Jikun Wu, Siu Ming YiuNeural Network GeneralizationPAC-Bayesian Generalization Bounds

    The University of Hong Kong, Hong Kong, China · Brain Investing Limited, Hong Kong, China

  19. Stability and Generalization in Looped Transformers

    Apr 16, 2026Asher LabovichNeural Network GeneralizationDynamical Systems

  20. Chaotic CNN for Limited Data Image Classification

    Apr 16, 2026Anusree M, Akhila Henry, Pramod P NairNeural Network GeneralizationConvolutional Neural Networks

    1*Department of Mathematics, Amrita Vishwa Vidyapeetham, Amritapuri, India.

  21. CLion: Efficient Cautious Lion Optimizer with Enhanced Generalization

    Apr 16, 2026Feihu Huang, Guanyi Zhang, Songcan ChenStochastic OptimizationSign-Based Optimization

    College of Computer Science and Technology, Nanjing University of Aeronautics and Astronautics, Nanjing, China · MIIT Key Laboratory of Pattern Analysis and Machine Intelligence, Nanjing, China

  22. VISTA: Validation-Informed Trajectory Adaptation via Self-Distillation

    Apr 13, 2026Eli Corn, Daphna WeinshallNeural Network GeneralizationDeep Learning Optimization

    Department of Computer Science, Hebrew University of Jerusalem, Jerusalem, Israel.

  23. The Rules-and-Facts Model for Simultaneous Generalization and Memorization in Neural Networks

    Mar 26, 2026Gabriele Farné, Fabrizio Boncoraglio, Lenka ZdeborováNeural Network GeneralizationNeural Network Memorization

    Statistical Physics of Computation Laboratory, École Polytechnique Fédérale de Lausanne (EPFL) CH-1015 Lausanne

  24. Rigorous Error Certification for Neural PDE Solvers: From Empirical Residuals to Solution Guarantees

    Mar 19, 2026Amartya Mukherjee, Maxwell Fitzsimmons, David C. Del Rey Fernández +1Neural Network GeneralizationNeural PDE Solvers

    Department of Applied Mathematics, University of Waterloo, Waterloo, ON, Canada

  25. Asymptotic Behavior of Multi--Task Learning: Implicit Regularization and Double Descent Effects

    Mar 5, 2026Ayed M. Alrashdi, Oussama Dhifallah, Houssem SifaouDouble DescentNeural Network Generalization

    Department of Electrical Engineering, College of Engineering, University of Ha’il, P.O. Box 2440, Ha’il, 81441, Saudi Arabia · John A. Paulson School of Engineering and Applied Sciences, Harvard University, Cambridge, MA 02138, USA · Department of Electrical and Electronic Engineering, King’s College London – Strand, London WC2R 2LS – London, UK

  26. To Use or not to Use Muon: How Simplicity Bias in Optimizers Matters

    Feb 28, 2026Sara Dragutinović, Yedi Zhang, Rajesh RanganathNeural Network GeneralizationMuon Optimizer

    Courant Institute School of Mathematics, Computing, and Data Science, New York University · Gatsby Computational Neuroscience Unit, University College London

  27. A Theory of How Pretraining Shapes Inductive Bias in Fine-Tuning

    Feb 23, 2026Nicolas Anguita, Francesco Locatello, Andrew M. Saxe +4Neural Network GeneralizationRepresentation Learning

    Department of Engineering, University of Cambridge · Institute of Science and Technology, Austria (ISTA) · Gatsby Computational Neuroscience Unit and Sainsbury Wellcome Centre, UCL +1

  28. Theoretical Analysis of Measure Consistency Regularization for Partially Observed Data

    Feb 1, 2026Yinsong Wang, Shahin ShahrampourNeural Network GeneralizationLearning with Missing Data

    University of Nevada Reno, Reno, NV 89557 USA · Department of Mechanical and Industrial Engineering at Northeastern University, Boston, MA 02115 USA

  29. To Grok Grokking: Provable Grokking in Ridge Regression

    Jan 27, 2026Mingyue Xu, Gal Vardi, Itay SafranNeural Network GeneralizationRidge Regression

    Department of Computer Science, Purdue University, West Lafayette, IN, USA · Department of Computer Science and Applied Mathematics, Weizmann Institute of Science, Israel · Stein Faculty of Computer and Information Science, Ben-Gurion University of the Negev, Israel

  30. Addressing A Posteriori Performance Degradation in Neural Network Subgrid Stress Models

    Nov 21, 2025Andy Wu, Sanjiva K. LeleNeural Network GeneralizationData Augmentation

    Department of Aeronautics and Astronautics, Stanford University, Stanford, California, USA · Department of Mechanical Engineering, Stanford University, Stanford, California, USA