Implicit Regularization

Ask about this topic

Momentum

3 papers in the last four weeks, with none the four weeks before. 0.0% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 35

All topics
CardsList

  1. A Broader Look at Model Merging: Rethinking Implicit Regularization Induced by Task Arithmetic

    Oct 6, 2026Sin-Han Yang, Shih-Cheng Huang, Chieh-Yen Lin +3Task Vector MergingMulti-Task Optimization

    Appier AI Research · National Taiwan University

  2. Mind the Drift: Diagonal Linear Networks Under Large Learning Rates

    Oct 5, 2026Aniket Sanyal, Tom Jacobs, Rebekka BurkholzEdge of StabilityDeep Learning Optimization

    CISPA Helmholtz Center for Information Security · Technical University of Munich · Konrad Zuse School of Excellence in Learning and Intelligent Systems (ELIZA)

  3. Grokking through the Lens of Minimum-Norm Interpolation

    Sep 29, 2026Gil Kur, Ileana Rugina, Clémentine Carla Juliette Dominé +1Statistical Learning TheoryImplicit Regularization

    ETH Zürich · Institute of Science and Technology Austria · Harvard University

  4. Minimal-Norm Univariate Two-Layer ReLU Classification: Exact Solutions and Global Optimality with Skip Connections

    Sep 23, 2026Karolina Drabik, Ben Lewis, Antoni Puch +4ReLU Neural NetworksNeural Network Optimization

    Department of Mathematics, Informatics and Mechanics, University of Warsaw, Poland · Department of Computer Science, University of Warwick, UK · INRIA & LMO, Université Paris-Saclay, France

  5. A Function-Space Approach to the Statistical Mechanics of Learning Dynamics

    Sep 9, 2026Yizhou Zhang, Weichen Wu, Lun Du +1Statistical Physics of LearningRepresentation Learning

    Variational AI · The Voleon Group · Independent Researcher +1

  6. Non-asymptotic implicit bias of logistic regression at early-stage gradient descent dynamics

    Aug 5, 2026Han BaoLogistic RegressionImplicit Bias

    The Institute of Statistical Mathematics · Tohoku University · RIKEN AIP

  7. Quotient Dynamics, Effective Curvature, and Implicit Bias in Positive Quadratic Networks

    Jul 28, 2026Pengcheng ChengRiemannian OptimizationImplicit Regularization

    School of Mathematics, Jilin University Changchun, 130012, China

  8. Beyond Negative-Ridge Endpoints: Mixed-Sign Spectral Regularization via Negative-Shifted Gradient Descent

    Jul 24, 2026Peng ZhaoSpectral RegularizationEarly Stopping

    Department of Applied Economics and Statistics · University of Delaware

  9. FAIR: Feature-Augmented Implicit Regularization for AI-generated Fake Image Detection

    Jul 24, 2026Md Redwanul Haque, Manzur Murshed, Manoranjan Paul +1Domain GeneralizationAI-Generated Image Detection

    Deakin University, Burwood, VIC, Australia · Charles Sturt University, Bathurst, NSW, Australia

  10. PN-QNN: Harnessing Physical Noise as a Native Regularizer in Photonic Hybrid Quantum Neural Networks

    Jul 22, 2026Farah Elnakhal, Alberto Marchisio, Nouhaila Innan +2Hybrid Quantum-Classical MLPhotonic Computing

    Science Division, New York University Abu Dhabi, UAE · eBrain Lab, Division of Engineering, New York University Abu Dhabi, PO Box 129188, Abu Dhabi, UAE · Center for Quantum and Topological Systems, NYUAD Research Institute, New York University Abu Dhabi, UAE +1

  11. Adaptive Runge-Kutta Step Control Buys Training Loss, Not Generalization: An Honest Compute-Matched Study of RK-Adam Optimizers

    Jul 16, 2026Akhilesh GogikarNeural Network OptimizationAdaptive Gradient Methods

    1Independent Researcher.

  12. Stability Annealing Selects the Implicit Bias of Smoothed Sign Descent: A Rate-Indexed Barrier Path on Separable Data

    Jul 7, 2026Xiangwu Wang, Chengwei Cao, Yicheng Song +2Sign-Based OptimizationImplicit Regularization

    1The University of Hong Kong · University of California, San Diego · 3Beijing University of Aeronautics and Astronautics

  13. Decoherence as Defence and the Magnitude of Noise Regularisation: A Rigorous N -Qubit Theory of Stochastic Quantum Neural Networks for Adversarially Robust Network Intrusion Detection

    Jun 23, 2026Gautier-Edouard Edouard FilardoNetwork Intrusion DetectionNeural Network Robustness

    CREOGN · Efrei Research Lab, Efrei Paris Panth´eon-Assas Universit´e, Villejuif, France

  14. The Spectral Dynamics and Noise Geometry of Muon

    Jun 7, 2026Pierfrancesco Beneventano, Mahmoud Abdelmoneum, Tomaso PoggioMuon OptimizerMatrix Optimization

    Massachusetts Institute of Technology

  15. Closed-Form Spectral Regularization for Multi-Task Model Merging

    Jun 5, 2026Yongxian Wei, Runxi Cheng, Xingxuan Zhang +4Spectral RegularizationMulti-Task Learning

    Shenzhen International Graduate School, Tsinghua University, Shenzhen 518071, China · Department of Computer Science and Technology, Tsinghua University, Beijing 100084, China · Sun Yat-sen University, Shenzhen 510275, China +1

  16. Implicit Fuzzification via Bounded Noise Injection for Robust Medical Image Segmentation

    Jun 3, 2026Bisheng Tang, Zhangfeng Ma, Chuchu Zhai +4Ultrasound Image SegmentationMedical Image Segmentation

    School of Information Science and Engineering, Provincial Key Laboratory of Informational Service for Rural Area of Southwestern Hunan, Shaoyang University, Shaoyang 422000, China · Xinshao County People’s Hospital, Shaoyang 422900, China

  17. Fast Generalization after Interpolation via Critically Damped Momentum Optimization

    Jun 1, 2026Luca Muscarnera, Silas Ruhrberg Estévez, Yuanzhang Xiao +1Neural Network GeneralizationMomentum Methods

  18. Stochastic Rounding Increases Small Singular Values

    May 29, 2026Linkai Ma, Tingzhou Yu, Petros DrineasSpectral RegularizationImplicit Regularization

    Department of Mathematics University of Alberta

  19. Improving Adversarial Robustness of Attribution via Implicit Regularization

    May 28, 2026Amir Mehrpanah, Matteo Gamba, Hossein AzizpourTransformer InterpretabilityNeural Network Robustness

    Department of Computer Science, KTH Royal Institute of Technology, Stockholm, Sweden · Department of Computer Science, Brown University, USA · Science for Life Laboratory, Stockholm, Sweden

  20. Implicit Regularization in Perturbed Deep Matrix Factorization: Spectral Conditions and Stability

    May 27, 2026Jingzhe Wang, Hung-Hsu ChouAlgorithmic StabilityLow-Rank Matrix Decomposition

    Department of Informatics and Networked Systems, University of Pittsburgh · Department of Mathematics, University of Pittsburgh

  21. Mildly Overparameterized ReLU Networks on Orthogonal Data: Incremental Learning and Implicit Bias

    May 26, 2026James Town, Etienne Boursier, Ben Lewis +2ReLU Neural NetworksNeural Network Optimization

    University of Warwick · INRIA LMO, Université Paris-Saclay

  22. From Latent Space to Training Data: Explainable Specialization in Minimal MLPs

    May 25, 2026Enrique Alba, Ezequiel Lopez-RubioMultilayer PerceptronsNeural Network Interpretability

    aITIS Software, University of Malaga, Spain

  23. Implicit Binarization via Complex Phase Dynamics in Combinatorial Optimization

    May 23, 2026Khen Cohen, Mark Glass, Meir Feder +1Combinatorial OptimizationQuadratic Unconstrained Binary Optimization

    School of Physics and Astronomy, Tel Aviv University, Tel Aviv, Israel · School of Electrical and Computer Engineering, Tel Aviv University, Tel Aviv, Israel

  24. Implicit Regularization of Mini-Batch Training in Graph Neural Networks

    May 21, 2026Clement Wang, Antoine Vialle, Robin Vaysse +1Graph Neural NetworksImplicit Regularization

    Institut Polytechnique de Paris · Mirakl

  25. Understanding Dynamics of Adam in Zero-Sum Games: An ODE Approach

    May 19, 2026Yi Feng, Weiming Ou, Xiao WangZero-Sum GamesMin-Max Optimization

    Aarhus University, Aarhus, Denmark · Shanghai University of Finance and Economics, Shanghai, China · MoE Key Laboratory of Interdisciplinary Research of Computation and Economics, Shanghai University of Finance and Economics, Shanghai, China

  26. Canonical Regularisation of Wide Feature-Learning Neural Networks

    May 18, 2026George Whittle, Pranav Vaidhyanathan, Juliusz Ziomek +2Kernel Ridge RegressionRepresentation Learning

    Department of Engineering Science University of Oxford

  27. Beyond What to Select: A Plug-and-play Oscillatory Data-Volume Scheduling for Efficient Model Training

    May 14, 2026Suorong Yang, Hanqi Zhu, Hai Gan +4Deep Learning OptimizationData Selection

    1National University of Singapore · 2Nanjing University · 3Hokkaido University +1

  28. Optimizer-Induced Mode Connectivity: From AdamW to Muon

    May 11, 2026Fangzhao Zhang, Sungyoon Kim, Erica Zhang +2Mode ConnectivityNeural Network Optimization

    Stanford University

  29. Estimating Implicit Regularization in Deep Learning

    May 6, 2026Joseph H. Rudoler, Kevin Tan, Giles Hooker +1Neural Network OptimizationImplicit Bias

    University of Pennsylvania

  30. When Does Removing LayerNorm Help? Activation Bounding as a Regime-Dependent Implicit Regularizer

    Apr 25, 2026Lucky VermaNeural Network Activation FunctionsLayer Normalization

    Independent Researcher