Overparameterization

Ask about this topic

Latest papers

CardsList

22 papers4 papers in the last four weeks, against 2 the four weeks before. 0.0% of all new papers.

  1. On the Optimisation Landscape of Overparameterised Weighted MMD

    Oct 14, 2026Tharrshann Jayan Logarajah, Jeremias Knoblauch, Louis SharrockOverparameterizationMaximum Mean Discrepancy

    University College London

  2. Over-parameterization Is Neither Robust nor Fragile in Matrix Sensing: A Geometric Theory of Solution Robustness

    Oct 13, 2026Runze Shi, Ziye MaOverparameterizationMatrix Factorization

    City University of Hong Kong

  3. Parameter symmetries determine representational geometry in overparameterized nonlinear networks

    Sep 30, 2026Marvin Theiss, Lukas Braun, Andrew M. Saxe +1Overparameterized Neural NetworkNeural Representation Geometry

    University of Tübingen · International Max Planck Research School for Intelligent Systems · Allen Institute for Neural Dynamics +4

  4. Double Descent and Malign Overfitting in Diffusion Models

    Sep 22, 2026Raphaël Urfin, Tony Bonnaire, Giulio Biroli +1Double DescentBenign Overfitting

    Laboratoire de Physique de l’École normale supérieure, ENS, Université PSL, CNRS, Sorbonne Université, Université Paris Cité, F-75005 Paris, France · Université Paris-Saclay, CNRS, Institut d’Astrophysique Spatiale, 91405 Orsay, France · Department of Computing Sciences, Bocconi University, Milano, Italy

  5. Structured Features Overfit Where Random Features Grok

    Sep 14, 2026Chon-Fai Kam, Miloud Bessafi, Frederic CadetNeural Network GeneralizationRidge Regression

    University Paris City & University of Reunion, Paris, France; Dipartimento di Fisica e Chimica · Emilio Segr`e, Universit`a degli Studi di Palermo, Italy · EnergyLab, University of Reunion, Saint-Denis, France +2

  6. Quantifying the Memorization-to-Generalization Transition: Scaling Laws and Phase Structure in Grokking

    Sep 9, 2026Anish KatariaNeural Network Training DynamicsNeural Scaling Laws

    Princeton University, Princeton, NJ, USA.

  7. Online Generalized Sparse Regression: How Does Overparametrization Help?

    Aug 18, 2026Shuoguang Yang, Qiang SunOverparameterizationSparse Recovery

    HKUST · University of Toronto and MBZUAI

  8. Direction-Magnitude Decomposition for Low-Rank Matrix Optimization: Faster Convergence and Saddle-to-saddle Dynamics

    Jun 30, 2026Yudong Wei, Liang Zhang, Bingcong Li +1Low-Rank Matrix DecompositionNonconvex Optimization

    Department of Mathematics, ETH Zurich, Zurich, Switzerland · Department of Computer Science, ETH Zurich, Zurich, Switzerland

  9. Asymmetric Scaling Laws from Sparse Features

    May 22, 2026John Sous, Michael WinerDouble DescentActivation Sparsity

    Department of Applied Physics, Yale University, New Haven, Connecticut 06511, USA · Energy Sciences Institute, Yale University, West Haven, Connecticut 06516, USA · Institute for Advanced Study, Princeton, NJ 08540, USA +1

  10. Unveiling Memorization-Generalization Coexistence: A Case Study on Arithmetic Tasks with Label Noise

    May 18, 2026Linyu Liu, Pinyan LuNeural Network GeneralizationNeural Network Memorization

    1Taylor Lab, Huawei Technologies Co., Ltd. · 2Key Laboratory of Interdisciplinary Research of Computation and Economics, Shanghai University of Finance and Economics

  11. The Role of Symmetry in Optimizing Overparameterized Networks

    Apr 28, 2026Kusha Sareen, Mohammad Pedramfar, Sékou-Oumar Kaba +2Neural Network OptimizationWeight-Space Analysis

    McGill University · Mila - Quebec Artificial Intelligence Institute

  12. Mild Over-Parameterization Benefits Asymmetric Tensor PCA

    Apr 11, 2026Shihong Ding, Weicheng Lin, Cong FangOverparameterizationTensor Decomposition

    Peking University

  13. Sharp description of local minima in the loss landscape of high-dimensional two-layer ReLU neural networks

    Apr 10, 2026Jie Huang, Bruno Loureiro, Stefano Sarao MannelliOverparameterizationLoss Landscape

    Physics, Chalmers University of Technology and University of Gothenburg · Ecole Normale Superieure, PSL & CNRS · Data Science and AI, Computer Science and Engineering, Chalmers University of Technology and University of Gothenburg +1

  14. Implicit Regularization and Generalization in Overparameterized Neural Networks

    Apr 8, 2026Zeran JohannsenOverparameterized Neural NetworkNeural Network Generalization

  15. Towards Initialization-dependent and Non-vacuous Generalization Bounds for Overparameterized Shallow Neural Networks

    Apr 1, 2026Yunwen Lei, Yufeng XieGeneralization BoundsOverparameterized Neural Network

    Department of Mathematics, The University of Hong Kong

  16. The Price of Robustness: Stable Classifiers Need Overparameterization

    Mar 3, 2026Jonas von Berg, Adalbert Fono, Massimiliano Datres +2OverparameterizationRobust Classification

    Ludwig-Maximilians-Universität München Munich, Germany Munich Center for Machine Learning (MCML) · ∗now at Aleph Alpha Research · †University of Tromso, DLR-German Aerospace Center

  17. The power of small initialization in noisy low-tubal-rank tensor recovery

    Mar 3, 2026ZHiyu Liu, Haobo Geng, Xudong Wang +3OverparameterizationGradient Descent

    State Key Laboratory of Robotics and Intelligent Systems, Shenyang Institute of Automation, Chinese Academy of Sciences, China · University of Chinese Academy of Sciences, China · School of Electrical and Electronic Engineering, Nanyang Technological University, Singapore +1

  18. Transfer Learning of Linear Regression with Multiple Pretrained Models: Benefiting from More Pretrained Models via Overparameterization Debiasing

    Feb 18, 2026Daniel Boharon, Yehuda DarOverparameterizationTransfer Learning

    Faculty of Computer and Information Science, Ben-Gurion University.

  19. Critical Points of Degenerate Metrics on Algebraic Varieties: A Tale of Overparametrization

    Dec 24, 2025Giovanni Luca Marchetti, Erin Connelly, Paul Breiding +1Constrained OptimizationOverparameterization

    KTH Royal Institute of Technology & Digital Futures

  20. Favorability of Loss Landscape with Weight Decay Requires Both Large Overparametrization and Initialization

    May 28, 2025Etienne Boursier, Matthew Bowditch, Matthias Englert +1Loss LandscapeOverparameterized Neural Network

    INRIA LMO, Université Paris-Saclay Orsay, France · Mathematics Institute University of Warwick Coventry, UK · Department of Computer Science University of Warwick Coventry, UK

  21. Over-parameterization and Adversarial Robustness in Neural Networks: An Overview and Empirical Analysis

    Jun 14, 2024Srishti Gupta, Zhang Chen, Luca Demetrio +9Overparameterized Neural NetworkAdversarial Attacks

    Sapienza University of Rome, Rome, Italy. · University of Cagliari, Cagliari, Italy. · Northwestern Polytechnical University, Xi’An, China. +1

  22. A Farewell to the Bias-Variance Tradeoff? An Overview of the Theory of Overparameterized Machine Learning

    Sep 6, 2021Yehuda Dar, Vidya Muthukumar, Richard G. BaraniukDouble DescentNeural Network Generalization

    Faculty of Computer and Information Science, Ben-Gurion University · Schools of Electrical and Computer Engineering, and Industrial and Systems Engineering, Georgia Institute of Technology · Electrical and Computer Engineering Department, Rice University