Descent

Ask about this topic

Momentum

3 papers in the last four weeks, with none the four weeks before. 0.0% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 31

All topics
CardsList

  1. LionMuon: Alternating Spectral and Sign Descent for Efficient Training

    Sep 28, 2026Arman Bolatov, Artem Riabinin, Nikita Kornilov +4MuonDescent

    Mohamed bin Zayed University of Artificial Intelligence (MBZUAI) · Basic Research of Artificial Intelligence Laboratory (BRAIn Lab) · Applied Artificial Intelligence Institute +1

  2. Double Descent and Malign Overfitting in Diffusion Models

    Sep 22, 2026Raphaël Urfin, Tony Bonnaire, Giulio Biroli +1OverfittingOverparameterization

    Laboratoire de Physique de l’École normale supérieure, ENS, Université PSL, CNRS, Sorbonne Université, Université Paris Cité, F-75005 Paris, France · Université Paris-Saclay, CNRS, Institut d’Astrophysique Spatiale, 91405 Orsay, France · Department of Computing Sciences, Bocconi University, Milano, Italy

  3. Double descent is the principle of least action

    Sep 16, 2026Congzhou M ShaDescentWeight Decay

    Penn Medicine Doylestown Hospital, 595 W State St, Doylestown, PA 18901, United States

  4. Hyper-ES: Effective Evolution Strategies for LLM Reasoning via Descent Direction Merging

    Aug 6, 2026Yu Gu, Zhi Zheng, Yunpeng Ba +3LLM Reasoning StrategiesEvolutionary Optimization Methods

    School of Intelligence Science and Technology, Nanjing University, China · School of Computing, National University of Singapore, Singapore · School of Automation and Intelligent Manufacturing, Southern University of Science and Technology, China +1

  5. Double Descent in Gradient Boosting Decision Trees via Split-Candidate Scaling

    Aug 4, 2026Ryuichi KanohGradient Boosted Decision TreeDecision Trees

    1The University of Electro-Communications · 2National Institute of Informatics

  6. Non-KKT Accumulation in Entropic Mirror Descent

    Aug 3, 2026Kuangyu Ding, Kim-Chuan TohMirror DescentDescent

    School of Industrial Engineering, Purdue University, West Lafayette, IN 47907, USA. · Department of Mathematics and Institute of Operations Research and Analytics, National University of Singapore, Singapore 119076.

  7. Code Is the Body: Agent-Owned Software Bodies for Recursive Evolution and Descent

    Jul 30, 2026Roy Zhao, Zhenyu ZhaoSelf-Evolving AgentsSelf-Evolution

    Paul G. Allen School of Computer Science & Engineering, University of Washington · 1Paul G. Allen School of Computer Science & Engineering, University of Washington · Independent Researcher +1

  8. Origins and mitigation of double descent in reduced order modeling

    Jul 29, 2026Andrei A. Klishin, J. Nathan Kutz, Krithika ManoharReconstruction ErrorDescent

    Department of Mechanical Engineering, University of Hawai‘ i at M¯anoa, Honolulu, HI · AI Institute in Dynamic Systems, University of Washington, Seattle, WA 98195, USA · Departments of Applied Mathematics and Electrical and Computer Engineering, University of Washington, Seattle, WA 98195, USA +1

  9. Learning from the Descent Direction: Adaptive Gradient Descent under One-Sided Hölder Regularity

    Jul 24, 2026Arzu Ahmadova, Ismail HuseynovGradient DescentDescent

    Weierstrass Institute for Applied Analysis and Stochastics Berlin, Germany · Physikalisch-Technische Bundesanstalt (PTB), Germany · Technical University of Berlin, Germany

  10. Cautious optimism for deep parameterized quantum circuits

    Jul 23, 2026Marie Kempkes, Elies Gil-Fuster, Carlos Bravo-Prieto +5Quantum Machine LearningQuantum Circuits

    Leiden University, Niels Bohrweg 1, 2333 CA Leiden, Netherlands · Volkswagen Group Innovation, Berliner Ring 2, 38440 Wolfsburg, Germany · Dahlem Center for Complex Quantum Systems, Freie Universität Berlin, 14195 Berlin, Germany +4

  11. TwistedMerge: Certified Higher-Order Diagnostics and Abstention for Model Merging

    Jul 23, 2026Ting Gong, Shitan XuContinual Model MergingMerge

    Department of Mathematics, University of Washington, Box 354350, Seattle, WA 98195-4350, USA · Beijing International Center for Mathematical Research, Peking University, No. 5 Yiheyuan Road, Haidian District, Beijing, 100871, P.R. China

  12. Desc++: Efficient Descriptor Enhancement for Data Association in Existing Visual SLAM Systems

    Jul 13, 2026Ting-Wei Ou, Huang-Ting Lin, Kuu-Young YoungOrb-Slam2Simultaneous Localization And Mapping

  13. Benign Overfitting Does Not Occur in Diffusion Models

    Jul 2, 2026Tyler Farghly, Benjamin Dupuis, Alain Durmus +1OverfittingScore-Based Diffusion Model

    1INRIA - École Normale Supérieure - PSL Research University - CNRS, France · 2 École Polytechnique - CMAP - IP Paris, France

  14. End-to-End Control of a Powered Knee-Ankle Prosthesis Towards Unified, Tuning-Free Assistance

    Jun 5, 2026John Shim, Christoph Nuesslein, Sixu Zhou +3Abox Abduction ProblemFeet

    Woodruff School of Mechanical Engineering and the Institute for Robotics and Intelligent Machines, Georgia Institute of Technology, Atlanta, GA 30332-0405 USA · Woodruff School of Mechanical Engineering, Georgia Institute of Technology, Atlanta, GA 30332-0405 USA

  15. Trust Region Q Adjoint Matching

    May 26, 2026Yonghoon Dong, Kyungmin Lee, Changyeon Kim +2Flow PoliciesQ-Learning

    1KAIST AI · 2Seoul National University · 3RLWRLD

  16. Two Speeds of Learning: A Representation-Readout Decomposition of Grokking and Double Descent

    May 26, 2026Chi-Ning Chou, Oscar Uzdelewicz, Neng-Chun Chiu +2GrokkingDescent

    Center for Computational Neuroscience, Flatiron Institute, New York, NY, USA. · Department of Physics, Harvard University, Cambridge, MA, USA. · Kempner Institute, Harvard University, Allston, MA, USA. +1

  17. The Stability of Singular Distribution: A Spectral Perspective on the Two-Phase Dynamics of Language Model Pre-training

    May 26, 2026Hongtao Zhang, Wenjie Zhou, Chenxi Jia +2Large Language Model PretrainingPretraining

    State Key Laboratory of AI Safety, Institute of Computing Technology, Chinese Academy of Sciences, Beijing, China · School of Advanced Interdisciplinary Sciences, University of Chinese Academy of Sciences, Beijing, China · University of Chinese Academy of Sciences, Beijing, China +1

  18. LionMuon: Alternating Spectral and Sign Descent for Efficient Training

    May 19, 2026Arman Bolatov, Artem Riabinin, Nikita Kornilov +4MuonDescent

    Mohamed bin Zayed University of Artificial Intelligence (MBZUAI) · Basic Research of Artificial Intelligence Laboratory (BRAIn Lab) · Applied Artificial Intelligence Institute +1

  19. Adynamical systems view of training generativemodels and the memorization phenomenon

    May 19, 2026Siva Athreya, Chiranjib Bhattacharya, Vivek S. BorkarStochastic Gradient DescentMemorization

    International Institute for Theoretical Sciences, Survey No. 151, Hesarghatta Road, Shivakote Hobli, Bengaluru 560089, India · Department of Computer Science and Automation, Indian Institute of Science, Bengaluru 560012, India · Department of Electrical Engineering, Indian Institute of Technology Bombay, Powai, Mumbai 400076, India

  20. Understanding Dynamics of Adam in Zero-Sum Games: An ODE Approach

    May 19, 2026Yi Feng, Weiming Ou, Xiao WangAdamImperfect-Information Games

    Aarhus University, Aarhus, Denmark · Shanghai University of Finance and Economics, Shanghai, China · MoE Key Laboratory of Interdisciplinary Research of Computation and Economics, Shanghai University of Finance and Economics, Shanghai, China

  21. Large Dimensional Kernel Ridge Regression: Extending to Product Kernels

    May 14, 2026Yang Zhou, Yicheng Li, Yuqian Cheng +1Kernel Ridge RegressionKernel Method

    Department of Statistics and Data Science Tsinghua University Beijing, 100084, China · Department of Mathematical Science Tsinghua University Beijing, 100084, China

  22. On the global convergence of gradient descent for wide shallow models with bounded nonlinearities

    May 11, 2026Romain Petit, Clarice Poon, Gabriel PeyréGradient DescentFlat Minima

    CNRS and ENS, PSL Universit´e · Mathematics Institute, University of Warwick

  23. When Descent Is Too Stable: Event-Triggered Hamiltonian Learning to Optimize

    May 7, 2026Yi Wang, Chandrajit BajajConvex OptimizationDescent

    1Oden Institute · Department of Computer Science

  24. Dynamic Scaled Gradient Descent for Stable Fine-Tuning for Classifications

    Apr 30, 2026Nghia Bui, Lijing WangGradient DescentModel Fine-Tuning

    Department of Data Science, New Jersey Institute of Technology, New Jersey, USA.

  25. Decoupled Descent: Exact Test Error Tracking Via Approximate Message Passing

    Apr 30, 2026Max LovigDescent1B Parameters

    Statistics and Data Science, Yale University

  26. A Mechanism Study of Delayed Loss Spikes in Batch-Normalized Linear Models

    Apr 18, 2026Peifeng Gao, Wenyi Fang, Yang Zheng +1Batch NormalizationBatch

    School of Computing and Data Science, The University of Hong Kong . · RAMS Technologies Lab, Huawei Technologies Ltd.

  27. Descent Before Hardness: Orbit-Gap Obstructions in Exact Certification

    Apr 8, 2026Tristan SimasTractabilityCertification

    McGill University, Montreal, Quebec, Canada

  28. Asymptotic Behavior of Multi--Task Learning: Implicit Regularization and Double Descent Effects

    Mar 5, 2026Ayed M. Alrashdi, Oussama Dhifallah, Houssem SifaouMulti--Task LearningDescent

    Department of Electrical Engineering, College of Engineering, University of Ha’il, P.O. Box 2440, Ha’il, 81441, Saudi Arabia · John A. Paulson School of Engineering and Applied Sciences, Harvard University, Cambridge, MA 02138, USA · Department of Electrical and Electronic Engineering, King’s College London – Strand, London WC2R 2LS – London, UK

  29. Accelerating Natural Gradient Descent for PINNs with Randomized Numerical Linear Algebra

    May 16, 2025Ivan Bioli, Carlo Marcati, Giancarlo SangalliSpectral PreconditioningNeural Solvers

    Department of Mathematics, University of Pavia, Via A. Ferrata 5, 27100 Pavia, Italy · Department of Civil Engineering and Architecture, University of Pavia, Via A. Ferrata 3, 27100 Pavia, Italy · Istituto di Matematica Applicata e Tecnologie Informatiche “E. Magenes”, CNR, Via A. Ferrata 1, 27100 Pavia, Italy

  30. Path Regularization: A Near-Complete and Optimal Nonasymptotic Generalization Theory for Multilayer Neural Networks and Double Descent Phenomenon

    Mar 3, 2025Hao YuRegularizationDescent

    Department of Automation, Tsinghua University, Beijing, 100086, China

  31. A Farewell to the Bias-Variance Tradeoff? An Overview of the Theory of Overparameterized Machine Learning

    Sep 6, 2021Yehuda Dar, Vidya Muthukumar, Richard G. BaraniukOverparameterizationBias-Variance Decomposition

    Faculty of Computer and Information Science, Ben-Gurion University · Schools of Electrical and Computer Engineering, and Industrial and Systems Engineering, Georgia Institute of Technology · Electrical and Computer Engineering Department, Rice University