Optimization Convergence Analysis

Ask about this topic

Momentum

4 papers in the last four weeks, up 33% on the four weeks before. 0.0% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 58

All topics
CardsList

  1. Stochastic Gradient Descent Ascent is Suboptimal for Nonconvex-PL Min-Max Games

    Oct 6, 2026Junsoo HaOptimization Convergence AnalysisMin-Max Optimization

  2. Last-Iterate Convergence Rate of Normalized Gradient Descent under Hölder Smoothness

    Oct 5, 2026Yuki Takezawa, Eduard GorbunovLearning Rate SchedulingLast-Iterate Convergence

    Toyota Motor Corporation · MBZUAI

  3. Convergence Analysis of STORM Under Different Geometries

    Oct 1, 2026Wei Jiang, Yibo Wang, Wenhao Yang +3Stochastic OptimizationLast-Iterate Convergence

    School of Computer Science and Engineering, Nanjing University of Science and Technology, Nanjing, China · School of Artificial Intelligence, Nanjing University, Nanjing, China

  4. The Row Normalization Puzzle in Muon

    Sep 30, 2026Jiayu Zhang, Tianyi LinStochastic OptimizationOptimization Convergence Analysis

    Department of Industrial Engineering and Operations Research Columbia University

  5. Complexities of Weak Proximal Oracle Methods for Composite Convex Optimization

    Sep 21, 2026Dan GarberOracle ComplexityOptimization Convergence Analysis

    Faculty of Data and Decision Sciences Technion - Israel Institute of Technology

  6. The fixed-point bundle method over product-of-simplex domains arising from game equilibria

    Sep 14, 2026Hongbo SunOptimization Convergence AnalysisNash Equilibrium Computation

    Hongbo Sun∗

  7. Projected Riemannian Gradient Descent for the Bures-Wasserstein Barycenter: Dimension-Independent Linear Convergence at Unit Step Size

    Sep 3, 2026A. AfhamRiemannian OptimizationOptimization Convergence Analysis

    Centre for Quantum Technologies, National University of Singapore, Singapore

  8. A Local-Linearly Convergent Algorithm for Nonconvex Equality-Constrained Optimization

    Aug 12, 2026Frank E. Curtis, Lingjun Guo, Daniel P. RobinsonOptimization Convergence AnalysisNonconvex Optimization

    Department of Industrial and Systems Engineering, Lehigh University

  9. Tight Nonasymptotic Local Convergence of Sinkhorn-Knopp

    Aug 12, 2026Wenzhi Gao, Zhaonan Qu, Yinyu Ye +1Optimization Convergence Analysis

    ICME, Stanford University · Google · Department of Management Science and Engineering, Stanford University

  10. Stable Density Ridges: Consistency and Convergence of Subspace Constrained Mean Shift

    Aug 5, 2026Wanli QiaoOptimization Convergence Analysis

  11. Non-KKT Accumulation in Entropic Mirror Descent

    Aug 3, 2026Kuangyu Ding, Kim-Chuan TohOptimization Convergence AnalysisMirror Descent

    School of Industrial Engineering, Purdue University, West Lafayette, IN 47907, USA. · Department of Mathematics and Institute of Operations Research and Analytics, National University of Singapore, Singapore 119076.

  12. Global Convergence of DGM and PINN Algorithms for Solving Nonlinear PDEs

    Jul 27, 2026Justin Sirignano, Konstantinos Spiliopoulos, Samuel CohenNeural PDE SolversOptimization Convergence Analysis

    Mathematical Institute, University of Oxford · Department of Mathematics and Statistics, Boston University

  13. When Rates Are Geometric: Rate-Certificate Transfer for Contact Splittings in Optimization

    Jul 26, 2026George A KevrekidisOptimization Convergence AnalysisHamiltonian Dynamics

    Department of Applied Mathematics and Statistics, Johns Hopkins University, Baltimore, MD 21218, USA

  14. Convergence analysis of a family of Zermelo-type iterations for the Bradley--Terry model

    Jul 24, 2026Ruijian Han, Ding Lu, Yiming XuOptimization Convergence AnalysisBradley–Terry Model

    Department of Data Science and Artificial Intelligence, The Hong Kong Polytechnic University, Hung Hom, Kowloon, Hong Kong SAR · Department of Mathematics, University of Kentucky, Lexington, KY, 40506, USA

  15. Barzilai-Borwein Fails Superlinear Convergence on an Open Set of Quadratics for Every Dimension n≥4n\geq 4

    Jul 23, 2026Dawei Li, Xiaotian Jiang, Mingyi HongOptimization Convergence Analysis

    University of Minnesota

  16. What's in a Smoothness Constant? Tighter Rates for Local SGD with Bounded Second-order Heterogeneity

    Jul 16, 2026Kumar Kshitij Patel, Rustem Islamov, Sebastian U Stich +3Optimization Convergence AnalysisStochastic Optimization Convergence

    Department of Mathematics and Computer Science University of Basel Basel, Switzerland 4001 · Simons Institute for the Theory of Computing, Berkeley · Department of Data Science New Jersey Institute of Technology Newark, NJ, USA 07102

  17. Sharper Analysis of Single-Loop Methods for Bilevel Optimization

    Jul 11, 2026Yubo Zhou, Jun Shu, Luo Luo +4Optimization Convergence AnalysisBilevel Optimization

    School of Mathematics and Statistics, Xi’an Jiaotong University · School of Data Science, Fudan University · 3SGIT AI Lab, State Grid Corporation of China +1

  18. Understanding Schedule-Free Methods in Nonconvex Optimization: Rate Guarantees and Escaping Saddles

    Jul 10, 2026Jiseok Chae, Donghwan KimLearning Rate SchedulingOptimization Convergence Analysis

    Natural Science Research Institute KAIST Daejeon, Republic of Korea · Department of Mathematical Sciences KAIST Daejeon, Republic of Korea

  19. On the Convergence of Self-Improving Online LLM Alignment

    Jun 30, 2026Xudong Wu, Pangpang Liu, Vaneet Aggarwal +1LLM AlignmentOptimization Convergence Analysis

    The University of Hong Kong, Hong Kong SAR · Yale University, New Haven, CT, USA · Purdue University, West Lafayette, IN, USA

  20. How AI settled the complexity of the oldest SGD algorithm

    Jun 28, 2026Michał Dereziński, Xiaoyu DongOptimization Convergence AnalysisStochastic Gradient Descent

    University of Michigan · National University of Singapore

  21. Analysis of Parameter Settings for the Bat Algorithm Using Variance Evolution

    Jun 26, 2026Xin-She Yang, Mehmet KaramanogluExploration-Exploitation TradeoffEvolutionary Optimization

    Faculty of Science and Technology, Middlesex University, The Burroughs, London NW4 4BT, United Kingdom.

  22. Second-Order KKT Guarantees for Bregman ADMM in Nonconvex and Non-Lipschitz Optimization

    Jun 26, 2026Shuang Li, Zhihui Zhu, Qiuwei LiOptimization Convergence AnalysisDistributed Optimization

    Department of Electrical and Computer Engineering, Iowa State University, Ames, Iowa 50014, USA · Department of Computer Science and Engineering, Ohio State University, Columbus, Ohio 43210, USA · DAMO Academy, Alibaba Group US, Bellevue, Washington 98004, USA

  23. Dangerous Liaisons of Convex Learning and Non-Affine Aggregation

    Jun 26, 2026Thomas Boudou, Batiste Le Bars, Nirupam Gupta +1Optimization Convergence AnalysisAlgorithmic Stability

    PreMeDICaL team, Inria, Idesp, Inserm, Universit´e de Montpellier, Montpellier, France · Univ. Lille, Inria, CNRS, Centrale Lille, UMR 9189, CRIStAL, F-59000 Lille, France · Department of Computer Science, University of Copenhagen, Copenhagen, Danemark

  24. High-Probability PL-SGD with Markovian Noise: Optimal Mixing and Tail Dependence

    Jun 24, 2026Dhruv Sarkar, Aprameyo Chakrabartty, Vaneet AggarwalStochastic OptimizationOptimization Convergence Analysis

    Indian Institute of Technology Kharagpur · Mohamed bin Zayed University of Artificial Intelligence · Purdue University

  25. Global Convergence of Gradient Descent for Score Matching in Gaussian Mixtures via Reverse Fisher Divergence

    Jun 18, 2026Alexander TyurinScore MatchingOptimization Convergence Analysis

    AXXX, Moscow, Russia · Applied AI Institute, Moscow, Russia

  26. Semiglobal Input-Delay Tolerance Algorithm for Distributed Nonconvex Optimization of Networked Nonlinear Systems

    Jun 18, 2026Jing-Zhe Xu, Zhi-Wei Liu, Ming-Feng Ge +2Dynamical SystemsOptimization Convergence Analysis

    School of Artificial Intelligence and Automation, Huazhong University of Science and Technology, Wuhan 430074, China · School of Mechanical Engineering and Electronic Information, China University of Geosciences, Wuhan 430074, China

  27. Beyond IGO-Flow: Toward Convergence Analysis of IGO in Continuous Spaces

    Jun 16, 2026Ryosuke Kimura, Youhei AkimotoInformation GeometryOptimization Convergence Analysis

    University of Tsukuba, Tsukuba, Japan · RIKEN Center for Advanced Intelligence Project, Tokyo, Japan

  28. Coercivity and Local Convergence of Physical Learning in Linear Circuits

    Jun 13, 2026Joshua A. McGinnis, Xinbo Li, Yoichiro MoriEquilibrium PropagationOptimization Convergence Analysis

    Department of Mathematics, University of Pennsylvania, Philadelphia.

  29. Operator Calculus for Population-Based Optimization: Modular Convergence and Finite-Population Guarantees

    Jun 12, 2026Pekka Malo, Lauri Viitasaari, Patrik Nummi +3Evolutionary OptimizationOptimization Convergence Analysis

    Aalto University, Department of Information and Service Management, Finland. · Aalto University, Department of Information and Communications Engineering, Finland. · Indian Institute of Management Ahmedabad, Operations and Decision Sciences, India. +1

  30. Last-Iterate Convergence of Optimistic Multiplicative Weight Update

    Jun 10, 2026Francesco OrabonaLast-Iterate ConvergenceOptimization Convergence Analysis

    King Abdullah University of Science and Technology (KAUST) Thuwal, 23955-6900, Kingdom of Saudi Arabia