Nonconvex Optimization

Ask about this topic

Momentum

10 papers in the last four weeks, up 100% on the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 92

All topics
CardsList

  1. Robust Local Optimization Done Right

    Oct 5, 2026James Pritts, Kevin KöserRelative Pose EstimationNonconvex Optimization

    Kiel University, Kiel, Germany

  2. SoftServe: A Scalable Quasi-Newton Method for Deep Learning

    Oct 1, 2026Joohwan Ko, Tetiana Parshakova, Diana Cai +1Deep Learning OptimizationSecond-Order Optimization

    University of Massachusetts Amherst · CCM, Flatiron Institute · Cornell University

  3. Removing spurious minima for planar features by skip connections

    Oct 1, 2026Jakob Paul Zimmermann, Moritz Grillo, Andrei Balakin +1Shallow Neural NetworksReLU Neural Networks

    Freie Universität Berlin · Technische Universität Berlin

  4. Generalized Geometry Block Proximal Linearized Method for Multiblock Nonconvex and Nonsmooth Optimization

    Sep 30, 2026Weifeng YangNonconvex OptimizationConstrained Optimization

  5. DCEmbed: Scalable Optimization over Neural Surrogates

    Sep 27, 2026Akshay Sreekumar, Nicolas Christianson, Priya L. Donti +2Neural Surrogate ModelingSurrogate-Assisted Optimization

    Stanford University Stanford, CA, USA · Johns Hopkins University Baltimore, MD, USA · Massachusetts Institute of Technology Cambridge, MA, USA

  6. lapanda: A Matrix-Free Differentiable Solver for Nonconvex Constrained Optimization Layers

    Sep 27, 2026Yuankun Chen, Zifei Nie, Kangyu Lin +2Differentiable ProgrammingNonconvex Optimization

    School of Artificial Intelligence, Jilin University, China · Graduate School of Informatics, Kyoto University, JPN · Department of Civil and Systems Engineering, Johns Hopkins University, USA

  7. Transformer-Informed Trajectory Optimization for Relative Motion in Cislunar Orbits

    Sep 21, 2026Walter J. Manuel, Yuji Takubo, Simone D'AmicoTrajectory OptimizationSpacecraft Rendezvous and Proximity Operations

    Department of Aeronautics and Astronautics, Stanford University, Stanford, CA 94305

  8. Near-Optimal Nonconvex Matrix Completion

    Sep 15, 2026Jian-Feng Cai, Xiliang Lu, Juntao YouRiemannian OptimizationNonconvex Optimization

    Department of Mathematics, Hong Kong University of Science and Technology. · School of Mathematics and Statistics, Hubei Center for Applied Mathematics, and Hubei Key Laboratory of Computational Science, Wuhan University, Wuhan 430072, China. · School of Artificial Intelligence, Hubei Center for Applied Mathematics, and Hubei Key Laboratory of Computational Science, Wuhan University, Wuhan 430072, China.

  9. Adaptively Incorporating Directional Hints into Zeroth-Order Optimization

    Sep 8, 2026Alexander Ryabchenko, Jian Qian, Wenlong MouZeroth-Order OptimizationNonconvex Optimization

    University of Toronto and Vector Institute · University of Hong Kong

  10. Sparse Data Augmentation for Optimization with Provable Guarantees

    Sep 8, 2026Behrooz Tahmasebi, Melanie WeberData AugmentationNonconvex Optimization

    Harvard John A. Paulson School of Engineering and Applied Sciences, Harvard University, Cambridge, MA 02138, USA.

  11. Poisson Image Denoising Using Minimax Concave and Reweighted ℓ1\ell_1 Penalties: Nonblind and Blind Approaches

    Sep 7, 2026Reza ParvazImage DeblurringNonconvex Optimization

    aDepartment of Engineering Sciences, Faculty of Advanced Technologies,Sep University of Mohaghegh Ardabili, Ardabil, Iran

  12. Median-of-Means as an Extremal Convex Estimator and a Nonconvex Route to the Trimmed Oracle

    Sep 1, 2026Angshul MajumdarNonconvex OptimizationCorruption Robustness

    Department of Electronics and Communications Engineering, IIIT Delhi, India

  13. Operational Regimes in Non-Convex Optimization: A Multiplier-Based Taxonomy

    Aug 31, 2026Seyed Mohsen Kazemi, Ali Movaghar, Shaahin hessabiNonconvex OptimizationConstrained Optimization

    Department of Computer Engineering, Sharif University of Technology, Azadi, Tehran, 11365-9517, Tehran, Iran.

  14. Estimating Population-Risk Curves Along Nonconvex Gradient Flows from the Training Sample

    Aug 31, 2026Mingzhi SongNonconvex OptimizationStatistical Learning Theory

    Department of Mathematics, The University of Hong Kong

  15. A Globally Convergent Algorithm for Total Scaled-Gradient Variation via Cone-Constrained Bilinear Decomposition

    Aug 29, 2026Haibin Su, Chunlin Wu, Huibin Chang +1Image ReconstructionNonconvex Optimization

    Yau Mathematical Sciences Center, Tsinghua University, Beijing 100084, China · School of Mathematical Sciences, Nankai University, Tianjin, 300071, China · School of Mathematical Sciences and Institute of Mathematics and Interdisciplinary Sciences, Tianjin Normal University, Tianjin, 300387, China

  16. A Local-Linearly Convergent Algorithm for Nonconvex Equality-Constrained Optimization

    Aug 12, 2026Frank E. Curtis, Lingjun Guo, Daniel P. RobinsonOptimization Convergence AnalysisNonconvex Optimization

    Department of Industrial and Systems Engineering, Lehigh University

  17. Establishing Boundary KKT Convergence of Mirror Descent through Reparameterization

    Aug 7, 2026Kuangyu Ding, Kim-Chuan TohNonconvex OptimizationMirror Descent

    School of Industrial Engineering, Purdue University, West Lafayette, IN 47907, USA. · Department of Mathematics, National University of Singapore, Singapore 119076.

  18. The Tamed Subgradient Unadjusted Langevin Algorithm beyond Convexity

    Aug 6, 2026Iosif Lytras, Nikolaos Makras, Sotirios SabanisStochastic Gradient Langevin DynamicsLangevin Dynamics

    School of Mathematics, University of Edinburgh, UK · National Technical University of Athens, Greece · Athena/Archimedes Research Centre, Greece

  19. Muon on the Stiefel Manifold Admits an Exact Closed-Form Update

    Aug 6, 2026Mikhail Solonko, Molozhavenko Alexander, Maxim RakhubaStiefel Manifold OptimizationRiemannian Optimization

    HSE University, Moscow, Russia.

  20. An Inertial Block Proximal Linearized Method with Adaptive Momentum for Nonconvex and Nonsmooth Optimization

    Aug 6, 2026Weifeng YangMomentum MethodsNonconvex Optimization

    Yunnan Earthquake Administration, Kunming 650224, China

  21. Biconvex Optimization for Smooth Minimum-Time Trajectories around Convex Obstacles

    Aug 3, 2026Peter Werner, Tobia Marcucci, Daniela RusConstrained Motion PlanningTrajectory Optimization

    Massachusetts Institute of Technology Computer Science and Artificial Intelligence Laboratory · University of California Santa Barbara

  22. On the robustness of noisy solutions in non-convex neural networks

    Jul 29, 2026Enrico M. Malatesta, Alessandra Passalacqua, Riccardo ZecchinaStochastic OptimizationNeural Network Generalization

    Department of Computing Sciences, Bocconi University, Milano, Italy · Bocconi Institute for Data Science and Analytics (BIDSA)

  23. Variance-Reduced Conditional Gradient Methods under Markovian Sampling for Nonconvex Composite Optimization

    Jul 28, 2026Zhaojun PengStochastic OptimizationNonconvex Stochastic Optimization

    School of Computer Science Nanjing University of Information Science and Technology

  24. Lloyd's KK-Means Clustering Algorithm Is Frank-Wolfe in Disguise

    Jul 28, 2026Michael Pokojovy, J. Marcus Jobe, Simon Lacoste-JulienClusteringUnsupervised Clustering

    Department of Mathematics & Statistics and School of Data Science Old Dominion University Norfolk, VA 23529, USA · Information Systems & Analytics Department Miami University Oxford, OH 45056, USA · Canada CIFAR AI Chair Department of Computer Science and Operations Research & Mila Université de Montréal Montréal (QC) Canada

  25. Learning from the Descent Direction: Adaptive Gradient Descent under One-Sided Hölder Regularity

    Jul 24, 2026Arzu Ahmadova, Ismail HuseynovLearning Rate SchedulingNonconvex Optimization

    Weierstrass Institute for Applied Analysis and Stochastics Berlin, Germany · Physikalisch-Technische Bundesanstalt (PTB), Germany · Technical University of Berlin, Germany

  26. Regularized Optimization on Grassmann Manifold: Theory, Algorithm and Applications

    Jul 23, 2026Zhuan Liang, Zheng ZhaiSpectral RegularizationRiemannian Optimization

    Department of Statistics, Faculty of Arts and Sciences at Beijing Normal University, Zhuhai

  27. Online Optimization of Difference-of-Convex Compositions with Smooth Mappings

    Jul 21, 2026Jingwei Ji, Jong-Shi Pang, Renyuan XuNonconvex OptimizationConstrained Optimization

    Management Science and Engineering, Stanford University · The Daniel J. Epstein Department of Industrial and Systems Engineering, University of Southern California

  28. Demixing Sparse Signals from Nonlinear Observations using Generalized Non-convex Regularization

    Jul 12, 2026Raziyeh TakbiriSparse RecoveryNonconvex Optimization

    School of Electrical Engineering, Iran University of Science and Technology, Tehran, Iran

  29. Understanding Schedule-Free Methods in Nonconvex Optimization: Rate Guarantees and Escaping Saddles

    Jul 10, 2026Jiseok Chae, Donghwan KimLearning Rate SchedulingOptimization Convergence Analysis

    Natural Science Research Institute KAIST Daejeon, Republic of Korea · Department of Mathematical Sciences KAIST Daejeon, Republic of Korea

  30. Nonconvex Composite Functional Constraints via First-Order Augmented Lagrangian Methods under Local Regularity

    Jul 9, 2026Linglingzhi Zhu, Jiajin LiPrimal-Dual OptimizationNonconvex Optimization

    H. Milton Stewart School of Industrial and Systems Engineering, Georgia Institute of Technology, Atlanta, GA, USA. · Sauder School of Business, University of British Columbia, Vancouver, BC, Canada.

  31. Higher-Order Geometric Updates for Levenberg-Marquardt Method via Riemann Normal Coordinates

    Jul 8, 2026Jianing Liu, Dong H. ZhangGauss-Newton OptimizationRiemannian Optimization

    State Key Laboratory of Chemical Reaction Dynamics and Department of Chemical Physics, University of Science and Technology of China, Hefei, 230026, China · State Key Laboratory of Chemical Reaction Dynamics, Dalian Institute of Chemical Physics, Chinese Academy of Sciences, Dalian, 116023, China. · University of Chinese Academy of Sciences, Beijing, 100049, China +1

  32. On the Condition Number Upper Bound of the L-BFGS Inverse Hessian Approximation Matrix with a Two-Sided Geometric Envelope Safeguarding Mechanism

    Jul 7, 2026Don LiSecond-Order OptimizationNonconvex Optimization

    Department of Mathematics & Statistics Portland State University Portland, OR 97201, USA

  33. Non-Convex Sparse Reinforcement Learning via Non-Monotone Inclusions

    Jul 6, 2026Kyohei Suzuki, Konstantinos SlavakisTemporal-Difference LearningNonconvex Optimization

    Department of Information and Communications Engineering, Institute of Science Tokyo, Yokohama, 226-8501, Japan

  34. Decentralized Stochastic Subgradient-type Methods with Communication Compression for Nonsmooth Nonconvex Optimization

    Jul 2, 2026Siyuan Zhang, Nachuan Xiao, Xin LiuStochastic OptimizationNonconvex Optimization

  35. Direction-Magnitude Decomposition for Low-Rank Matrix Optimization: Faster Convergence and Saddle-to-saddle Dynamics

    Jun 30, 2026Yudong Wei, Liang Zhang, Bingcong Li +1Low-Rank Matrix DecompositionNonconvex Optimization

    Department of Mathematics, ETH Zurich, Zurich, Switzerland · Department of Computer Science, ETH Zurich, Zurich, Switzerland

  36. A Fast Convergent Algorithm for Solving Non-convex Partially-Decoupled Generalized Nash Equilibrium Problems

    Jun 26, 2026Bennet Outland, Vishala AryaGame TheoryNonconvex Optimization

    Smead Aerospace Engineering Sciences Department, 3775 Discovery Drive, Boulder, CO, USA

  37. Second-Order KKT Guarantees for Bregman ADMM in Nonconvex and Non-Lipschitz Optimization

    Jun 26, 2026Shuang Li, Zhihui Zhu, Qiuwei LiOptimization Convergence AnalysisDistributed Optimization

    Department of Electrical and Computer Engineering, Iowa State University, Ames, Iowa 50014, USA · Department of Computer Science and Engineering, Ohio State University, Columbus, Ohio 43210, USA · DAMO Academy, Alibaba Group US, Bellevue, Washington 98004, USA

  38. Difference of Convex Programming in the Wasserstein Space with Applications to MMD Optimization

    Jun 26, 2026Clément Bonet, Pierre-Cyril Aubin-Frankowski, Youssef MrouehMaximum Mean DiscrepancyNonconvex Optimization

    CMAP, CNRS, Ecole Polytechnique, IP Paris · CERMICS, CNRS, ENPC, IP Paris · IBM Research

  39. Finding Stationary Points by Comparisons

    Jun 25, 2026Helin Wang, Chenyi Zhang, Xiwen Tao +2Black-Box OptimizationZeroth-Order Optimization

    School of Electronics Engineering and Computer Science, Peking University · Center on Frontiers of Computing Studies, Peking University · Computer Science Department, Stanford University +1

  40. Adam Converges in Nonsmooth Nonconvex Optimization

    Jun 21, 2026Zijian LiuHeavy-Tailed NoiseNonconvex Optimization

    Department of Technology, Operations, and Statistics Leonard N. Stern School of Business New York University New York, NY 10012, USA

  41. On the Oracle Complexity of Interpolation-Based Gradient Descent

    Jun 18, 2026Dongmin Lee, William Lu, Anuran MakurOracle ComplexityGradient Descent

    Department of Computer Science, Purdue University, West Lafayette, IN 47907, USA · Department of Computer Science and the Elmore Family School of Electrical and Computer Engineering, Purdue University, West Lafayette, IN 47907, USA

  42. Semiglobal Input-Delay Tolerance Algorithm for Distributed Nonconvex Optimization of Networked Nonlinear Systems

    Jun 18, 2026Jing-Zhe Xu, Zhi-Wei Liu, Ming-Feng Ge +2Dynamical SystemsOptimization Convergence Analysis

    School of Artificial Intelligence and Automation, Huazhong University of Science and Technology, Wuhan 430074, China · School of Mechanical Engineering and Electronic Information, China University of Geosciences, Wuhan 430074, China

  43. Low-Rank Tensor Completion Based on Fractional Regularization with Ky Fan p-k Norm

    Jun 17, 2026Shan Fan, Feng Zhang, Jianjun Wang +2Tensor CompletionNonconvex Optimization

    School of Mathematics and Statistics, Southwest University, Chongqing 400715, China · School of Mathematical Sciences/Research Center for Image and Vision Computing, University of Electronic Science and Technology of China, Chengdu 611731, China · Faculty of Computer Science and Control Engineering, Shenzhen University of Advanced Technology, Shenzhen 518055, China

  44. The Complexity of Min-Max Optimization for Quadratic Polynomials

    Jun 15, 2026Martino Bernasconi, Matteo Castiglioni, Andrea Celli +1Min-Max OptimizationNonconvex Optimization

    Bocconi University · Politecnico di Milano · University of Oxford

  45. When to use what Schatten-pp norm in deep learning?

    Jun 13, 2026Thomas PethickDeep Learning OptimizationMuon Optimizer

  46. Operator Calculus for Population-Based Optimization: Modular Convergence and Finite-Population Guarantees

    Jun 12, 2026Pekka Malo, Lauri Viitasaari, Patrik Nummi +3Evolutionary OptimizationOptimization Convergence Analysis

    Aalto University, Department of Information and Service Management, Finland. · Aalto University, Department of Information and Communications Engineering, Finland. · Indian Institute of Management Ahmedabad, Operations and Decision Sciences, India. +1

  47. Sharp First-Order Lower Bounds for Higher-Order Smooth Nonconvex Optimization

    Jun 3, 2026Dongruo ZhouOptimization Convergence AnalysisNonconvex Optimization

    Department of Computer Science, Indiana University Bloomington, IN 47408, USA

  48. From Non-Convex to Strongly Convex: Curvature-Adaptive FTPL for Online Optimization

    Jun 1, 2026Moses Charikar, Chirag Pabbaraju, Ambuj TewariOnline Convex OptimizationNonconvex Optimization

    Stanford University. · University of Michigan, Ann Arbor.

  49. Learning-based Directed Graph Abstraction of Combinatorial Spaces for Order-Preserving Search in Mixed-Combinatorial Nonlinear Optimization

    May 31, 2026Gishnu Madhu, Feng Liu, Souma ChowdhuryGraph Structure LearningGraph Neural Networks

    University at Buffalo Buffalo, New York, 14260

  50. GLENS: Global Search via Learning from Solver Iterates with Diffusion Models

    May 29, 2026Anjian Li, Bartolomeo Stellato, Ryne BeesonLearning to OptimizeDiffusion Sampling

    Department of Electrical and Computer Engineering, Princeton University, Princeton, 08544, NJ, USA. · Department of Operations Research and Financial Engineering, Princeton University, Princeton, 08544, NJ, USA. · Department of Mechanical and Aerospace Engineering, Princeton University, Princeton, 08544, NJ, USA.

  51. Convergence of Steepest Descent and Adam under Non-Uniform Smoothness

    May 28, 2026Sharan Vaswani, Yifan Sun, Reza BabanezhadOptimization Convergence AnalysisGradient Descent

    1Simon Fraser University · 2Stony Brook University · 3Samsung AI, Montreal.

  52. Caspar: CUDA Accelerator for Symbolic Programming with Adaptive Reordering

    May 28, 2026Emil Martens, Aaron Miller, Matias Varnum +1Bundle AdjustmentGPU Kernel Optimization

    Norwegian University of Science and Technology · Skydio

  53. MoSSP: A Momentum-Based Single-Loop Stochastic Penalty Method for Nonconvex Constrained DC-Regularized Optimization

    May 28, 2026Luxuan Li, Chunfeng Cui, Xiao WangStochastic OptimizationNonconvex Stochastic Optimization

    School of Mathematical Sciences, Beihang University, Beijing 100191, China · School of Computer Science and Engineering, Sun Yat-sen University, Guangzhou 510006, China.

  54. Designing Active Tether-Net Systems for Space Debris Capture with Graph-Learning-Aided Mixed-Combinatorial Optimization

    May 27, 2026Feng Liu, Achira Boonrath, Gishnu Madhu +2Metaheuristic OptimizationNonconvex Optimization

    University at Buffalo Buffalo, New York, 14260

  55. Theoretical Analysis of Sparse Optimization with Reparameterization, Weight Decay, and Adaptive Learning Rate

    May 24, 2026Huangyu Xu, Jingqin Yang, Qianqian Xu +1Nonconvex Optimization

    State Key Laboratory of AI Safety, Institute of Computing Technology, Chinese Academy of Sciences, Beijing, China · School of Computer Science and Technology, University of Chinese Academy of Sciences, Beijing, China · IIIS, Tsinghua University, Beijing, China +3

  56. Zeroth-Order Nonconvex Nonsmooth Optimization with Heavy-Tailed Noise

    May 23, 2026Zhuanghua Liu, Luo LuoStochastic OptimizationGradient Clipping

  57. RA-DCA: A Randomized Active-Set DCA for Directional Stationarity in Max-Structured DC Programs

    May 22, 2026Yi-Shuai NiuNonconvex Optimization

    Beijing Institute of Mathematical Sciences and Applications (BIMSA), Beijing, China

  58. Convex Compositional Reasoning Models

    May 22, 2026Meir Roketlishvili, Semyon Semenov, Maksim Bobrin +7Compositional ReasoningEnergy-Based Models

    Mohamed bin Zayed University of Artificial Intelligence, Abu Dhabi, UAE · Applied AI Institute, Computational Imaging Lab · AXXX

  59. Exploiting Non-Negativity in DAG Structure Learning

    May 19, 2026Samuel Rey, Madeline navarro, Gonzalo MateosGraph Structure LearningStructural Causal Models

    Dept. of Signal Theory and Communications, Universidad Rey Juan Carlos, Madrid, Spain · Dept. of Electrical and Computer Engineering, Rice University, Houston, TX 77005, USA · Dept. of Electrical and Computer Engineering, University of Rochester, Rochester, NY 14627, USA

  60. An Exterior Method for Nonnegative Matrix Factorization

    May 19, 2026Qiujing Lu, Tonmoy Monsoor, Ehsan Ebrahimzadeh +2Non-Negative Matrix FactorizationLow-Rank Matrix Decomposition

    1ECE, UCLA · 2eBay Search Science Team