Overview

Riemannian optimization studies how to minimize objectives when parameters lie on curved spaces such as spheres, Stiefel manifolds, and spaces of low-rank matrices. Common methods project gradients onto tangent spaces and take feasible steps with retractions or geodesics; natural-gradient, mirror-descent, and second-order methods adapt updates to the chosen metric. These techniques are used for orthogonality-constrained learning, low-rank model adaptation, covariance and probability optimization, tensor networks, and robotics. A central tension is balancing geometric fidelity and convergence guarantees against the cost of computing geometric updates, while empirical gains over well-tuned Euclidean optimizers are not consistent across settings.

Latest papers

CardsList

85 papers8 papers in the last four weeks, down 50% on the four weeks before. 0.1% of all new papers.

  1. Zeroth-Order Riemannian Optimization on Fixed-Rank Manifolds for LLM Fine-Tuning

    Nov 7, 2026Xinjue Wang, Xiuheng Wang, Yejun Zhang +2Zeroth-Order OptimizationRiemannian Optimization

  2. Fixed-point acceleration on Neural Wasserstein manifolds

    Nov 6, 2026Vitalii Aksenov, Sebastian Gutierrez HernandezInference AccelerationRiemannian Optimization

  3. Self-Normalized Inference from Riemannian Stochastic Gradient Paths

    Oct 31, 2026Xiaotian Chang, Qirui Hu, Yi LiuConfidence Region EstimationRiemannian Optimization

  4. Riemannian Newton Methods with Statistical Inference

    Oct 31, 2026Xiaotian Chang, Qirui Hu, Yangdi Jiang +1Covariance EstimationRiemannian Optimization

  5. Bootstrap Inference for Riemannian Optimization Problems

    Oct 31, 2026Xiaotian Chang, Qirui Hu, Yangdi Jiang +1Confidence Region EstimationRiemannian Optimization

  6. Riemannian Optimization on Unknown Manifolds via Stochastic Proximal Refinement

    Oct 30, 2026Ruixiang Wu, Jiahao Ai, Tinko Sebastian Bartels +5Riemannian OptimizationStochastic Optimization

  7. Online Covariance Estimation for Averaged Stochastic Gradient Descent on Riemannian Manifolds

    Oct 24, 2026Jingrong Guan, Liwei Jiang, Sen NaCovariance EstimationRiemannian Optimization

  8. A Riemannian Geometry for Low-rank Adaptation

    Oct 6, 2026Shoichiro Takeda, Shin'ya Yamaguchi, Satoshi Suzuki +1Riemannian OptimizationLow-Rank Adaptation

  9. How Inefficient Is Natural Gradient Descent? From Exact Optimality to Θ( \sqrt{ \log d } ) Divergence

    Oct 5, 2026Guni Sharon, Alan KuhnleInformation GeometryRiemannian Optimization

  10. Hyperbolic Graph Representation Learning: Embed in One Metric, Optimize with Another

    Oct 5, 2026Federico Larroca, Paola Bermolen, Marcelo Fiori +1Riemannian OptimizationHierarchical Representation Learning

  11. Hamiltonian Metric Learning and Energy-Based Training: A Dissipative Geometric Framework for Optimization

    Oct 4, 2026Sparsho Chakraborty, Mohammad Alamgir, Nishanth M +3Neural Network OptimizationRiemannian Optimization

  12. Riemannian Difference-of-Convex Optimization for K-Means Clustering

    Sep 28, 2026Meng Xu, Bo Jiang, Hanfu Zhang +2Riemannian OptimizationClustering

  13. Rotated Manifold Optimization for Low-Rank Adaptation

    Sep 28, 2026Yuhui Ding, Javier Zazo, James HensmanRiemannian OptimizationLow-Rank Adaptation

  14. Retraction-Based Gradient Projection Algorithms on Manifolds

    Sep 25, 2026Conglong Xu, Hao WuGradient ProjectionRiemannian Optimization

  15. Guaranteed Low-Rank Tensor Recovery from Modewise Measurements via Normalized Block-Weighted Riemannian Gradient Descent

    Sep 21, 2026Yushi Zhou, Feng ZhangRiemannian OptimizationTensor Decomposition

  16. Locally Private Inference for Riemannian Stochastic Optimization

    Sep 18, 2026Xiaotian Chang, Yangdi Jiang, Qirui HuRiemannian OptimizationConfidence Region Estimation

  17. Stiefel-AdamW: Geometry-Aware AdamW for Linear Factorization Blocks

    Sep 17, 2026Emanuele Zangrando, Marco Sutti, Francesco TudiscoDeep Learning OptimizationRiemannian Optimization

  18. Optimization over covariance matrices with a parameterized metric

    Sep 15, 2026Yibang Li, Bamdev Mishra, Pratik Jawanpuria +1Riemannian OptimizationSecond-Order Optimization

  19. Near-Optimal Nonconvex Matrix Completion

    Sep 15, 2026Jian-Feng Cai, Xiliang Lu, Juntao YouRiemannian OptimizationNonconvex Optimization

  20. Riemannian ascent--descent for nonconvex nonconcave minimax landscapes: convergence to basin saddle points and applications to distributionally robust optimization

    Sep 12, 2026Rishabh Dixit, Pranav Upadrashta, Alex CloningerMin-Max OptimizationWasserstein Distributionally Robust Optimization

  21. Curvature-Independent Regret Bounds for Distributed Online Optimization on Hadamard Manifolds

    Sep 12, 2026Zhanyuan Cai, Emre Sahinoglu, Shahin ShahrampourRiemannian OptimizationDecentralized Optimization

  22. Riemannian Optimization for Multi-Player Quantum Games on Product Unitary Manifolds

    Sep 7, 2026Alireza Habibi, Setareh MaghsudiMulti-Agent System OptimizationRiemannian Optimization

  23. LoRA-TSD: Tangent-Space Spectral Descent for LoRA via Muon-Style Updates

    Sep 2, 2026Dmitrii Andriianov, Andrey Veprikov, Aleksandr BeznosikovLow-Rank AdaptationParameter-Efficient Fine-Tuning

  24. Stochastic Optimization of Tree Tensor Networks

    Sep 1, 2026Marius Willner, Maximilian Scharf, André Uschmajew +2Tensor NetworksRiemannian Optimization