Latest papers

CardsList

15 papers1 paper in the last four weeks, with none the four weeks before. 0.0% of all new papers.

  1. ORCA: The Annealed Spectral Conditioning Optimizer for Faster, Better LLM Training

    Oct 5, 2026Yuanshi Liu, Boyuan Jiang, Liang Hou +4Spectral RegularizationDeep Learning Optimization

  2. Dion3: Full-Stack Orthogonal Updates

    Aug 12, 2026Noah Amsel, Jack Zhang, Kwangjun Ahn +5Newton-Schulz IterationGPU Kernel Optimization

  3. Muon on the Stiefel Manifold Admits an Exact Closed-Form Update

    Aug 6, 2026Mikhail Solonko, Molozhavenko Alexander, Maxim RakhubaStiefel Manifold OptimizationRiemannian Optimization

  4. A Note on Stability for Orthogonalized Matrix Momentum with Client Sampling

    Jun 1, 2026Da Chang, Qiankun Shi, Lvgang Zhang +2Algorithmic StabilityDistributed Optimization

  5. When Muon Optimizer Meets Adversarial Training: A Theoretical and Empirical Study

    May 26, 2026Jun Yan, Weiquan Huang, Jiankai Zuo +4Adversarial TrainingOrthogonal Optimization

  6. AdamO: A Collapse-Suppressed Optimizer for Offline RL

    May 3, 2026Nan Qiao, Sheng Yue, Shuning Wang +1Reinforcement LearningOrthogonal Optimization

  7. Deflation-Free Optimal Scoring

    Apr 28, 2026Sharmin Afroz, Brendan AmesOrthogonal OptimizationConstrained Optimization

  8. Delve into the Applicability of Advanced Optimizers for Multi-Task Learning

    Apr 10, 2026Zhipeng Zhou, Linxiao Cao, Pengcheng Wu +2Orthogonal OptimizationMulti-Task Learning

  9. Primal-Dual Methods for Nonsmooth Nonconvex Optimization with Orthogonality Constraints

    Apr 5, 2026Linglingzhi Zhu, Wentao Ding, Shangyuan Liu +1Orthogonal OptimizationConstrained Optimization

  10. MuonEq: Balancing Before Orthogonalization with Lightweight Equilibration

    Mar 30, 2026Da Chang, Qiankun Shi, Lvgang Zhang +5Neural Network OptimizationMuon Optimizer

  11. An Embarrassingly Simple Way to Optimize Orthogonal Matrices at Scale

    Feb 16, 2026Adrián Javaloy, Antonio VergariOrthogonal OptimizationMatrix Optimization

  12. Turbo-Muon: Almost-Orthogonal Pre-Conditioning for Fast Muon Updates

    Dec 4, 2025Thibaut Boissin, Thomas Massena, Franck Mamalet +1Newton-Schulz IterationOrthogonal Optimization