Subspace Optimization

Ask about this topic

Latest papers

CardsList

13 papers2 papers in the last four weeks, against 2 the four weeks before. 0.0% of all new papers.

  1. Global O(k−2)\mathcal{O}\left(k^{-2}\right) Convergence of Multilevel Gradient-Regularized Newton Methods

    Oct 26, 2026Nick Tsipinakis, Matthias VoigtOptimization Convergence AnalysisSecond-Order Optimization

    Faculty of Mathematics and Computer Science, UniDistance Suisse, Brig, Switzerland

  2. Memory-Efficient Subspace Optimization with Residual Correction: From Momentum SGD to Muon

    Oct 14, 2026Sifan Yang, Hongyi Tao, Dingzhi Yu +5Subspace OptimizationMemory-Efficient Training

    State Key Laboratory of Novel Software Technology, Nanjing University · School of Artificial Intelligence, Nanjing University · Alibaba Token Hub, Alibaba Group +1

  3. AIM-ZO: Activation-Informed Subspace Maintenance for Zeroth-Order LLM Fine-Tuning

    Sep 28, 2026Yue Xie, Zhi Zheng, Yunpeng Ba +5Subspace OptimizationMemory-Efficient Fine-Tuning

    Southern University of Science and Technology · National University of Singapore · Huawei Technologies Ltd. +1

  4. Gradient Descent with Stochastic Subspaces via Persistence of Memory

    Sep 16, 2026Subhroshekhar Ghosh, Clement Z. Q. Ng, Pierre-Louis Poirion +1Gradient DescentStochastic Optimization Convergence

    Department of Mathematics, National University of Singapore, Singapore · Center for Advanced Intelligence Project, RIKEN, Tokyo, Japan · Department of Mathematical Informatics, The University of Tokyo, Tokyo, Japan

  5. FedSubMuon: Communication-Efficient Federated LLM Fine-Tuning via Structured Subspace Muon

    Sep 5, 2026Shaolong Chen, Youming Tao, Shuzhen Chen +3Subspace OptimizationFederated Fine-Tuning

    King Abdullah University of Science and Technology (KAUST) · Provable Responsible AI and Data Analytics (PRADA) Lab · Imperial College London +3

  6. Predicting When Random Low-Dimensional Reparameterizations Train Neural Networks

    Aug 12, 2026Andrew Cheng, Ali Eslamian, Jie Cheng +2Subspace Optimization

    Department of Computer Science, Tsinghua University, Beijing, China · Department of Computer Science, The University of Manchester, Manchester, UK · Department of Computer Science, University of Kentucky, Lexington, KY, USA +3

  7. Dysco: Dynamic Subspace Boosting to Mitigate LoRA Interference in Federated Learning

    Jul 15, 2026Haobo Zhang, Jiankun Wang, Suraj Rajendran +5Subspace OptimizationFederated Learning Aggregation

    University of Michigan · Cornell University · University of Pennsylvania

  8. Stochastic global optimization of continuous functions via random walks on Grassmannians

    May 13, 2026Kartik Gupta, Stephen D. Miller, Pradeep Ravikumar +1Stochastic OptimizationSubspace Optimization

  9. BROS: Bias-Corrected Randomized Subspaces for Memory-Efficient Single-Loop Bilevel Optimization

    May 11, 2026Hengrui Zhang, Boao Kong, Engao Zhang +1Stochastic Bilevel OptimizationBilevel Optimization

    1Sichuan University · 2Peking University

  10. Randomized Subspace Nesterov Accelerated Gradient

    May 1, 2026Gaku Omiya, Pierre-Louis Poirion, Akiko TakedaGradient DescentSmooth Convex Optimization

    Department of Mathematical Informatics, The University of Tokyo, Tokyo, Japan · Center for Advanced Intelligence Project, RIKEN, Tokyo, Japan

  11. Subspace Optimization for Efficient Federated Learning under Heterogeneous Data

    Apr 28, 2026Shuchen Zhu, Zhengyang Huang, Yuqi Xu +1Subspace OptimizationNon-IID Federated Learning

    Peking University · Beihang University

  12. Subspace Optimization for Backpropagation-Free Continual Test-Time Adaptation

    Mar 30, 2026Damian Sójka, Sebastian Cygert, Marc MasanaSubspace OptimizationContinual Test-Time Adaptation

    Poznan University of Technology · Akces NCBR · NASK - National Research Institute +3

  13. Linearized subspace refinement framework to expose hidden accuracy in trained neural networks

    Jan 20, 2026Wenbo Cao, Weiwei ZhangSubspace OptimizationNeural Network Optimization

    Institute of AI for Industries, Chinese Academy of Sciences, Nanjing 211135, China · Institute of Computing Technology, Chinese Academy of Sciences, Beijing 100190, China · School of Aeronautics, Northwestern Polytechnical University, Xi’an 710072, China +2