Momentum

Ask about this topic

Momentum

5 papers in the last four weeks, against 2 the four weeks before. 0.1% of all new papers.

Jul 6Week of Sep 21
View on map

Latest papers 59

All topics
CardsList

  1. Muon meets Tamed Langevin: Momentum Preconditioning beyond Convex and gradient-Lipschitz Potentials

    Oct 1, 2026Nikolaos Makras, Sotirios SabanisLangevin DynamicsLipschitz Continuity

    School of Mathematics, University of Edinburgh, UK · National Technical University of Athens, Greece · Athena/Archimedes Research Centre, Greece

  2. FedMIX-P: Mixing Local and Global Preconditioners for Federated Vision and Language Model Training

    Oct 1, 2026Junkang LiuSpectral PreconditioningFedavg

    Tianjin University

  3. The Row Normalization Puzzle in Muon

    Sep 30, 2026Jiayu Zhang, Tianyi LinMuonNormalization

    Department of Industrial Engineering and Operations Research Columbia University

  4. FORM: Robot Manipulation through Direct Material Law Identification

    Sep 29, 2026Stepan Tretiakov, Ruihan Zhao, Cheng-Hsi Hsiao +6Deformable Linear ObjectsRobotic Manipulation

    Department of Mechanical Engineering, University of California, Berkeley, CA 94720, USA. · Chandra Family Department of Electrical and Computer Engineering · Maseeh Department of Civil, Architectural and Environmental Engineering +2

  5. Annealed Sinkhorn with Momentum: Certified Unregularized Optimal Transport in Linear Memory

    Sep 27, 2026Samuel J. K. Chin, Maximilian SchifferFused Sinkhorn-Localized SimilarityPrimal-Dual Methods

    MIT · HEC Paris

  6. Low-Rank Friction for Memory-Efficient Transformer Pretraining

    Sep 24, 2026Rajit Rajpal, Benedict LeimkuhlerAdamTransformer Architectures

    School of Mathematics University of Edinburgh Edinburgh, UK EH9 3FD

  7. VCMM: Variance-Calibrated Momentum for Multimodal Learning

    Sep 23, 2026Zhongjing Gu, Chenyang Huang, Yufa Feng +3Multimodal LearningModalities

  8. Angular momentum analysis on Karate roundhouse kicks: a longitudinal case study

    Sep 21, 2026Jan C. L. Lau, Christian Mele, Jonathan Feng-Shun Lin +1Gait DynamicsMomentum

    BioRobotics Lab, Optimization and Biomechanics for Human-Centred Robotics (HCR), Institute for Anthropomatics and Robotics (IAR), Karlsruhe Institute of Technology, 76131 Karlsruhe, Germany · Canada Excellence Research Chair in Human-Centred Robotics and Machine Intelligence, Systems Design & Mechanical and Mechatronics Engineering, University of Waterloo, Waterloo, N2L3G1, Ontario, Canada

  9. MpSub: A Momentum pp-Dimensional Subspace Trust-Region Method for Derivative-Free Fine-Tuning of Large Language Models

    Sep 7, 2026Yuyang Wang, Haoyu Yao, Pengcheng XieTrust RegionMomentum

    Xi’an Jiaotong University, Xi’an, China · Lawrence Berkeley National Laboratory, Berkeley, CA, USA

  10. Activation-Keyed Momentum: An Anisotropic Momentum Update via the Delta Rule

    Aug 19, 2026Euijin Hong, Guannan QuMomentum Stochastic Gradient DescentMomentum

    Electrical and Computer Engineering, Carnegie Mellon University

  11. Momentum as Residual-Driven Multiplier Correction for Deep Learning Optimization

    Aug 13, 2026Zhixin Ren, Yau Lyu, Congrong Li +2Neural Network OptimizationMomentum

    Department of Mathmatical Science, Tsinghua University · School of Vehicle and Mobility, Tsinghua University · College of AI, Tsinghua University

  12. DART: Dual-Axis Airborne Reachability-Gated Torque-Reaction for Off-Road Vehicle Jumps

    Jul 31, 2026Yu Hu, Fangzhou Zhao, Mingyuan Sang +7Standard Traffic Speed BenchmarksTorque

    Research Center for Intelligent Computing Systems, Institute of Computing Technology, CAS, Beijing 100190, China. · School of Computer Science and Technology, University of Chinese Academy of Sciences, Beijing 100049, China. · Dong Feng Off-Road Vehicle Co., Ltd, Shiyan 442000, China.

  13. Falling Behind Drives Unsafe Development in an Idealised AI Race Experiment

    Jul 28, 2026Elias Fernández Domingos, The Anh HanArtificial Intelligence SafetyArtificial Intelligence Systems

    AI-Lab, Vrije Universiteit Brussel, Pleinlaan 9, Brussels, 1050, Belgium. · MLG, Université Libre de Bruxelles, Boulevard du Triomphe, Brussels, 1050, Belgium. · School of Computing, Engineering and Digital Technologies, Teesside University, Teesside University, Middlesbrough, United Kingdom. +1

  14. Muse: Representation Geometry of Muon Beyond Normalized Momentum

    Jul 16, 2026Da Chang, Qiankun Shi, Lvgang Zhang +4MuonRepresentation Space

    1Pengcheng Laboratory · 2Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences · University of Chinese Academy of Sciences +3

  15. Physics-inspired Pseudo Anomaly Generation and Prototype Feature Guidance for 3D Anomaly Detection

    Jul 12, 2026Jian Ning, Qin Zou, Linchun Wu +4Point Clouds3D Object Detection

    School of Computer Science, Wuhan University, Wuhan 430072, Hubei, China · Guangdong Laboratory of Artificial Intelligence and Digital Economy (SZ), Shenzhen 518060, Guangdong, China · School of Information and Software Engineering, East China Jiaotong University, Nanchang 330013, Jiangxi, China +1

  16. Vanilla SGD with Momentum Survives Heavy-Tailed Noise: Convergence Analysis without Gradient Clipping or Normalization

    Jul 9, 2026Ryusei Yamada, Naoki Sato, Hideaki IidukaStochastic Gradient DescentConvergence

    Meiji University, Japan

  17. Can Model Merging Improve Aggregation in DiLoCo?

    Jul 3, 2026Stefan Horoi, Benjamin Thérien, Guy Wolf +1Stochastic Gradient DescentMomentum

    Université de Montréal · Mila – Quebec AI Institute · Concordia University

  18. Class-Grouped Normalized Momentum and Faster Hyperparameter Exploration to Tackle Class Imbalance in Federated Learning

    Jul 1, 2026Haemin Park, Diego Klabjan, Martin W. Braun +2Federated LearningImbalanced Classification

    Department of Industrial Engineering & Management Sciences, Northwestern University, Evanston, IL, USA · Intel Corporation, Chandler, AZ, USA

  19. MuonSSM: Orthogonalizing State Space Models for Sequence Modeling

    Jun 29, 2026Thai-Khanh Nguyen, Ngoc-Bich-Uyen Vo, Thieu N. Vo +2State Space ModelsSequence Modeling

    Faculty of Information Technology, Dainam University, Hanoi University of Science and Technology, Hanoi 10000, Vietnam · Faculty of Artificial Intelligence, Posts and Telecommunications Institute of Technology, Hanoi 10000, Vietnam · Department of Computer Science, University of Bath, Bath BA2 7AY, UK +1

  20. NaviCache: Test-Time Self-Calibration Caching for Video Generation

    Jun 25, 2026Zheqi Lv, Zhibo Zhu, Jinke Wang +6Video GenerationAccelerometer Data

    Zhejiang University, Hangzhou, China · Cornell University, New York, USA · Tencent Hunyuan, Shenzhen, China +1

  21. \chisao{}: A GPU-Native Parallel Optimizer for Multimodal Black-Box Functions via Convergence-Anticonvergence Oscillation

    Jun 24, 2026Ira WolfsonBlack-Box OptimizationCpu-Gpu Hybrid Designs

    Department of Electronics and Electrical Engineering Braude College of Engineering, Karmiel, Israel

  22. Towards Understanding the Power and Limits of the Muon Optimizer: A River-Valley Perspective

    Jun 19, 2026Tianqi Shen, Jinji Yang, Runze Shi +3MuonAdam

    Department of Computer Science City University of Hong Kong (CityUHK) · Department of Statistics and Data Science University of Pennsylvania · School of Statistics and Data Science Shanghai University of Finance and Economics

  23. GPT-Based Fast Simulation of CLAS12 Detector Hits via Conditional Autoregressive Generation

    Jun 14, 2026Cole Granger, James Giroux, Richard Tyson +2Autoregressive GenerationAutoregressive Transformers

    William & Mary, Department of Data Science, Williamsburg, VA 23185, USA · University of Glasgow, School of Physics and Astronomy, Glasgow G12 8QQ,14 UK · Thomas Jefferson National Accelerator Facility, Newport News, VA 23606, USA +1

  24. FlowMo-WM: A World Model with Object Momentum and Hidden Ambient Drift

    Jun 11, 2026Yitao Jiang, Luyang Zhao, Muhao Chen +1Latent World ModelsWorld Models

    Department of Computer Science Dartmouth College, Hanover, NH · Department of Electrical and Computer Engineering Clemson University, Clemson, SC · Department of Mechanical and Aerospace Engineering University of Houston, Houston, TX

  25. Neural Legendre-Fenchel transform with Hessian Preconditioning

    Jun 8, 2026Basile Plus-Gourdon, Frank NielsenSpectral PreconditioningHessian

    ´Ecole Normale Sup´erieure · Paris-Saclay, France · Sony Computer Science Laboratories Inc. +1

  26. Momentum for Reasoning: Dense Intrinsic Signals in Policy Optimization

    Jun 7, 2026Hao Chen, Zhanming Shen, Liyao Li +8Reinforcement Learning With Verifiable RewardVerifiable Rewards

    Zhejiang University · The Chinese University of Hong Kong · Eastern Institute of Technology

  27. Denoise First, Orthogonalize Later: Understanding Momentum in Muon via Spectral Filtering

    Jun 2, 2026Xianliang Li, Zihan Zhang, Weiyang Liu +1MuonMomentum

    1The Institute of Statistical Mathematics · 2The Graduate Institute for Advanced Studies, SOKENDAI · 3National Institute of Informatics +3

  28. MomentKV: Closing the Directional Gap in KV Cache Eviction for Long-Context Inference

    Jun 1, 2026Yu Li, Binxu Li, Tian LanKey-Value Cache EvictionKey-Value Cache

    George Washington University · Princeton University

  29. Fast Generalization after Interpolation via Critically Damped Momentum Optimization

    Jun 1, 2026Luca Muscarnera, Silas Ruhrberg Estévez, Yuanzhang Xiao +1Stochastic InterpolantsGradient Descent

  30. How Much Orthogonalization Does Muon Need?

    May 29, 2026Hua HuangMuonOrthogonality

    NVIDIA

  31. Kalimati Vegetable Price Index Forecasting with a Momentum Corrected Online Stacking Ensemble

    May 29, 2026Sahaj Raj MallaNormalized Difference Vegetation IndexVolatility

    Department of Mathematics, Kathmandu University, Dhulikhel, Nepal

  32. Dynamics of Stochastic Momentum with Sparse Updates in High Dimensions

    May 27, 2026Katie Everett, Elliot PaquetteMomentum Stochastic Gradient DescentMomentum

    Google DeepMind & MIT · McGill University & Mila

  33. Outer-Momentum Restarting in High-Dimensional Two-Phase Optimization

    May 27, 2026Kristi Topollai, Allan Ma, Tolga Dimlioglu +2MomentumPeak Memory

    New York University, New York, USA

  34. Stochastic Gradient Descent with Momentum is Algorithmically Stable

    May 27, 2026Yunwen Lei, Zimeng Wang, Xiaoming YuanStochastic Gradient DescentGeneralization Bounds

    Department of Mathematics, The University of Hong Kong, Hong Kong, China · Department of Mathematics and Mathematical Statistics, Umeå University, Sweden

  35. SkillGrad: Optimizing Agent Skills Like Gradient Descent

    May 26, 2026Hanyu Wang, Yifan Lan, Bochuan Cao +2SkillsLarge Language Model Agents

    College of Information Sciences and Technology The Pennsylvania State University University Park, PA, USA

  36. Momentum Streams for Optimizer-Inspired Transformers

    May 23, 2026Jingchu Gai, Nai-Chieh Huang, Jiayun WuTransformer ArchitecturesBatch Normalization

    Carnegie Mellon University

  37. Perfect Parallelization in Mini-Batch SGD with Classical Momentum Acceleration

    May 18, 2026Sachin Garg, Michał DerezińskiMomentum Stochastic Gradient DescentStochastic Gradient Descent

    University of Michigan

  38. Q-LocalAdam: Memory-Efficient Client-Side Adaptive Optimization for Edge Federated Learning

    May 17, 2026Vedant Waykole, Haroon R. LoneFederated LearningResource-Constrained Edge Devices

    IISER Bhopal · India

  39. Stochastic Compositional Optimization via Hybrid Momentum Frank--Wolfe

    May 14, 2026El Mahdi ChaytiStochastic Convex OptimizationStochastic Optimization

    Machine Learning and Optimization Laboratory (MLO) EPFL, Switzerland

  40. Refresh-Scaling the Memory of Balanced Adam

    May 11, 2026Alberto Fernández-Hernández, Cristian Pérez-Corral, Jose I. Mestre +2AdamMomentum

    Universitat Polit`ecnica de Val`encia, Val`encia, Spain · Universitat Jaume I, Castell´o de la Plana, Spain

  41. Learned Lyapunov Shielding for Adaptive Control

    May 7, 2026Giansalvo Cirrincione, Adriano FagioliniAdaptive ControlLyapunov Function

    Laboratoire LTI, Université de Picardie Jules Verne, Amiens, France. · MIRPALab, Department of Engineering, University of Palermo, 90128 Palermo, Italy.

  42. A Rod Flow Model for Adam at the Edge of Stability

    May 7, 2026Eric Regis, Sinho ChewiAdamMomentum

    Yale University

  43. MDN: Parallelizing Stepwise Momentum for Delta Linear Attention

    May 7, 2026Yulong Huang, Xiang Liu, Hongxiang Huang +5Kimi Delta AttentionLinear Attention

    The Hong Kong University of Science and Technology (Guangzhou), Guangzhou, China

  44. Jointly Learning Structured Representations and Stabilized Affinity for Human Motion Segmentation

    May 7, 2026Xianghan Meng, Zhiyuan Huang, Zhengyu Tong +1Temporal Action SegmentationLatent Motion

    School of Artificial Intelligence, Beijing University of Posts and Telecommunications, Beijing 100876, P.R. China

  45. On the Emergence of Pendular Structure in Multi-Contact Locomotion

    May 7, 2026Lingxue Lyu, Zihui LiuInverted PendulumTorque

    School of Engineering and Applied Science, University of Pennsylvania, Philadelphia, PA 19104, USA · Department of Aeronautics & Astronautics, Stanford University, Stanford, CA 94305, USA

  46. Bringing Order to Asynchronous SGD: Towards Optimality under Data-Dependent Delays with Momentum

    May 3, 2026Tehila Dahan, Roie Reshef, Sharon Goldstein +1Stochastic Gradient DescentAsynchronous Execution

    Technion – Israel Institute of Technology, Haifa, Israel

  47. Runtime Evaluation of Procedural Content Generation in an Endless Runner Game Using Autonomous Agents

    May 3, 2026Rishabh KarMotion GenerationRuntime

    Department of Informatics King’s College London London, United Kingdom

  48. A Dirac-Frenkel-Onsager principle: Instantaneous residual minimization with gauge momentum for nonlinear parametrizations of PDE solutions

    Apr 30, 2026Matteo Raviola, Benjamin PeherstorferPartial Differential EquationsMomentum

    EPFL, Lausanne, Switzerland · Courant Institute of Mathematical Sciences, New York University, New York, NY, USA

  49. Momentum-Conserving Graph Neural Networks for Deformable Objects

    Apr 28, 2026Jiahong Wang, Logan Numerow, Stelian Coros +3Graph Neural NetworksMomentum

    Max Planck Institute for Informatics · ETH Zurich · University of Bonn +1

  50. Negative Momentum for Convex-Concave Optimization

    Apr 18, 2026Henry Shugart, Shuyi Wang, Jason M. AltschulerConvex OptimizationConvergence

    UPenn · Yale

  51. Natural gradient descent with momentum

    Apr 16, 2026Anthony Nouy, Agustín SomacalGradient DescentGradient

    Centrale Nantes, Nantes Universit´e, Laboratoire de Math´ematiques Jean Leray UMR CNRS 6629

  52. Critical Damping as a Momentum Schedule: Multi-Seed Validation, a Hybrid Recipe, and an Exhaustive Negative Result on Surgical Layer Selection

    Mar 30, 2026Ivan PasichnykMomentumStochastic Gradient Descent

    We Label Data Inc.

  53. Why β1=β2β_1 = β_2 Is Dynamically Special in Adam

    Jan 29, 2026Alberto Fernández-Hernández, Cristian Pérez-Corral, Jose I. Mestre +2AdamMomentum

    Universitat Politècnica de València Valencia, Spain · Universitat Jaume I Castelló de la Plana, Spain

  54. Better Convergence Guarantees for Sign-Based Momentum Methods

    Jul 16, 2025Wei Jiang, Dingzhi Yu, Sifan Yang +3Momentum Stochastic Gradient DescentConvergence

    National Key Laboratory for Novel Software Technology, Nanjing University, Nanjing, China · School of Artificial Intelligence, Nanjing University, Nanjing, China

  55. MoCA-Video: Motion-Aware Concept Alignment for Consistent Video Editing

    Jun 1, 2025Tong Zhang, Victor Escorcia, Juan C Leon Alcazar +1Video EditingLatent Representation Alignment

    Department of Computer Science King Abdullah University of Science and Technology Thuwal, Saudi Arabia · Independent Researcher

  56. Scaling Textual Gradients via Sampling-Based Momentum

    May 31, 2025Zixin Ding, Junyuan Hong, Zhan Shi +6Large Language Model TrainingAutomatic Prompt Optimization

    University of Chicago · University of Texas at Austin · Santa Clara University +3

  57. Accelerated Stochastic Min-Max Optimization Based on Bias-corrected Momentum

    Jun 18, 2024Haoyuan Cai, Sulaiman A. Alghunaim, Ali H. SayedStochastic Convex OptimizationConvex Optimization

    Ecole Polytechnique Fédérale de Lausanne, Switzerland · Kuwait University, Kuwait

  58. DP-Muon: Differentially Private Optimization via Matrix-Orthogonalized Momentum

    Date pendingJihwan Kim, Chenglin FanMuonDifferentiable Optimization

    Seoul National University

  59. Musec: MomentUm SpEctral Clipping for Stable Muon-type Training

    Date pendingZhuanghua Liu, Menglian Wang, Luo LuoMuonGradient Clipping

    National University of Singapore · Wonders Information Co., Ltd. · Fudan University