cs.LGOct 1, 2026

Muon meets Tamed Langevin: Momentum Preconditioning beyond Convex and gradient-Lipschitz Potentials

Authors: Nikolaos Makras, Sotirios Sabanis

Organizations: School of Mathematics, University of Edinburgh, UK · National Technical University of Athens, Greece · Athena/Archimedes Research Centre, Greece

Abstract

We consider the problem of sampling from Gibbs distributions on matrix spaces whose potential energies are neither convex nor globally gradient-Lipschitz. We introduce a family of non-quadratic kinetic energies that lead to a new underdamped Langevin system with momentum preconditioning, in which the gradient of the kinetic energy acts as a smooth spectral taming of the momentum. We prove that, under these relaxed assumptions on the potential, the resulting dynamics leaves the target Gibbs measure invariant, and we establish exponential convergence to equilibrium in a weighted total variation distance. Finally, we show that the corresponding Euler-Maruyama discretization admits moment bounds that are uniform in time, without any modification of the potential gradient, which ensures the stability of the resulting sampling algorithm.

Explore similar work

CardsList
  1. Penalized Nonreversible Langevin for Constrained Sampling

    Sep 21, 2026Pervez Ali, Weihao Dong, Xiaoyu WangLog-Concave DistributionsLangevin Dynamics

  2. Time-Inhomogeneous Preconditioned Langevin Dynamics

    May 7, 2026Alexander Falk, Laurenz Nagler, Andreas Habring +1Langevin DynamicsSpectral Preconditioning

  3. Dimension-Uniform Discretization Analysis of Preconditioned Annealed Langevin Dynamics for Multimodal Gaussian Mixtures

    May 15, 2026Lorenzo Baldassari, Josselin Garnier, Knut Solna +1Langevin DynamicsDiffusion Sampling