Wasserstein mixing time of the unadjusted Langevin algorithm
Authors: Francesco Pedrotti, Peter A. Whalley
Organizations: ETH Zürich
Abstract
We provide new estimates in Wasserstein distance for the asymptotic bias of the unadjusted Langevin algorithm, in the classical setting of log-smooth strongly log-concave measures. Our bound implies a Wasserstein mixing time of order κd/ε, where κ is the condition number, d is the dimension, and ε is the target precision: this improves by a factor of d/ε over the previous state-of-the-art results.
We study the classical Moreau--Yosida unadjusted Langevin algorithm (MYULA) for π(dx)∝e−f(x)−g(x)dx, where f∈C2(Rd) is m-strongly convex with Lf-Lipschitz gradient and g:Rd→R is convex and globally G-Lipschitz. For the Moreau-smoothed target πλ and the MYULA invariant law πλ,h, we prove
mW2(πλ,πλ,h)=O(h)+O(h3/4)
under 0<h(Lf+λ−1)≤c, with only logarithmic dependence on λ−1 in the error coefficients. Combining this estimate with the Moreau approximation bias yields O(ε−4/3) iterations to achieve mW2(μN,π)≤ε, for fixed model parameters and initialization. The proof combines a discrete Poisson corrector with active-trace estimates and a shared-noise bound for the exact--Euler two-point curvature.
We study the Moreau--Yosida unadjusted Langevin algorithm (MYULA) for the nonsmooth composite target
π(dx)∝exp{−f(x)−g(x)}dx,x∈Rd,
where f is m-strongly convex with Lf-Lipschitz gradient and g is convex and G-Lipschitz. Let gλ be the Moreau envelope of g, πλ the corresponding smoothed target, and aλ=trHλ, where Hλ is the a.e./weak Hessian of gλ. We show that the leading MYULA discretization error is controlled by the reference active trace Bref, the average of aλ along the heat substep of one MYULA update started from πλ, rather than by the global curvature bound d/λ. If Mλ is an a.e. upper bound for aλ, then, up to logarithmic factors,
N≲m1[Lf+εalg2τf+G2+Bref+εalgMλ],τf:=xsuptr∇2f(x),
iterations suffice to ensure mW2(μN,πλ)≤εalg, where μN is the law of the N-th iterate and W2 is the quadratic Wasserstein distance. We also prove the Moreau-bias bound
mW2(πλ,π)≤4G2λ.
Thus, choosing λ≍ε/G2 gives an end-to-end guarantee for π. The universal estimate Bref≤d/λ yields O(ε−3) accuracy dependence. For the structured piecewise-linear, lasso-type, group, and total-variation penalties considered here, curvature--tube estimates make Bref independent of λ, yielding O(ε−2) for the same classical MYULA kernel.
We establish improved nonasymptotic bounds for Langevin Monte Carlo in the strongly log-concave setting, when the error is measured by the Wasserstein distance. The main result shows that the discretization error is governed by an average coordinate-wise smoothness constant, rather than by the usual global smoothness constant. The proof is short and probabilistic, and relies on a refined use of the synchronous coupling. We further show that the same ideas lead to improved bounds for variable step sizes, for potentials whose Laplacian is Lipschitz-continuous, and for finite-sum problems sampled by stochastic-gradient Langevin dynamics with fixed point control variates. In the Laplacian-smooth case, the usual Hessian-Lipschitz contribution is replaced by a weaker trace-type third-order smoothness quantity. In the finite-sum setting, the resulting SGLD bound improves the dependence on the root mean square smoothness of the component functions. Applications to generalized linear models with Gaussian design show that these refinements can yield substantial, dimension-dependent improvements over previously known bounds, especially for correlated covariates.