cs.LGAug 13, 2026

Active-Trace Complexity Bounds for Moreau--Yosida Unadjusted Langevin Sampling

Authors: Yuchen XinZhihua Zhang

Organizations: School of Mathematical Sciences, Peking University

Abstract

We study the Moreau--Yosida unadjusted Langevin algorithm (MYULA) for the nonsmooth composite target

π(dx)exp{f(x)g(x)}dx,xRd,π(dx)\propto \exp\{-f(x)-g(x)\}\,dx, \qquad x\in\mathbb R^d,

where ff is mm-strongly convex with LfL_f-Lipschitz gradient and gg is convex and GG-Lipschitz. Let gλg_λ be the Moreau envelope of gg, πλπ_λ the corresponding smoothed target, and aλ=trHλa_λ=\operatorname{tr}H_λ, where HλH_λ is the a.e./weak Hessian of gλg_λ. We show that the leading MYULA discretization error is controlled by the reference active trace BrefB_{\mathrm{ref}}, the average of aλa_λ along the heat substep of one MYULA update started from πλπ_λ, rather than by the global curvature bound d/λd/λ. If MλM_λ is an a.e. upper bound for aλa_λ, then, up to logarithmic factors,

N1m[Lf+τf+G2+Brefεalg2+Mλεalg],τf:=supxtr2f(x),N \lesssim \frac{1}{m} \left[ L_f + \frac{ τ_f+G^2+B_{\mathrm{ref}} }{ \varepsilon_{\mathrm{alg}}^2 } + \frac{M_λ}{\varepsilon_{\mathrm{alg}}} \right], \qquad τ_f:= \sup_x\operatorname{tr}\nabla^2 f(x),

iterations suffice to ensure mW2(μN,πλ)εalg\sqrt m\,W_2(μ_N,π_λ)\leq\varepsilon_{\mathrm{alg}}, where μNμ_N is the law of the NN-th iterate and W2W_2 is the quadratic Wasserstein distance. We also prove the Moreau-bias bound

mW2(πλ,π)G2λ4.\sqrt m\,W_2(π_λ,π) \leq \frac{G^2λ}{4}.

Thus, choosing λε/G2λ\asymp\varepsilon/G^2 gives an end-to-end guarantee for ππ. The universal estimate Brefd/λB_{\mathrm{ref}}\leq d/λ yields O~(ε3)\widetilde O(\varepsilon^{-3}) accuracy dependence. For the structured piecewise-linear, lasso-type, group, and total-variation penalties considered here, curvature--tube estimates make BrefB_{\mathrm{ref}} independent of λλ, yielding O~(ε2)\widetilde O(\varepsilon^{-2}) for the same classical MYULA kernel.

Explore similar work

Sep 14, 2026cs.LG

Poisson-Corrector Complexity Bounds for Moreau--Yosida Unadjusted Langevin Sampling

We study the classical Moreau--Yosida unadjusted Langevin algorithm (MYULA) for π(dx)ef(x)g(x)dx\pi(\,\mathrm{d} x)\propto e^{-f(x)-g(x)}\,\mathrm{d} x, where fC2(Rd)f\in C^2(\mathbb{R}^d) is mm-strongly convex with LfL_f-Lipschitz gradient and g:RdRg:\mathbb{R}^d\to\mathbb{R} is convex and globally GG-Lipschitz. For the Moreau-smoothed target πλ\pi_\lambda and the MYULA invariant law π^λ,h\widehat\pi_{\lambda,h}, we prove mW2(πλ,π^λ,h)=O(h)+O~(h3/4)\sqrt m\,W_2(\pi_\lambda,\widehat\pi_{\lambda,h}) =O(h)+\widetilde O(h^{3/4}) under 0<h(Lf+λ1)c0<h(L_f+\lambda^{-1})\le c, with only logarithmic dependence on λ1\lambda^{-1} in the error coefficients. Combining this estimate with the Moreau approximation bias yields O~(ε4/3)\widetilde O(\varepsilon^{-4/3}) iterations to achieve mW2(μN,π)ε\sqrt m\,W_2(\mu_N,\pi)\le\varepsilon, for fixed model parameters and initialization. The proof combines a discrete Poisson corrector with active-trace estimates and a shared-noise bound for the exact--Euler two-point curvature.
Yuchen Xin, Zhihua Zhang
May 29, 2026math.ST

Improved Guarantees for Langevin Monte Carlo with Average Smoothness

We establish improved nonasymptotic bounds for Langevin Monte Carlo in the strongly log-concave setting, when the error is measured by the Wasserstein distance. The main result shows that the discretization error is governed by an average coordinate-wise smoothness constant, rather than by the usual global smoothness constant. The proof is short and probabilistic, and relies on a refined use of the synchronous coupling. We further show that the same ideas lead to improved bounds for variable step sizes, for potentials whose Laplacian is Lipschitz-continuous, and for finite-sum problems sampled by stochastic-gradient Langevin dynamics with fixed point control variates. In the Laplacian-smooth case, the usual Hessian-Lipschitz contribution is replaced by a weaker trace-type third-order smoothness quantity. In the finite-sum setting, the resulting SGLD bound improves the dependence on the root mean square smoothness of the component functions. Applications to generalized linear models with Gaussian design show that these refinements can yield substantial, dimension-dependent improvements over previously known bounds, especially for correlated covariates.
Arnak S. Dalalyan, Avetik Karagulyan
Aug 3, 2026stat.CO

Wasserstein mixing time of the unadjusted Langevin algorithm

We provide new estimates in Wasserstein distance for the asymptotic bias of the unadjusted Langevin algorithm, in the classical setting of log-smooth strongly log-concave measures. Our bound implies a Wasserstein mixing time of order κd/εκ\sqrt{d}/\varepsilon, where κκ is the condition number, dd is the dimension, and ε\varepsilon is the target precision: this improves by a factor of d/ε\sqrt{d}/\varepsilon over the previous state-of-the-art results.
Francesco Pedrotti, Peter A. Whalley