Sharp dimensional analysis of midpoint methods for Langevin sampling
Authors: Fan Chen, Sinho Chewi, Jianfeng Lu, Matthew S. Zhang
Organizations: Department of Electrical Engineering and Computer Science, Massachusetts Institute of Technology. · Department of Statistics and Data Science, Yale University. · Department of Mathematics, Duke University. · Department of Mathematics, Massachusetts Institute of Technology.
We study deterministic and randomized midpoint discretizations of Langevin dynamics for a target π∝e−V, where 0≺αI⪯∇2V⪯βI and κ=β/α. To achieve αW2⩽ε, we show that deterministic Heun uses at most O(κ4/3d1/3ε−2/3) gradient queries, and underdamped exponential midpoint uses O(κ5/4d1/4ε−1/2). The proofs exploit cancellation at stationarity and smoothing using techniques from Malliavin calculus, outperforming previous upper bounds based on standard couplings. At bounded condition number, a lower bound matches the d and ε powers of both deterministic methods. To contrast, for the randomized midpoint methods and Poisson midpoint with at least two grid points (both overdamped and underdamped variants), a simple Gaussian calculation yields a lower bound d1/3ε−1/3 to get an ε-close sample despite starting at a benign initialization. This shows surprisingly that in high dimensions, deterministic discretizations can outperform their random counterparts.
Figures & tables
Method
Upper bound
Lower bound
Overdamped Euler (LMC)
d1/2ε−1 [ 44 ]
d1/2ε−1 [ 54 , Example 2]
Heun
d1/3ε−2/3
d1/3ε−2/3
RLMC
d1/2ε−1 [ 28 ]
d1/3ε−1/3
PLMC
d2/3ε−2/3 [ 50 ]
d1/3ε−1/3
Underdamped exponential midpoint
d1/4ε−1/2
d1/4ε−1/2
RULMC
d1/3ε−2/3 [ 48 ]
d1/3ε−1/3
Table 1: Gradient query bounds for αW2⩽ε at bounded condition number, omitting logarithms. Bold entries are new results. “Lower bound” means a necessary number of iterations for some admissible target and an initial distribution with expected energy gap O(d) , as specified in Theorem 1.2 . Poisson methods use at least two grid points and have constant expected gradient cost per batch. The cited upper bounds have their own initialization hypotheses; PULMC’s general p bound is discussed below.