math.STDec 30, 2025

Fast Score-Based Sampling via Log-Concave Reductions

Authors: M. J. Wainwright

Organizations: Laboratory for Information and Decision Systems · Statistics and Data Science Center · EECS & Mathematics · Massachusetts Institute of Technology

Abstract

Sampling based on score diffusions has led to striking empirical results, and has attracted considerable attention from various research communities. It depends on availability of (approximate) Stein score functions for various levels of additive noise. We show how in some generality, the availability of scores allows the general problem to be ``reduced'' to sampling from an adaptively constructed sequence of KK strongly log-concave (SLC) sub-problems. The reduction is simple, constructive and algorithm-independent, so that any SLC sampler can be used as a subroutine. Various bounds on score-based sampling complexity follow directly: for instance, high-accuracy SLC samplers yield O~(Kdpolylog(1/ε))\tilde{\mathcal{O}}(K \sqrt{d} \operatorname{polylog}(1/\varepsilon)) guarantees for accuracy ε\varepsilon in dimension dd, where randomized midpoint SLC schemes yield O~(Kd1/3poly(1/ε))\tilde{\mathcal{O}}(K d^{1/3} \operatorname{poly}(1/\varepsilon)) guarantees. When the original distribution itself is SLC, we prove that K1+log2(κ)K \leq 1 + \log_2(κ), thereby obtaining the first efficient procedure with logarithmic dependence on condition number κκ; for general distributions, the quantity KK depends on the geometry of score Hessian across the trajectory. Our analysis is direct and simple, involving techniques and insights complementary to those in standard analyses of discretized diffusions.

Explore similar work

CardsList