stat.MLMay 10, 2026

Quantitative Local Convergence of Mean-Field Stein Variational Gradient Flow

Authors: Lénaïc ChizatMaria ColomboRoberto ColomboXavier Fernández-Real

Abstract

Stein Variational Gradient Descent (SVGD) is a deterministic interacting-particle method for sampling from a target probability measure given access to its score function. In the mean-field and continuous-time limit, it is known that the flow converges weakly toward the target, but no quantitative rate is known for the last iterate. In this paper, we establish quantitative local convergence in strong norms for this dynamics, when the interaction kernel is of Riesz type on the dd-dimensional torus. Specifically, assuming that the initial density and the target are smooth and close in L2L^2-norm, we obtain explicit polynomial convergence rates in L2L^2-norm that depend on the dimension and on the regularity parameters of the kernel, the initialization and the target. We further show that these rates are sharp in certain regimes, and support the theory with numerical experiments. In the edge case of kernels with a Coulomb singularity, we recover the global exponential convergence result established in prior work. Our analysis is inspired by recent results on Wasserstein gradient flows of kernel mean discrepancies.

Explore similar work

CardsList
  1. Improved Finite-Particle Convergence Rates for Stein Variational Gradient Descent

    Sep 13, 2024Sayan Banerjee, Krishnakumar Balasubramanian, Promit GhosalGradient DescentConvergence

  2. Sobolev Regularized MMD Gradient Flow

    May 12, 2026Chenyang Tian, Bharath K. Sriperumbudur, Arthur Gretton +1Maximum Mean DiscrepancyWasserstein Gradient Flows