stat.MLJan 20, 2026

Finite-Sample Unbiased Variance of MMD under Unbalanced Sampling: Exact Estimation and Quasi-Linear Computation

Authors: Shijie ZhongYikun YangDa GongJiangfeng Fu

Abstract

Accurately and efficiently estimating the variance of the Maximum Mean Discrepancy (MMD) remains challenging, particularly for unbalanced sample sizes. In this paper, we derive a finite-sample unbiased estimator of the MMD variance. To overcome the traditional O(N2)\mathcal{O}(N^2) computational bottleneck, we develop a recursive prefix-suffix accumulation scheme for the Laplace kernel, reducing the computational complexity to O(NlogN)\mathcal{O}(N \log N) while requiring O(N)\mathcal{O}(N) memory. Experimental results verify the theoretical exactness and numerical stability of the proposed estimator and demonstrate its scalability on large datasets. Furthermore, the method proves effective for monitoring distributional convergence during the training of Time-series Generative Adversarial Networks (TimeGAN).

Explore similar work

CardsList
  1. Sobolev Regularized MMD Gradient Flow

    May 12, 2026Chenyang Tian, Bharath K. Sriperumbudur, Arthur Gretton +1Maximum Mean DiscrepancyWasserstein Gradient Flows