Generalization Bounds for Flow-matching Generative Models for Intrinsically Low-dimensional Data
Authors: Saptarshi Chakraborty, Quentin Berthet, Peter L. Bartlett
Organizations: Department of Statistics, University of Michigan · Google DeepMind · Department of Statistics, University of California, Berkeley · Department of Electrical Engineering and Computer Sciences, UC Berkeley
Despite the remarkable empirical success of flow-matching models, their statistical generalization guarantees remain underdeveloped. Existing analyses often impose restrictive assumptions on the estimated velocity field and yield convergence rates that fail to reflect the intrinsic low-dimensional structure common in real data, such as natural images and molecular geometries. In this work, we study the statistical generalization of flow-matching models for learning an unknown distribution Pdata from finitely many samples. We derive finite-sample error bounds on the learned generative distribution, measured in the Wasserstein-p distance, for all p≥1. Specifically, given n i.i.d. samples from Pdata, we show that, for every d>dp∗(Pdata) and appropriately chosen network architectures and hyperparameters, the learned distribution PFM satisfies Wp(PFM,Pdata)≲n−1/d+n−1/(2p)(log(1/ξ))1/(2p) with probability at least 1−ξ, where dp∗(Pdata) denotes the Wasserstein-p dimension of the target measure. Our results demonstrate that flow matching naturally adapts to the intrinsic geometry of data and mitigates the curse of dimensionality, as the convergence exponent depends on the intrinsic rather than ambient dimension. These guarantees remain meaningful in high-dimensional regimes and provide a theoretical explanation for the empirical success of flow matching on structured data distributions under substantially more relaxed assumptions than those in existing analyses.
Figures & tables
Figure 1 : Average generalization error (in terms of FID scores) for different values of n for flow-matching. The error bars denote the standard deviation out of 10 replications.