Minimax-Optimal Predictive Flow Matching under Distribution Drift
Organizations: Purdue University, West Lafayette
Abstract
Flow matching learns a generative velocity field by regression, but under distribution drift a field must be deployed before the current data arrive. We study this predictive problem for a fixed, possibly nonconvex, neural class, with dynamic regret against the best represented field of each round. We propose DyProd-FM, which refits flow matching on dyadic historical prefixes and selects among the fits with a sleeping Prod master. Without knowing any drift budget, it attains regret in the relative velocity risk variation and in the target-law variation , up to approximation and fitting costs. Matching lower bounds for fixed classes show that both rates are optimal in and in the budgets up to logarithmic factors. Prior optimal dynamic-regret guarantees rely on a convex decision set with strongly convex or exp-concave losses, whereas our class may be nonconvex and no curvature in its parameters is assumed. The target-law rate rests on a second-order link between the two variations, which the base noise of flow matching provides.
Figures & tables
Appendix figures & tables2 assets
Supplementary material from the paper’s appendix.
Appendix
| Symbol | Meaning in Theorems 1 – 2 |
|---|---|
| Horizon, triples per round, dimension. | |
| Base law, round- target law, flow-time law. | |
| Represented class, its output bound, and its spatial Lipschitz constant (Equation ( 14 )). | |
| Absolute velocity risk, class approximation error, excess velocity risk (Equation ( 5 )). | |
| Dynamic velocity regret and cumulative approximation error (Equation ( 7 )). | |
| Caps on the relative velocity risk variation and its change count (Equation ( 9 )). |
| Variation | Budget | Upper bound | Lower bound | Family |
|---|---|---|---|---|
| Relative risk | (Thm. 1 ) | (Prop. F.1 ) | Gaussian means | |
| Relative risk | (Thm. 1 ) | (Prop. F.2 ) | rare Gaussian mixture | |
| Target law | (Thm. 2 ) | (Prop. F.1 ) | Gaussian means | |
| Target law | (Thm. 2 ) | (Prop. F.3 ) | Gaussian means |
Flow Matching
Flow matching learns continuous-time vector fields that transport simple noise distributions into data for efficient generative modeling.
See all 658 papers