When do explicit penalties improve flow matching?
Abstract
Flow matching can learn structure directly from data, raising the question of when additional constraints improve generation. We study penalties that encode such constraints, with physics-informed flow matching as a motivating example. Satisfying a constraint more closely need not make the generated distribution more accurate. We therefore compare penalised and unpenalised generative modelling through their expected squared -Wasserstein error. Our analysis covers both vector-valued and functional data in a Hilbert-space setting. We first derive geometric criteria that account for constraint violations and the distribution of samples after projection onto the constraint set. We then solve the statistical comparison explicitly for specific velocity-field classes and constraints via flow matching. In this model, penalisation improves accuracy exactly when the reduction in estimation variance outweighs the increase in squared bias. The resulting formula shows how this trade-off depends on sample size, the model class, the noise schedule, and the penalty weight.
Figures & tables
Appendix figures & tables1 asset
Supplementary material from the paper’s appendix.
Appendix
| Latin | English definition |
|---|---|
| ad hoc | made or happening only for a particular purpose or need, not planned before it happens |
| a fortiori | for an even stronger reason than one that has already been accepted |
| in toto | as a total or whole |
| ipso facto | used to say that it is reasonable to state […] something based on facts that are already known |
| mutatis mutandis | used when comparing two […] things to say that although changes will be necessary in order to take account of different situations, the basic point remains the same. |
Flow Matching
Flow matching learns continuous-time vector fields that transport simple noise distributions into data for efficient generative modeling.
See all 658 papers