Velocity Ambiguity Profiles: Time-Resolved Bayes-Risk Diagnostics for Flow Matching
Organizations: Beijing Institute of Technology · ByteDance
Abstract
Flow matching trains a continuum of velocity regression problems but usually reports a loss averaged over interpolation time, obscuring which regions are limited by intrinsic ambiguity and which remain data-limited. We introduce the Velocity Ambiguity Profile (VAP), , the time-local Bayes-risk floor of velocity prediction, and decompose time-resolved loss as , where only the excess term is reducible by more data or a different estimator. For training samples and a -component mixture in the structured example, we prove two statistical benchmarks. In an intrinsic local-regression benchmark, enters the time-dependent noise factor of the standard nonparametric rate. In separated isotropic Gaussian mixtures, the Bayes velocity becomes locally affine, and a label-oracle residual-regression benchmark has parametric excess-risk scale , matched within the same separated residual Gaussian-location subproblem. Controlled Gaussian-mixture experiments validate this diagnostic through a dense transition sweep, calibrated oracle-to-blind and empirical-proxy audits, and a local controlled time-sampler stress test in which a frozen reducible-error proxy reduces reducible loss while cross-cell sensitivity delimits aggressive sampling. On CIFAR-100 DINOv2 feature flow, guided time sampling reduces uniformly evaluated velocity loss by and global feature Fréchet distance (FD) by , while class-conditional kernel inception distance (KID) shows no improvement. VAP turns an averaged flow-matching objective into a time-resolved diagnostic for locating ambiguity-limited and data-limited regions.
Figures & tables
| Row | dev (%) | (%) | |
|---|---|---|---|
| sep | |||
| p.m. | |||
| Metric | Uniform | VAP-guided | Change |
|---|---|---|---|
| Global feature FD | |||
| Macro precision | |||
| Macro density | |||
| Macro coverage | |||
| Fine-label macro accuracy | pp | ||
| Macro conditional KID |
Appendix figures & tables30 assets
Supplementary material from the paper’s appendix.
Appendix
| Geometry | (MC) | (MC) | |||
|---|---|---|---|---|---|
| simplex | |||||
| simplex | |||||
| simplex | |||||
| equiangular | |||||
| equiangular | |||||
| equiangular |
| Experiment block | Implementation settings |
|---|---|
| Dense transition | , , , one-hot centers, reported across the values listed in Table 6 . Models use hidden width , training steps, Adam learning rate , , data seeds and initialization replicates per cell. Evaluation uses time bins on , evaluation actions, and noise draws per time bin; the main readout keeps . |
| Oracle-to-blind bridge | Five controlled rows are used: separated, partial-merge, and simplex rows at with and . The closed-form arms are the label-and-action true-label plug-in and EM-fitted blind OLS; neural arms use the same MLP class with hidden width . The secondary bridge run uses seeds, training steps, Adam learning rate , evaluation actions, and noise draws per time bin. |
| Proxy-floor audit | The proxy audit is a post-processing pass over controlled-result JSON files. It compares the exact excess with the empirical proxy , where is the large-budget reference profile stored with each controlled row. The audit reports Spearman rank agreement, region-label agreement, negative proxy-excess counts, and the factor diagnostic . |
| Three-family heterogeneity panel | Three Gaussian-mixture families are trained with the same implementation: a well-separated ring, a high-entropy ring, and a partial-merge geometry. The panel uses time bins on , data seeds with initialization replicates, hidden width , and to training steps. |
| Time-sampler stress test | The intervention cell is a balanced partial-merge GMM with , , , pair gap , spread , and demonstrations ( per component). The MLP has hidden width and is trained for steps with Adam learning rate . The baseline samples ; gap arms use a categorical sampler on fine time bins, with no importance correction and the standard MSE objective. The proxy is frozen from source baseline seeds at ts using source evaluation-action key ; paired comparisons use seeds and evaluation-action key . |
| Regime | CI | CV | ||
|---|---|---|---|---|
| overlap / noise floor | ||||
| transition | ||||
| parametric plateau | ||||
| bias transition | ||||
| extreme separation |
| abstain | CI | mean SNR | |||||
|---|---|---|---|---|---|---|---|
| Readout | SNR | gate | retained | plateau | mean CV | |
|---|---|---|---|---|---|---|
| raw-positive | ( ) | |||||
| loose | ( ) | |||||
| canonical / mid-b | ( ) | |||||
| very-strict | ( ) |
| SNR gate \ gate | ||||||
|---|---|---|---|---|---|---|
| Row ( ) | Full | Within | Flat | Large- |
|---|---|---|---|---|
| separated ( ) | ||||
| boundary ( ) | ||||
| failure ( ) | ||||
| overlap ( ) |
| Row | |||
|---|---|---|---|
| sep. | |||
| sep. | |||
| strict | |||
| -sweep ( ) | |||
| aux. ( ) |
| Instance | Seeds | Region-label match | Strict-tie gap | |
|---|---|---|---|---|
| canonical pool | ||||
| pool | ||||
| pool | ||||
| pool | ||||
| extended pool |
| row | flip bins | std mid/high | |||
|---|---|---|---|---|---|
| separated, | |||||
| separated, | |||||
| separated, | |||||
| separated, |
| band | cells | range |
|---|---|---|
| family | geometry | range | peak | peak |
|---|---|---|---|---|
| well-separated | ring | |||
| high-entropy | ring | |||
| partial-merge | paired |
| Metric | Uniform | VAP-guided | Paired change |
|---|---|---|---|
| Global feature FD | |||
| Precision ( ) | |||
| Density ( ) | |||
| Coverage ( ) | |||
| Fine macro accuracy | |||
| Fine cross-entropy |
| Arm | Sampler | Mean | SE (%) | |
|---|---|---|---|---|
| gap_mix_025 | mixture ( ) | |||
| gap_mix_050 | mixture ( ) | |||
| gap_mix_075 | mixture ( ) | |||
| gap_pure_a1 | pure ( ) | |||
| gap_pure_a2 | pure ( ) | |||
| gap_pure_a4 | pure ( ) |
| Arm | (canonical) | ||
|---|---|---|---|
| gap_mix_025 | |||
| gap_mix_050 | |||
| gap_mix_075 | |||
| gap_pure_a1 | |||
| gap_pure_a2 | |||
| gap_pure_a4 |
| row | within at | relative gap |
|---|---|---|
| separated | ||
| partial-merge | ||
| simplex | ||
| simplex | ||
| simplex |
| row | CV across | grid | |
|---|---|---|---|
| separated | |||
| partial-merge | |||
| simplex | |||
| simplex | |||
| simplex |
| row | [CI] | EM [CI] | MLP |
|---|---|---|---|
| sep | [ , ] | [ , ] | |
| p.m. | [ , ] | [ , ] | |
| simplex | [ , ] | [ , ] | |
| simplex | [ , ] | [ , ] | |
| simplex | [ , ] | [ , ] |
| label-resid. [CI] | two-stage [CI] | soft-EM [CI] | two-stage (%w) | between/within (%) | |
|---|---|---|---|---|---|
| [ , ] | [ , ] | [ , ] | |||
| [ , ] | [ , ] | [ , ] | |||
| [ , ] | [ , ] | [ , ] | |||
| [ , ] | [ , ] | [ , ] | |||
| [ , ] | [ , ] | [ , ] | |||
| [ , ] | [ , ] | [ , ] |
| Hyperparameter | Value |
|---|---|
| Action Expert Width | |
| Action Expert Depth | |
| Action Expert MLP Dim | |
| Batch Size | |
| Chunk Size | |
| Learning Rate |
| Task | Region ratios | Reg. CV | Peak | |||
|---|---|---|---|---|---|---|
| collecting | / / | / / | ||||
| preparing | / / | / / | ||||
| cook_hot_dogs | / / | / / | ||||
| moving_boxes | / / | / / | ||||
| wash_cap | / / | / / | ||||
| cook_bacon | / / | / / |
Flow Matching
Flow matching learns continuous-time vector fields that transport simple noise distributions into data for efficient generative modeling.
See all 663 papers