Change Detection in Probability Flow ODE: Online Testing in Diffusion Latent Spaces
Organizations: National Research University Higher School of Economics Moscow, Russia · The University of Sydney Business School & CIREQ & CEBDA Sydney, Australia
Abstract
A rapidly growing range of sequential data tasks, such as identifying trend reversals in financial markets, auto-segmenting video and audio recordings, detecting changes in movement direction from motion sensors cannot be fully addressed without detection of distributional shifts in time-ordered data. We consider a sequential change-point detection problem where the conditional density switches at an unknown time, yet neither the pre- nor post-change distribution admits a closed-form. Classical likelihood-ratio statistics are inapplicable in this settings. A conditional diffusion model, trained on pre-change-point data with a frozen context encoder, defines a deterministic bijection via the probability flow ODE. Pre-change observations are mapped onto standard Gaussian latent variables. Post-change observations, processed through the same frozen map, deviate from this reference. We employ the Maximum Mean Discrepancy as the test statistic, derive closed-form expressions for its components under the Gaussian null, and establish its asymptotic distribution as a degenerate U-statistic. Afterwards we apply an online detection procedure of Shiryaev--Roberts to the resulting statistic with exact threshold calibration. The method detects arbitrary distributional shifts, including covariance rotations and higher-order structural breaks, without parametric assumptions on either regime.
Figures & tables
| Experiment | Method | null dist. | avg. delay | ||
|---|---|---|---|---|---|
| Gaussian mixture rotation | Ours | exact | |||
| A | approx. | ||||
| B | exact | ||||
| C | asympt. | ||||
| Four clusters one | Ours | exact | |||
| A | approx. |
Appendix figures & tables3 assets
Supplementary material from the paper’s appendix.
Appendix
| Kernel | Detectable shifts | ||||
|---|---|---|---|---|---|
| Linear | (exact, any ) | Mean only: | |||
| Deg.- poly. | , | Moments : mean, cov., skewness | |||
| RBF | , | Any | |||
| Laplace | No closed form | No closed form | , | Any | |
| IMQ | No closed form | No closed form | , exp. decay | Any |
| Experiment | delay | ||||
|---|---|---|---|---|---|
| Gaussian mixture rotation | |||||
| Four clusters one | |||||
| Blob Ring |
| 2D pairs (§ 4 ) | MNIST (§ 5 ) | |
| observation dim | ( ) | |
| history encoder | GRU, hidden | MLP embed ( ) GRU, hidden |
| denoiser conditioning | FiLM | concatenation, CFG dropout |
| denoiser width / # blocks | / | / |
| diffusion steps | ||
| schedule | linear, | linear, |
Distribution Shift Detection
Distribution shift detection identifies when data or model behavior changes between reference and deployment settings.
See all 62 papers