Identifying Drift, Diffusion, and Causal Structure from Temporal Snapshots
Organizations: Department of Mathematics University of British Columbia, Vancouver, Canada · Department of Earth, Ocean and Atmospheric Sciences University of British Columbia, Vancouver, Canada · School of Mathematics and Statistics University of Melbourne, Melbourne, Australia
Abstract
Stochastic differential equations (SDEs) are a fundamental tool for modelling dynamic processes, including gene regulatory networks (GRNs), contaminant transport, financial markets, and image generation. However, learning the underlying SDE from data is a challenging task, especially if individual trajectories are not observable. Motivated by burgeoning research in single-cell datasets, we present the first comprehensive approach for jointly identifying the drift and diffusion of an SDE from its temporal marginals. Assuming linear drift and additive diffusion, we show that non-identifiability can only arise if the initial distribution possesses generalized rotational symmetries. We further prove that even if this condition holds, the drift and diffusion can almost always be recovered from the marginals. Additionally, we show that the causal graph of any SDE with additive diffusion can be recovered from the identified SDE parameters. To complement this theory, we adapt entropy-regularized optimal transport to handle anisotropic diffusion and introduce APPEX (Alternating Projection Parameter Estimation from ), an iterative algorithm designed to estimate the drift, diffusion, and causal graph of an additive noise SDE, solely from temporal marginals, and demonstrate its effectiveness on simulated data from linear additive noise SDEs.
Figures & tables
| A Estimation | GG ⊤ Estimation | |||
|---|---|---|---|---|
| WOT | APPEX | WOT | APPEX | |
| 3 | ||||
| 4 | ||||
| 5 | ||||
| 6 | ||||
| 7 | ||||
| A Estimation | GG ⊤ Estimation | |||
|---|---|---|---|---|
| WOT | APPEX | WOT | APPEX | |
| 3 | ||||
| 4 | ||||
| 5 | ||||
| 6 | ||||
| 7 | ||||
| WOT | APPEX | WOT | APPEX | WOT | APPEX | |
|---|---|---|---|---|---|---|
| 3 | ||||||
| 5 | ||||||
| 10 | ||||||
| Hamming distance for drift edges | Hamming distance for latent confounders | |||
|---|---|---|---|---|
| WOT | APPEX | WOT | APPEX | |
| 3 | ||||
| 5 | ||||
| 10 | ||||
Appendix figures & tables4 assets
Supplementary material from the paper’s appendix.
Appendix
Stochastic Differential Equations
Stochastic Differential Equations describe continuous-time systems whose dynamics combine deterministic drift with random noise.
See all 117 papers