Continuous-Time Trajectory Generation from Discrete Observations with Stochasticity
Authors: Ruifeng Shang, Shu Liu, Yuhua Zhu
Organizations: Department of Mathematics Florida State University Tallahassee, FL 32306, USA · Department of Statistics and Data Science University of California, Los Angeles Los Angeles, CA 90095, USA
Physical systems evolve continuously in time, yet their states are typically observed only at discrete times. Generating trajectories consistent with their probability densities from such observations therefore requires capturing the continuous-time evolution rather than only learning transition mappings between consecutive observations. We propose PhiBE-Flow, a framework that directly estimates the probability velocity field induced by the stochastic differential equation (SDE) which governs this continuous-time distributional evolution. PhiBE-Flow learns from discrete observations using a model-free approach requiring neither known SDE coefficients nor score estimation. We establish convergence guarantees for the method, accounting for both time-discretization and finite-sample errors. We evaluate PhiBE-Flow on systems of increasing complexity, from controlled stochastic numerical systems to Navier--Stokes dynamics and real-world videos. Our results show that PhiBE-Flow accurately recovers probability flows of stochastic dynamics, preserves multiscale physical statistics, and improves video generation performance over representative baselines. The code is available at https://github.com/R1fe/PhiBE-Flow.
Figures & tables
Figure 1: Overview of PhiBE-Flow. Top: frame-to-frame methods learn relations between sampled states. Bottom: PhiBE-Flow directly learns the SDE-induced probability velocity.
Figure 2: PhiBE-Flow on reversible and non-reversible OU processes. (a) PhiBE-Flow (green) and analytical (orange) probability-flow trajectories for the non-reversible case. (b) PhiBE-Flow (blue) and OU-process (red) samples at t=15 . (c) PhiBE-Flow (green) and analytical (orange) trajectories for the reversible case. (d) Global L2 velocity error versus temporal observations Nt . (e) Global L2 velocity error versus observed trajectories N .
Figure 3: State-space learning on the stochastic double-pendulum system. Ground-truth and PhiBE-Flow predictions for two joint angles θ1,θ2 and angular velocities θ˙1,θ˙2 over physical time.
Figure 4: Image-based Learning on the stochastic double-pendulum system. The top row shows the ground-truth image sequence. The bottom row shows results from PhiBE-Flow.
Figure 5: Temporal generation results on Navier–Stokes. Ground-truth vorticity fields and results from MCVD, PFI, and PhiBE-Flow, together with their corresponding error maps.
Standard metrics
Adjusted metrics
Method
MSE( ×10−2 ) ↓
FVD ↓
PSNR ↑
SSIM ↑
MSE( ×10−2 ) ↓
FVD ↓
PSNR ↑
SSIM ↑
MCVD
0.8550
307.3
20.68
0.6986
–
–
–
–
PFI
0.6637
280.1
21.78
0.7254
0.6576
247.1
21.82
0.7372
PhiBE-Flow
0.4405
227.5
23.56
0.7663
0.4305
192.7
23.66
0.7800
Table 1: Metric results on KTH. Standard metrics compare generated results with the original ground truth. Adjusted metrics compare generated results with the reconstructed ground truth.
Figure 7: Video generation on the KTH dataset. The top row shows the ground-truth trajectory. The following three rows show generation results from MCVD, PFI, and PhiBE-Flow, respectively.
Appendix figures & tables2 assets
Supplementary material from the paper’s appendix.
Appendix
Figure 8: Time evolution of selected mean and covariance components of the marginal distributions for reversible (left two panels) and non-reversible (right two panels) OU processes. Results obtained from the computed probability flows are compared with the exact solutions.
Model
Layer
Output Shape
Encoder
Input image x (resized)
1×32×32
Conv2d( 1→32 ), LeakyReLU, BatchNorm
32×16×16
Conv2d( 32→64 ), LeakyReLU
64×8×8
Conv2d( 64→128 ), LeakyReLU, BatchNorm
128×4×4
Flatten, Linear( 2048→3 )
3
Decoder
Input latent z
3×1×1
Appendix
Table 2: Architectures of the geometry-preserving encoder Tϕ and decoder Sψ .
Flow and diffusion models generate high-quality samples in many modalities; however, many network evaluations are required during inference due to numerical integration of an underlying differential equation. Flow maps alleviate this problem by learning the solution map of the differential equation directly, enabling few-step sampling. Yet, current methods are restricted to approximating the solution map of ODEs. These methods can be used to learn the transition kernel of an SDE, thereby obtaining a solution map that recovers the marginal distributions of the process (weak convergence) rather than the solution path (strong convergence). We propose Strong Stochastic Flow Maps (SSFMs) as a novel framework for learning the strong solution map of additive-noise SDEs, directly generalizing deterministic flow maps to the stochastic setting. Further, a polynomial approximation to Brownian motion is introduced and shown to converge pathwise. These results enable a simulation-free training objective for the solution map of diffusion models. We demonstrate that SSFMs outperform previous stochastic flow map methods on image generation and enable few-step sampling of molecular systems.
Sam McCallum, Zander W. Blasingame, Timothy Herschell +3
MeanFlow enables one-step generation in continuous spaces by learning an average velocity over a time interval rather than the instantaneous velocity field of flow matching. However, discrete state spaces lack smooth trajectories or spatial derivatives, so the continuous formulation does not directly apply. We introduce Discrete MeanFlow, a theoretical finite-state formulation that replaces point motion with probability-mass transport. Our key object is the conditional transition kernel of a continuous-time Markov chain (CTMC), from which we define a mean discrete rate that measures average transition-probability change over a finite interval. We prove a Discrete MeanFlow identity that relates this finite-interval rate to the instantaneous CTMC generator at the endpoint, using the Kolmogorov forward equation in place of the spatial chain rule in continuous MeanFlow. We parameterize the transition kernel directly using a boundary-by-construction design that guarantees valid probability outputs and exact boundary conditions without auxiliary losses. Because the learned kernel defines a probability distribution, generation requires only a single forward pass followed by direct sampling, eliminating the need for iterative denoising, ODE integration, or multi-step refinement. We validate the identity on exact finite-state Markov chains, demonstrating that the learned kernel recovers the analytical ground truth with high precision. We also investigate the training objective and the limits of factorization on synthetic sequence tasks across varying alphabet sizes and sequence lengths.
Fairoz Nower Khan, Nabuat Zaman Nahim, Md Sajid Ahmed +2
Department of Computer Science, University of Kentucky, Lexington, Kentucky 40506, USA
We benchmark transport-based generative models as well as distillation-based few-step methods for the probabilistic forecasting of stochastic fluid flows, with a particular focus on performance under limited inference budgets. All methods are evaluated on a two-dimensional Kolmogorov flow with stochastic forcing. We measure one-step distributional accuracy against large simulated reference ensembles and assess whether the invariant measure is preserved during autoregressive rollouts via the enstrophy spectrum. On the stochastic task, flow matching achieves the most accurate one-step conditional distribution at high inference budgets, while the second-order exponential integrator DPM-2 is strongest at very low NFE. Few-step distillation methods are competitive with the multi-step methods and preserve the enstrophy spectrum particularly well. A deterministic control task, in which the forcing over the prediction interval is observed, separates aleatoric from epistemic uncertainty. Model performance does not translate between the two settings: the distilled models are competitive on the stochastic task but least accurate on the control task. While stochastic diffusion samplers such as DDPM better preserve the enstrophy spectrum during rollouts in the stochastic setting, deterministic samplers such as DDIM and DPM-2 show better spectral preservation in the deterministic setting.
Sebastian Pfister, Benjamin Holzschuh, Nils Thuerey
School of Computation, Information and Technology, Technical University of Munich, Germany.