Gaussian process learning with flow map refinement for parameter estimation in dynamical systems
Authors: Yue Hao, Dongwei Ye
Organizations: School of Mathematical Science, Suzhou University of Science and Technology, Suzhou, PR China · Department of Applied Mathematics, Xi’an Jiaotong-Liverpool University, Suzhou, PR China
Parameter estimation is a central task in data-driven learning of dynamical systems. It aims to recover the underlying physical parameters from observed time-series data, thereby providing interpretable insights into the physical mechanisms governing the system. Gradient/derivative matching methods based on Gaussian process provide an efficient way to perform parameter estimation. Those methods avoid repeated numerical integration and enforce local derivative consistency. However, such local matching may result in global inconsistency with the governing flow map, particularly under scarce and noisy observations. To address this limitation, we propose a framework based on Gaussian process learning with flow map refinement (GPL-FMR), a two-stage parameter estimation framework. The first stage is based on Gaussian process learning algorithm and the posterior obtained from which is transferred as an informative prior to the second stage based on flow-map refinement. The second stage further improves the parameter estimation via optimisation based on global dynamical constraints. We demonstrate and analyse its performance on multiple numerical examples, including the Van der Pol oscillator, the Lotka-Volterra model, and the Lorenz-63 system. The results show that the proposed framework consistently improves parameter estimation accuracy, particularly under scarce and noisy observations.
Figures & tables
Figure 1: Schematic diagram of the proposed two-stage parameter estimation framework. The first stage employs Gaussian process learning (blue), while the second stage applies flow-map refinement (red) to further refine the parameter estimates.
Figure 2: Trajectory reconstruction for the Van der Pol oscillator using the estimated parameters and the prescribed initial condition, with Nt=20 and Nt=100 observations under 10% and 30% noise levels. The uncertainty bands correspond to two standard deviations obtained from the Laplace approximation.
Figure 3: Comparison between the trajectories reconstructed from the inferred latent states and the GP-smoothed trajectories obtained from the GPL stage for the Van der Pol oscillator under 30% noise.
Figure 4: Comparison of the relative errors in parameter estimation for the Lotka-Volterra model using feature regression (FR), GPL, and the proposed GPL-FMR method, with 20,30,40,50, and 100 observations under 10%, 20%, and 30% noise levels.
Figure 5: Trajectory reconstruction for the Lotka-Volterra model using the estimated parameters and prescribed initial condition, with Nt=20 and Nt=100 observations under 10% and 30% noise levels. The uncertainty bands correspond to two standard deviations obtained from the Laplace approximation.
Figure 6: Comparison between the trajectories reconstructed from the inferred latent states and the GP-smoothed trajectories obtained from the GPL stage for the Lotka-Volterra model under 30% noise.
Figure 7: Comparison of the relative errors in parameter estimation for the Lotka-Volterra model using feature regression (FR), GPL, and the proposed GPL-FMR method, with 20,30,40,50, and 100 observations under 10%, 20%, and 30% noise levels.
Figure 8: Trajectory reconstruction for the Lorenz-63 model using the estimated parameters and prescribed initial condition, with Nt=20 and Nt=100 observations under 10% noise levels. The uncertainty bands correspond to two standard deviations obtained from the Laplace approximation.
Figure 9: Trajectory reconstruction for the Lorenz-63 model using the estimated parameters and prescribed initial condition, with Nt=20 and Nt=100 observations under 30% noise levels. The uncertainty bands correspond to two standard deviations obtained from the Laplace approximation.
Figure 10: Comparison between the trajectories reconstructed from the inferred latent states and the GP-smoothed trajectories obtained from the GPL stage for the Lorenz-63 system under 30% noise.
In this paper, we propose Lagrangian Gaussian Processes (LGPs) for probabilistic and data-efficient learning of dynamics via discrete forced Euler-Lagrange equations. Importantly, the geometric structure of the Lagrange-d'Alembert principle, which governs the motion of dynamical systems, is preserved by construction in the absence of external forces. This allows learning physically consistent models that overcome erroneous drift in the system's energy, thereby providing stable long-term predictions. At the core of our approach lie linear operators for Gaussian process conditioning, constructed from discrete forced Euler-Lagrange equations and variational discretization schemes. Thereby and unlike prior work, the method enables learning dynamics from discrete position snapshots, i.e., without access to a system's velocities or momenta. This is particularly relevant for a large class of practical scenarios where only position measurements are available, for instance, in motion capture or visual servoing applications. We demonstrate the data-efficiency and generalization capabilities of the LGPs in various synthetic and real-world case studies, including a real-world soft robot with hysteresis. The experimental results underscore that the LGPs learn physically consistent dynamics with uncertainty quantification solely from sparse positional data and enable stable long-term predictions.
Outside the linear-Gaussian regime, conditional sampling from Gaussian processes (GPs) is challenging. Recent methods such as FlowGP (Moss et al., (2026)) can condition on arbitrary non-linear and non-Gaussian statements, but at considerable cost: an expensive iterative and high-dimensional diffusion that requires hand-specified kernel hyperparameters. In this paper, we alleviate two significant drawbacks of FlowGP by (1) introducing kernel approximations that enable scaling to high-resolution domains and (2) proposing a way to obtain the marginal likelihood by measuring the work needed to steer the diffusion towards conditioning statements. We enable, for the first time, hyperparameter optimisation within FlowGP and demonstrate our approach on probabilistic downscaling from areal summary statistics, PDE solution inference on irregular domains, and recovery of sea level anomaly fields from non-Gaussian satellite observations.
Thomas Cowperthwaite, Louis Sharrock, Lachlan Astfalck +1
University of Cambridge · University College London · University of New South Wales +1
Simulation-free training of latent Stochastic Differential Equations (SDEs) relies on a variational posterior process whose one-time marginals are tractable, typically Gaussian. Such marginals, however, do not determine the underlying dynamics: many processes share the same marginals while differing in their temporal structure, and existing parameterizations fix this structure implicitly, which restricts the posterior family and biases the learned model. We introduce Gaussian flow dynamics, which construct stochastic processes directly from smoothly evolving Gaussian marginals while making the marginal-preserving, or gauge, degrees of freedom explicit and parameterizable. The construction admits state-dependent diffusion coefficients and recovers every linear SDE with additive noise and a non-degenerate Gaussian initial distribution. Building on it, we propose Gauge Matching, a simulation-free method for latent SDE learning that combines Gaussian flow dynamics with the SDE Matching objective. Gauge Matching costs at most quadratically in the latent dimension per step, like SDE Matching, but learns the temporal structure of the posterior beyond its one-time marginals. It comes within a nat of Helmholtz-SDE, which computes the gauge from the prior Jacobian at cubic cost, on the linear benchmark where the exact posterior is known, matches it on nonlinear systems, and applies where Helmholtz-SDE does not, to state-dependent noise.