Neural Conditional Gaussian Model: Efficient Data Assimilation with Sequential Uncertainty Quantification for Nonlinear Dynamics
Organizations: Department of the Geophysical Sciences, University of Chicago, Chicago, IL 60637 · Department of Mathematics, University of Wisconsin–Madison, Madison, WI 53706
Abstract
Data assimilation (DA) in partially observed nonlinear systems requires repeated estimation of both hidden states and their uncertainty. Conventional nonlinear filtering can be computationally expensive and often relies on an explicit dynamical model. In this paper, we develop the Neural Conditional Gaussian Model (Neural CGM), a data-driven dynamical model that maps unobserved physical states into a learned latent space, where the dynamics of the latent states follow a conditional Gaussian structure. This structure allows closed-form DA updates in the latent space, while nonlinear encoder-decoder mappings retain the flexibility needed to represent complex dynamics in physical space. A key feature of Neural CGM is its treatment of uncertainty in DA. The latent posterior mean and covariance are mapped to the physical variables through a Gaussian decoder that combines local moment propagation with learned nonlinear corrections. The resulting physical-space posterior statistics depend on the sequentially updated latent distribution rather than on a separate post-processing estimate. The same statistics enter a Gaussian negative log-likelihood during training, so both the posterior mean and uncertainty affect the learned model. Because Neural CGM learns the dynamical model itself, it can also be used for state forecasting and simulation without explicit knowledge of the governing equations. Numerical experiments on benchmark nonlinear dynamical systems show accurate state estimation and forecasting while substantially reducing online assimilation cost relative to conventional nonlinear DA methods. Neural CGM is therefore suited to repeated state estimation, uncertainty quantification, and prediction from partial observations.
Figures & tables
| System | Hyperparameters in Neural CGM | |||
|---|---|---|---|---|
| Lorenz 63 System | 12 | 1 | 200 | 0 |
| Lorenz 96 System | 80 | 1 | 100 | 20 |
| Kuramoto–Sivashinsky Equation | 15 | 1 | 200 | 20 |
Data Assimilation
Data assimilation combines observations with dynamical models to estimate hidden system states and their uncertainty over time.
See all 67 papers