Data Assimilation

Ask about this topic

Overview

Data assimilation estimates the evolving state of a system by combining imperfect observations with forecasts from a physical or learned model. Kalman and ensemble filters, particle filters, and variational methods are established approaches; newer work also uses latent-space models, neural operators, and generative methods such as diffusion and flow matching. These methods support applications including weather prediction, fluid reconstruction, ocean modeling, and subsurface characterization, often when observations are sparse or irregular. A central challenge is balancing computational cost and scalability with accurate uncertainty estimates and physically plausible results, especially for nonlinear systems and non-Gaussian posteriors.

Latest papers

CardsList

58 papers9 papers in the last four weeks, up 29% on the four weeks before. 0.1% of all new papers.

  1. SURGE: Approximation and Training Free Particle Filter for Diffusion Surrogate

    May 18, 2026Lifu Wei, Yinuo Ren, Naichen Shi +1Particle FilteringBayesian Filtering

    Department of Mechanical Engineering, Northwestern University, Evanston, IL, United States · Institute for Computational & Mathematical Engineering, Stanford University, Stanford, CA, United States · Department of Industrial Engineering & Management Sciences, Northwestern University, Evanston, IL, United States

  2. ForcingDAS: Unified and Robust Data Assimilation via Diffusion Forcing

    May 14, 2026Yixuan Jia, Siyi Chen, Yida Pan +9Data Assimilation

    University of Michigan, Ann Arbor · Michigan State University · Los Alamos National Laboratory

  3. WindINR: Latent-State INR for Fast Local Wind Query and Correction in Complex Terrain

    May 10, 2026Yi Xiao, Qilong Jia, Hang Fan +4Implicit Neural RepresentationsInference-Time Optimization

    Tsinghua University · MBZUAI · Columbia University +2

  4. Online Generalised Predictive Coding

    May 4, 2026Mehran H. Z. Bazargani, Szymon Urbas, Adeel Razi +2Parameter EstimationLatent Dynamics Modeling

    Insight Research Ireland Centre, UCD, Dublin, Ireland. · UCD School of Mathematics and Statistics, UCD, Belfield, Dublin, Ireland. · Turner Institute for Brain and Mental Health, School of Psychological Sciences, Monash University, Melbourne, Victoria, Australia. +5

  5. Learning Discriminators for Resampling in the Ensemble Gaussian Mixture Filter through a Normalizing Flow Approach

    May 1, 2026Zain Jabbar, Andrey A. PopovParticle FilteringBayesian Filtering

  6. Global Attention with Linear Complexity for Exascale Generative Data Assimilation in Earth System Prediction

    Apr 17, 2026Xiao Wang, Zezhong Zhang, Isaac Lyngaas +10Climate ScienceHigh-Performance Computing

    Oak Ridge National Laboratory, Oak Ridge, TN, USA · Auburn University, Auburn, AL, USA · Florida State University, Tallahassee, FL, USA +2

  7. Amortized Filtering and Smoothing with Conditional Normalizing Flows

    Apr 8, 2026Tiangang Cui, Xiaodong Feng, Chenlong Pei +2Bayesian FilteringData Assimilation

    School of Mathematics and Statistics, The University of Sydney, Camperdown, NSW 2006, Australia · Institute of Advanced Study, Beijing Normal-Hong Kong Baptist University, Zhuhai 519087, China · SKLMS & Institute of Computational Mathematics and Scientific/Engineering Computing, Academy of Mathematics and Systems Science, Chinese Academy of Sciences +1

  8. Rethinking Forward Processes for Score-Based Nonlinear Data Assimilation in High Dimensions

    Apr 3, 2026Eunbi Yoon, Won Chang, Donghan Kim +1Data AssimilationBayesian Filtering

    KAIST · Seoul National University

  9. Closed-form conditional diffusion models for data assimilation

    Mar 22, 2026Brianna Binder, Agnimitra Dasgupta, Assad OberaiData AssimilationConditional Diffusion Models

    Department of Aerospace & Mechanical Engineering, University of Southern California, 3650 McClintock Ave, Los Angeles, 90089, California, USA. · Optimization & Uncertainty Quantification, Sandia National Laboratories, 1450 Innovation Pkwy SE, Albuquerque, 87123, New Mexico, USA.

  10. Auto-differentiable data assimilation: Co-learning of states, dynamics, and filtering algorithms

    Mar 21, 2026Melissa Adrian, Daniel Sanz-Alonso, Rebecca WillettData AssimilationState Space Models

    School of Mechanical Engineering, Purdue University, West Lafayette, IN 47907 · Department of Statistics, The University of Chicago, Chicago, IL 60637 · Department of Computer Science, The University of Chicago, Chicago, IL 60637 +1

  11. Operator Learning for Smoothing and Forecasting

    Mar 20, 2026Edoardo Calvello, Elizabeth Carlson, Nikola Kovachki +2Data AssimilationOperator Learning

    California Institute of Technology, Pasadena, CA · Oregon State University, Corvallis, OR · NVIDIA Corporation, Santa Clara, CA +1

  12. Sparsely-Supervised Data Assimilation via Physics-Informed Schrödinger Bridge

    Mar 20, 2026Dohyun Bu, Chanho Kim, Seokun Choi +1Data AssimilationPhysics-Informed Generative Modeling

    Department of Industrial & Systems Engineering, KAIST, Daejeon, Repulic of Korea · Department of Mathematical Sciences, KAIST, Daejeon, Repulic of Korea

  13. Enhancing the Parameterization of Reservoir Properties for Data Assimilation Using Deep VAE-GAN

    Mar 19, 2026M. A. Sampaio, P. H. Ranazzi, M. J. BluntData AssimilationParameter Estimation

    Departamento de Engenharia de Minas e de Petróleo, Escola Politécnica, Universidade de São Paulo, 05508-030, SP, Brasil. · Department of Earth Science and Engineering, Imperial College London, South Kensington, London, UK

  14. Implementation of tangent linear and adjoint models for neural networks based on a compiler library tool

    Mar 17, 2026Sa Xiao, Hao Jing, Honglu Sun +1Weather ForecastingData Assimilation

    State Key Laboratory of Severe Weather Meteorological Science and Technology (LaSW), Beijing, China · CMA Earth System Modeling and Prediction Centre (CEMC), Beijing, China

  15. FuXiWeather2: Learning accurate atmospheric state estimation for operational global weather forecasting

    Mar 16, 2026Xiaoze Xu, Xiuyu Sun, Songling Zhu +5Weather ForecastingData Assimilation

    Shanghai Academy of Artificial Intelligence for Science, Shanghai, & 200232, China. · Artificial Intelligence Innovation and Incubation Institute, Fudan University, Shanghai & 200433, China. · FuXi Intelligent Computing Technology Co., Ltd., Shanghai & 200233, China.

  16. A Score Filter Enhanced Data Assimilation Framework for Data-Driven Dynamical Systems

    Mar 16, 2026Jingqiao Tang, Ryan Bausback, Feng Bao +2Data AssimilationScientific ML

  17. Adaptive Diffusion Posterior Sampling for Data and Model Fusion of Complex Nonlinear Dynamical Systems

    Mar 13, 2026Dibyajyoti Chakraborty, Hojin Kim, Romit MaulikPDE Surrogate ModelingChaotic Time-Series Prediction

    College of Information Sciences and Technology, Pennsylvania State University, University Park, 16802, PA, USA · School of Mechanical Engineering, Purdue University, West Lafayette, 47907, IN, USA

  18. Latent Autoencoder Ensemble Kalman Filter for Nonlinear Data assimilation

    Mar 6, 2026Xin T. Tong, Yanyan Wang, Liang YanData AssimilationEnsemble Kalman Filtering

    Department of Mathematics, National University of Singapore, 119076, Singapore · School of Mathematics, Southeast University, Nanjing 210096, China

  19. Accurate and Efficient Hybrid-Ensemble Atmospheric Data Assimilation in Latent Space with Uncertainty Quantification

    Mar 4, 2026Hang Fan, Juan Nathaniel, Yi Xiao +5Data AssimilationUncertainty Quantification

    Department of Earth and Environmental Engineering, School of Engineering and Applied Sciences, Climate School, Columbia University, New York, NY, USA · Learning the Earth with Artificial Intelligence and Physics (LEAP) Center, Columbia University, New York, NY, USA · Shanghai Artificial Intelligence Laboratory, Shanghai, China +2

  20. BLISSNet: Deep Operator Learning for Fast and Accurate Flow Reconstruction from Sparse Sensor Measurements

    Feb 27, 2026Maksym Veremchuk, K. Andrea Scott, Zhao PanOperator LearningComputational Fluid Dynamics

    Department of Mechanical and Mechatronics Engineering, University of Waterloo

  21. Neural ensemble Kalman filter: Data assimilation for compressible flows with shocks

    Feb 26, 2026Xu-Hui Zhou, Lorenzo Beronilla, Michael K. Sleeman +4Data AssimilationEnsemble Kalman Filtering

    Scripps Institution of Oceanography, University of California San Diego, La Jolla, 92093, CA, USA · Computing + Mathematical Sciences, California Institute of Technology, Pasadena, 91125, CA, USA · Department of Mechanical Engineering, Johns Hopkins University, Baltimore, 21218, MD, USA

  22. D-Flow SGLD: Source-Space Posterior Sampling for Scientific Inverse Problems with Flow Matching

    Feb 25, 2026Meet Hemant Parikh, Yaqin Chen, Jian-Xun WangPosterior SamplingBayesian Inverse Problems

    Sibley School of Mechanical and Aerospace Engineering, Cornell University, Ithaca, NY, USA · Department of Aerospace and Mechanical Engineering, University of Notre Dame, Notre Dame, IN, USA

  23. LEVDA: Latent Ensemble Variational Data Assimilation via Differentiable Dynamics

    Feb 23, 2026Phillip Si, Peng ChenData AssimilationLatent Space Optimization

    School of Computational Sciences and Engineering, Georgia Institute of Technology

  24. Machine learning enhanced data assimilation framework for multiscale carbonate rock characterization

    Jan 27, 2026Zhenkai Bo, Ahmed H. Elsheikh, Hannah P. Menke +5Data Assimilation

    Institute of GeoEnergy Engineering, Heriot-Watt University, Edinburgh, EH14 4AS, United Kingdom · Department of Geoscience & Engineering, Technical University of Delft, Delft, The Netherlands · PETRONAS Research Sdn Bhd, Bangi, Selangor, Malaysia

  25. GenDA: Generative Data Assimilation on Complex Urban Areas via Classifier-Free Diffusion Guidance

    Jan 16, 2026Francisco Giral, Álvaro Manzano, Ignacio Gómez +2Diffusion Model GuidanceData Assimilation

    Applied Mathematics Department, ETSIAE-School of Aeronautics, Universidad Politécnica de Madrid, Spain · Department of Aerospace Engineering, University of Michigan, Ann Arbor, MI 48109, USA.

  26. Huracan: A skillful end-to-end data-driven system for ensemble data assimilation and weather prediction

    Aug 25, 2025Zekun Ni, Jonathan Weyn, Hang Zhang +7Ensemble LearningData Assimilation

    Microsoft Corporation. · Department of Earth System Science, Ministry of Education Key Laboratory for Earth System Modeling, Institute for Global Change Studies, Tsinghua University, Beijing, China.

  27. Flow Matching for Efficient and Scalable Data Assimilation

    Aug 18, 2025Taos Transue, Bohan Chen, So Takao +1Flow MatchingKalman Filtering

    Department of Mathematics and Scientific Computing and Imaging Institute, University of Utah, Salt Lake City, UT, 84112 · The Computing and Mathematical Sciences Department, California Institute of Technology, 1200 E California Blvd, Pasadena, CA 91125

  28. Guided Unconditional and Conditional Generative Models for Super-Resolution and Inference of Quasi-Geostrophic Turbulence

    Jul 1, 2025Anantha Narayanan Suresh Babu, Akhil Sadam, Pierre F. J. LermusiauxDiffusion Model GuidanceData Assimilation

    Department of Mechanical Engineering, Massachusetts Institute of Technology, Cambridge, USA · Center for Computational Science and Engineering, Massachusetts Institute of Technology, Cambridge, USA