cs.LGNov 13, 2026

WeatherDreamer: Learning a World Model from Multimodal Earth Observations

Authors: Kate Duffy, Elise Penn, Tristan Ballard, August Posch, Thomas J. Vandal

Organizations: Zeus AI, Inc., Cambridge, Massachusetts

Abstract

Machine learning weather models now rival operational global forecasts but still start from analyses produced by separate, expensive data assimilation (DA) systems, which for global models are typically updated every six hours. Observation-to-observation models avoid this dependence, but most omit the recursive filtering cycle that lets DA systems carry a background state through sparse, irregular observations. We introduce WeatherDreamer, a world model that learns this cycle end-to-end from 18 global observing systems, without reanalysis. It infers a latent state from observations, carries it forward hour by hour with learned dynamics, corrects it each hour with new observations, and can predict what any of its observing systems would measure at any location. At held-out stations, its ensembles beat NOAA's Global Ensemble Forecast System (GEFS) for temperature, dew point and wind out to 12 h and are better calibrated than GEFS and the ECMWF ensemble. Precipitation, cloud-top height and solar irradiance, never inputs at inference, are inferred with skill matching or exceeding operational products at short leads. Against the first guess of NOAA's Gridpoint Statistical Interpolation (GSI) DA system, WeatherDreamer's short-range departures are within 10% of GSI's at surface stations and within 25% for moisture-sensitive microwave channels, but up to five times larger for temperature-sounding channels. Never given observation errors, its learned update assumes errors close to known instrument and retrieval errors of microwave sounders and scatterometer winds. WeatherDreamer also separates viewing geometry from atmospheric state, recovering 83-96% of observed limb darkening and producing seamless nadir-view imagery. Producing an hourly global analysis in about 1.5 minutes on one GPU, WeatherDreamer shows that assimilation and forecasting can be learned together directly from observations.

Figures & tables

Appendix figures & tables16 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. FuXiWeather2: Learning accurate atmospheric state estimation for operational global weather forecasting

    Mar 16, 2026Xiaoze Xu, Xiuyu Sun, Songling Zhu +5Weather ForecastingData Assimilation

  2. Earth-o1: A Grid-free Observation-native Atmospheric World Model

    May 7, 2026Junchao Gong, Kaiyi Xu, Wangxu Wei +22World Model LearningWeather Forecasting

  3. WeatherNext 3: Increasing resolution and performance of global weather models with raw observations

    Sep 3, 2026Stephan Rasp, Boris Babenko, Dominic Masters +22Probabilistic ForecastingWeather Forecasting