physics.ao-phAug 9, 2026

Do AI Forecast Ensembles Sample the Correct Conditional Distribution?

Authors: Lucas J. HowardElizabeth A. Barnes

Organizations: Boston University, Faculty of Computing and Data Sciences

Abstract

Ensemble forecasting aims to sample the conditional distribution of outcomes; whether AI forecast ensembles do this correctly in a joint sense remains largely untested. We train a diffusion model for probabilistic subseasonal coastal sea level forecasts at eight US East Coast tide gauge stations, with sea level derived from reanalysis, and find that marginal and joint forecast quality decouple: positive skill at every station and lead time marginally, while joint spatial structure is worse than climatological draws. A shuffle-based permutation decomposition reveals this failure is invisible to the energy score but detected by the variogram score. Lorenz-96 experiments across 0.7-170 equivalent years show the gap persists regardless of training volume and is reproduced by a linear baseline, indicating structural inadequacy of the learned distribution. A dynamical ensemble does not replicate the failure while a deterministic emulator does, suggesting it is specific to learned emulators rather than ensemble forecasting generally.

Explore similar work

CardsList
  1. Diversity is the Strength of the AI Crowd

    Jun 29, 2026Matthew Aitchison, Scott Jeen, Toby Shevlane +1Load ForecastingDiversity

  2. Sampling sea state using a diffusion model

    Jun 24, 2026Jiarong Wu, Bertrand Chapron, Laure ZannaOceanUrban Wind