cs.LGApr 15, 2026
SaveMonthly Diffusion v0.9: A Latent Diffusion Model for the First AI-MIP
Organizations: Department of Atmospheric & Oceanic Sciences, University of Maryland, College Park, MD 20740
Abstract
Here, we describe Monthly Diffusion at 1.5-degree grid spacing (MD-1.5 version 0.9), a climate emulator that leverages a spherical Fourier neural operator (SFNO)-inspired Conditional Variational Auto-Encoder (CVAE) architecture to model the evolution of low-frequency internal atmospheric variability using latent diffusion. MDv0.9 was designed to forward-step at monthly mean timesteps in a data-sparse regime, using modest computational requirements. This work describes the motivation behind the architecture design, the MDv0.9 training procedure, and initial results.
Figures & tables
| Short Name | Name | Level(s) |
|---|---|---|
| SKT | skin temperature | surface/single-level |
| MTPR | mean total precipitation rate | surface/single-level |
| 2D | 2 meter dewpoint temperature | surface/single-level |
| 2T | 2 meter temperature | surface/single-level |
| SP | surface pressure | surface/single-level |
| 10U | 10 meter U wind component | surface/single-level |
Table 1: Variables used for MDv0.9.
| Quantity | Description |
|---|---|
| prognostic atmospheric state, | |
| external forcing fields (SST, SIC, LSM), | |
| static invariant fields (ANOR, ISOR, SLOR, SDOR), | |
| corresponding to months of the year. | |
| Contractions of sample-wise seasonal coefficients with learned seasonal basis, | |
| time-varying conditioning tensor, |
Table 2: State (initial and prognostic) , conditioning , and latent representation.
Figure 1: Schematic of MDv0.9. Data are denoted by circles, neural networks are denoted by polygons, and subordinate operations are denoted by round-cornered rectangles. Arrows entering laterally indicate data streams used as direct inputs to the indicated operation, and arrows entering from below indicate data streams used as conditioning tensors.
Figure 2: Schematic of spatial conditioning RMS normalization layer.
Figure 3: Schematic of seasonality embedding.
Figure 4: Schematic of an S2-convolution layer. A spectral operator is applied to the internal feature tensor after a spherical harmonic transform, after which the result is inverted onto a new spatial grid.
Figure 5: Schematic of a tensor-product spectral operator. The shapes of the input tensor and operator parameters are denoted below the corresponding objects, and the dimensionality of the intermediate results is displayed above each operation. Here is the minibatch dimension, corresponds to the input channels, and to the input zonal and meridional wave modes respectively, to the operator rank, and to the output channels. corresponds to matrix multiplication (inner product) and to the tensor product (outer product).
Figure 6: Schematic of the encoder. In Fig. 1 , the resampling block in the conditioning pathway is placed outside of the encoder for visual clarity. The residual pathways are omitted from the S2-convolution layers located inside the SpatialConditionalRMSNorm blocks. The decoder uses this same architecture, but with inverted dimensions where appropriate. The predictor uses the same architecture, but with no static fields, and an additional input for DDPM-style noise input.
| Component | Description |
|---|---|
| Encoder | maps to posterior parameters where |
| Decoder | maps latent state and conditioning back to physical space, modeling |
| Seasonal Embedding | MLP taking inputs , and producing coefficients for a learned latent seasonal basis tensor with shapes: input hidden output |
| Learned Seasonal Basis | tensor of shape . Seasonal embedding derived by the tensor product , contracting the basis dimension. |
| Shared spectral operator family | low-rank tensor-product spectral operator with channel mixing , and spectral factors |
| Encoder spectral rank | 64 |
Table 3: Architecture summary for MDv0.9 at resolution: encoder, decoder, and spectral building blocks.
| Component | Description |
|---|---|
| Predictor | conditional latent diffusion model for the next-month latent target |
| Training target | next-month posterior mean , conditioned on stochastic |
| Diffusion steps | |
| Noise schedule | cosine -schedule with offset |
| Time encoding | sinusoidal diffusion-time embedding followed by MLP |
| Time-embedding width | 32-dimensional sinusoidal embedding projected to 5 spatial channels |
Table 4: Architecture summary for MDv0.9 at resolution: latent diffusion predictor and conditioning pathway.
Algorithm 1 Conditional latent DDPM with -prediction. Physical time indexes the monthly evolution, while diffusion time indexes the internal denoising chain used to sample the conditional transition.
Figure 7: Cosine-latitude-weighted annual-mean skin temperature from each of the four sea-surface temperature forced ensemble experiments.
Figure 8: Annual-mean climatology of the MDv0.9 historical ensemble mean, differences between ERA5 and MDv0.9 historical ensemble mean, and differences between MDv0.9 historical +2K and MDv0.9 historical ensemble means.
Figure 9: ERA5 vs MDv0.9-historical regression on forced Niño-3.4
Figure 10: Regression onto the leading EOF of Z500 over 0–90°N for ERA5 and the climatology-forced MDv0.9 run.
Internal variability is a dominant contributor to the uncertainty of predictions at the interannual to decadal timescale. A typical approach to separating the internal variability from forced climate responses is to generate large ensembles of simulations under different initial conditions. Due to the complexity of Earth System Models, generating these large ensembles is computationally expensive. In this work, we present ArchesClimate, a deep learning-based climate model emulator designed to reduce the cost of exploring internal variability at timescales ranging from monthly to decadal. ArchesClimate is trained on decadal hindcasts of the IPSL-CM6A-LR climate model. We train a flow matching model following ArchesWeatherGen, which we adapt to predict near-term climate. Once trained, the model generates states at a one-month lead time from the states of the two preceding months, and can be used to auto-regressively emulate climate model simulations. We show that for up to 10 years, these generations are stable and physically consistent. We also show that for several important climate variables, ArchesClimate generates simulations that are interchangeable with the IPSL model. This work suggests that climate model emulators could reduce the cost of generating large ensembles with climate models.
High-Resolution Climate Projections Using Diffusion-Based Downscaling of a Lightweight Climate Emulator
The proliferation of data-driven models in weather and climate sciences has marked a significant paradigm shift, with advanced models demonstrating exceptional skill in medium-range forecasting. However, these models are often limited by long-term instabilities, climatological drift, and substantial computational costs during training and inference, restricting their broader application for climate studies. Addressing these limitations, Guan et al. (2024) introduced LUCIE, a lightweight, physically consistent climate emulator utilizing a Spherical Fourier Neural Operator (SFNO) architecture. This model is able to reproduce accurate long-term statistics including climatological mean and seasonal variability. However, LUCIE's native resolution (~300 km) is inadequate for detailed regional impact assessments. To overcome this limitation, we introduce a deep learning-based downscaling framework, leveraging probabilistic diffusion-based generative models with conditional and posterior sampling frameworks. These models downscale coarse LUCIE outputs to 25 km resolution. They are trained on approximately 14,000 ERA5 timesteps spanning 2000-2009 and evaluated on LUCIE predictions from 2010 to 2020. Model performance is assessed through diverse metrics, including latitude-averaged RMSE, power spectrum, probability density functions and First Empirical Orthogonal Function of the zonal wind. We observe that the proposed approach is able to preserve the coarse-grained dynamics from LUCIE while generating fine-scaled climatological statistics at ~28km resolution.
Climate Physics Dynamic Matching
Deep generative models such as flow matching and diffusion models have shown potential for learning complex dynamical systems, but typically act as black boxes that neglect underlying physical structure, while physics-based models governed by partial differential equations are often incomplete due to missing source terms, or uncertain parametrisations. We present Climate Physics Dynamic Matching (ClimPhyDM), a variational simulation-free dynamics informed framework for weather forecasting that combines an advection-type physics prior with data-driven components in a variational framework. % to capture the stochasticity and multi-modality of unresolved atmospheric dynamics. On the ERA5 benchmark at hourly (42-hour) and monthly (5-month) resolutions, ClimPhyDM outperforms ClimODE, and GB-DM, keeping the lower error at extended horizon, indicating improved temporal stability and resistance to error accumulation, while its simulation-free paradigm also enables training on a single modest 12 GB consumer GPU.