Generate the Forest before the Trees - A Hierarchical Diffusion model for Climate Downscaling
Organizations: School of Computer Science and Engineering, University of New South Wales, Sydney, New South Wales, Australia · ARC Centre of Excellence for the Weather of the 21st Century and Climate Change Research Centre, University of New South Wales, Sydney, New South Wales, Australia
Abstract
Downscaling is essential for generating the high-resolution climate data needed for local planning, but traditional methods remain computationally demanding. Recent years have seen impressive results from AI downscaling models, particularly diffusion models, which have attracted attention due to their ability to generate ensembles and overcome the smoothing problem common in other AI methods. However, these models typically remain computationally intensive. We introduce a Hierarchical Diffusion Downscaling (HDD) model, which introduces an easily-extensible hierarchical sampling process to the diffusion framework. A coarse-to-fine hierarchy is imposed via a simple downsampling scheme. HDD achieves competitive accuracy on ERA5 reanalysis datasets and CMIP6 models, significantly reducing computational load by running on up to half as many pixels with competitive results. Additionally, a single model trained at 0.25° resolution transfers seamlessly across multiple CMIP6 models with much coarser resolution. HDD thus offers a lightweight alternative for probabilistic climate downscaling, facilitating affordable large-ensemble high-resolution climate projections. See a full code implementation at: https://github.com/HDD-Hierarchical-Diffusion-Downscaling/HDD-Hierarchical-Diffusion-Downscaling.
Figures & tables
| Model | RMSE | PSNR | CRPS |
|---|---|---|---|
| Bilinear Interpolation | 0.362755 | 9.54 | – |
| Earth-ViT (Finetuned PanguWeather ( Curran et al., 2024a ) ) | 0.317410 | 10.63 | – |
| Base EDM - 500 steps | 0.000143 | 31.45 | 0.0002319 |
| HDD (Ours) | 0.000128 | 33.34 | 0.0002308 |
| Model | RMSE | PSNR |
|---|---|---|
| Equally Spaced Steps | 0.000131 | 33.262 |
| Move in tandem – 1 denoise step per shape step | 0.000129 | 33.40 |
| 2 denoise steps per shape step | 0.000129 | 33.36 |
| 3 denoise steps per shape step (Ours) | 0.000128 | 33.34 |
| 50 denoise steps per shape step | 0.000131 | 33.21 |
| 500 denoise steps per shape step | 0.000133 | 33.11 |
| Model | NRMSE | MAD | SCorr | MAPE | kgCO 2 Emitted |
|---|---|---|---|---|---|
| CCAM-1704 | 0.78 | 0.97 | 0.87 | 0.38 | 1032kg |
| Earth-ViT | 0.33 | 1.30 | 0.82 | 0.44 | 51kg Training + 2kg inference |
| Base EDM | 0.54 | 1.30 | 0.81 | 0.55 | 105kg Training + 5kg inference |
| HDD | 0.45 | 1.09 | 0.85 | 1.18 | 50kg Training + 2kg 8 8 8 Values for HDD calculated based on theoretical speedup values in section 4 with 30% overhead for data loading etc. – see appendix D for more information inference |
| GCM | Resolution | Model | NRMSE | MAD | MAPE | SpCor |
|---|---|---|---|---|---|---|
| MIROC5 | CCAM-2008 | 0.62 | 0.85 | 0.49 | 0.88 | |
| CCAM-1704 | 0.78 | 0.97 | 0.38 | 0.87 | ||
| Earth-ViT | 0.33 | 1.30 | 0.44 | 0.82 | ||
| EDM | 0.54 | 1.30 | 0.55 | 0.81 | ||
| HDD | 0.45 | 1.09 | 1.18 | 0.85 | ||
| CNRM-CM5 | CCAM-1704 | 0.68 | 0.87 | 0.54 | 0.82 |
| GCM (input resolution) | NRMSE (%) | MAD (%) | MAPE (%) | SpCor (%) |
|---|---|---|---|---|
| MIROC5 ( ) | ||||
| CNRM-CM5 ( ) | ||||
| HadGEM3 ( ) | ||||
| GFDL-ESM2M ( ) |
Appendix figures & tables6 assets
Supplementary material from the paper’s appendix.
Appendix
| Driving GCM | Model / RCM | NRMSE | MAD | SCorr | MAPE | kgCO 2 Train 11 11 11 Emissions for hard-disk diffusion (HDD) runs are estimated using the theoretical speed-up in Section 4 of the manuscript with a 30 % overhead for data handling; see Appendix D for details. |
|---|---|---|---|---|---|---|
| MIROC5 | HDD | 0.45 | 1.0865 | 0.85 | 1.1752 | 53 kg |
| CNRM-CM5 | HDD | 0.62 | 1.3897 | 0.79 | 0.5185 | 53 kg |
| MIROC5 | Base EDM | 0.54 | 1.2961 | 0.81 | 0.5505 | 105 kg |
| CNRM-CM5 | Base EDM | 0.56 | 1.2654 | 0.78 | 0.2481 | 105 kg |
| CNRM-CM5 | Earth-ViT | 0.50 | 1.1044 | 0.80 | 0.3498 | 51 kg |
| CNRM-CM5 | CCAM-1704 | 0.68 | 0.8698 | 0.89 | 0.2600 | 1032 kg (total) |
| Fundamental rainfall characteristic | Quantifying metric | Benchmark threshold |
|---|---|---|
| How much does it rain? | Mean absolute percentage error (MAPE) | MAPE |
| Where does it rain? | Spatial correlation (SCor) | SCor |
| When does it rain? | Amplitude : normalised root mean squared error (NRMSE) Phase : mean absolute deviation (MAD; months) of the maximum-rainfall month | Amplitude : NRMSE Phase : MAD |
| Model | RMSE | PSNR | CRPS |
|---|---|---|---|
| Base EDM – 50 Steps | 0.000197 | 29.17 | 0.0002415 |
| HDD – 50 steps – 3 denoise steps per shape step | 0.000157 | 31.40 | 0.0002402 |
| Hyperparameter | Value |
|---|---|
| Inference sampling | |
| Number of steps | 50 14 14 14 Note that steps varied across ablations per experiments section. However 50 was used as a good baseline to maintain high quality results and efficient sampling |
| Noise schedule | |
| 0.002 | |
| 80 | |
| 7 | |
| Model | RMSE | PSNR | CRPS |
|---|---|---|---|
| Base EDM (50 steps) | 0.000197 | 29.17 | 0.000324 |
| HDD (Ours - 50 steps) | 0.000059 | 30.61 | 0.000157 |
| Level Index | Shape Steps per Split | RMSE |
|---|---|---|
| 2 | 10 | 0.583962 |
| 2 | 25 | 0.590721 |
| 2 | 50 | 0.628742 |
| 7 | 10 | 0.583874 |
| 7 | 25 | 0.591166 |
| 7 | 50 | 0.629259 |
Climate Downscaling
Climate downscaling translates coarse climate simulations and observations into finer regional detail for local impact and risk assessment.
See all 29 papers