Auditing Learned Dynamics in Weather Models
Organizations: Mila McGill University · Haziel
Abstract
Learned weather models are experimentally accessible computational systems whose internal representations can be inspected and manipulated. Using sparse autoencoder features from GraphCast, DeepMind's autoregressive weather forecasting model, we test whether causal relevance requires physical semantics, a question that matters for auditing whether AI forecasters used in high-assurance settings rely on reliable mechanisms. We also look at whether physically associated latent directions can be steered to improve extreme-event forecasts, where interventions are applied to the model's internal activations during the rollout. We find that ablating a feature locked to GraphCast's computational mesh increases global geopotential height error despite lacking conventional physical semantics. Second, suppressing convection- and low-level-vorticity-associated features weakens predicted tropical-cyclone deepening (the fall in central pressure during intensification), while amplifying them reduces intensity error, with amplification of convection features through feature scaling achieving a median of 51% error reduction over seven storms. Together, these results separate interpretable, physical association from causal utility and establish sparse features as experimental coordinates for auditing and intervening on learned weather dynamics.
Figures & tables
Appendix figures & tables5 assets
Supplementary material from the paper’s appendix.
Appendix
| Ida | Michael | Haishen | Goni | Haiyan | Patricia | Wilma | |
| Convection, feature 2401 | |||||||
| 1 | 8.87 | 6.40 | 4.87 | 4.71 | 1.81 | 6.56 | 11.37 |
| 1.25 | 8.21 ( ) | 6.05 ( ) | 3.08 ( ) | 4.45 ( ) | 1.23 ( ) | 6.54 ( ) | 11.14 ( ) |
| 1.5 | 7.43 ( ) | 5.72 ( ) | 2.37 ( ) | 4.30 ( ) | 1.67 ( ) | 6.53 ( ) | 10.71 ( ) |
| 2 | 5.25 ( ) | 4.67 ( ) | 7.02 ( ) | 3.73 ( ) | 4.51 ( ) | 6.50 ( ) | 10.24 ( ) |
| 2.5 | 2.59 ( ) | 3.36 ( ) | 12.88 ( ) | 2.90 ( ) | 7.54 ( ) | 6.44 ( ) | 9.69 ( ) |
| Storm | Unmodified (hPa) | (hPa) | Change (hPa) | Change (%) |
|---|---|---|---|---|
| Marcus 2018 | 9.13 | 2.76 | ||
| Veronica 2019 | 4.80 | 2.96 | ||
| Fantala 2016 | 5.95 | 4.16 | ||
| Harold 2020 | 7.41 | 7.06 | ||
| Winston 2016 | 8.79 | 9.60 |
| Ida | Michael | Haishen | Goni | Haiyan | Patricia | Wilma | Median | |
|---|---|---|---|---|---|---|---|---|
| Convection | 7.43 | 5.72 | 12.88 | 3.73 | 7.54 | 6.50 | 9.69 | 7.43 |
| Vorticity | 2.54 | 2.50 | 3.90 | 2.40 | 1.47 | 3.81 | 6.74 | 2.54 |
| Bias-corrected | 3.96 | 1.78 | 2.70 | 1.05 | 1.98 | 2.28 | 7.25 | 2.28 |
Causal Interpretability
Causal interpretability uses interventions and counterfactuals to identify which model inputs and internal mechanisms actually drive predictions.
See all 121 papers