Sonny: Breaking the Compute Wall in Medium-Range Weather Forecasting
Organizations: Department of Computer Science and Engineering, Sejong University, Seoul, South Korea
Abstract
Weather forecasting is a fundamental problem for protecting lives and infrastructure from high-impact atmospheric events. Recently, data-driven weather forecasting methods based on deep learning have demonstrated strong performance, often reaching accuracy levels competitive with operational numerical systems. However, many existing models rely on large-scale training regimes and compute-intensive architectures, which raises the practical barrier for academic groups with limited compute resources. Here we introduce Sonny, an efficient hierarchical transformer that achieves competitive medium-range forecasting performance while remaining feasible within reasonable compute budgets. At the core of Sonny is a two-stage StepsNet design: a narrow slow path first models large-scale atmospheric dynamics, and a subsequent full-width fast path integrates thermodynamic interactions. To stabilize medium-range rollout without an additional fine-tuning stage, we apply exponential moving average (EMA) during training. On WeatherBench2, Sonny yields robust medium-range forecast skill, remains competitive with operational baselines, and demonstrates clear advantages over FastNet, particularly at extended tropical lead times. In practice, Sonny can be trained to convergence on a single NVIDIA A40 GPU in approximately 5.5 days.
Figures & tables
| Variable name | Short name | Vertical levels (hPa) | Units |
| Zonal wind | U | 1000, 925, 850, 700, 600, 500, 400, 300, 250, 200, 150, 100, 50 | m/s |
| Meridional wind | V | 1000, 925, 850, 700, 600, 500, 400, 300, 250, 200, 150, 100, 50 | m/s |
| Temperature | T | 1000, 925, 850, 700, 600, 500, 400, 300, 250, 200, 150, 100, 50 | K |
| Specific humidity | Q | 1000, 925, 850, 700, 600, 500, 400, 300, 250, 200, 150, 100, 50 | kg/kg |
| Geopotential | Z | 1000, 925, 850, 700, 600, 500, 400, 300, 250, 200, 150, 100, 50 | m 2 /s 2 |
| 2m temperature | T2m | - | K |
| Item | Value |
| Backbone setting | ViT-S configuration |
| Number of parameters | 20.5M |
| Optimizer | |
| Class | AdamW |
| Learning rate | 5e-4 |
| 0.9 | |
| Model | Params (M) | MACs (G) | Training Hardware | Training Time | Latency (ms) |
| 721 1440 (0.25 ∘ ) | |||||
| Fengwu | 153.49 | 132.83 | 32 A100 | 17 days | 227.0 |
| FourCastNet | 79.60 | 111.62 | 64 A100 | 16 hours | 164.0 |
| GraphCast | 36.7 | 1639.26 | 32 TPUv4 | 4 weeks | - |
| Pangu-Weather | 256 | 142.39 | 192 V100 | 64 days | 275.0 |
| 128 256 ( 1.4 ∘ ) | |||||
Weather Forecasting
Weather forecasting predicts future atmospheric conditions, from local storms to global patterns, using physical models, observations, and machine learning.
See all 176 papers