With the rise of univariate time series foundation models (e.g., Sundial, Timer), initial efforts have been made to extend them to multivariate settings. However, these models mainly focus on modeling correlations among variables. When they are applied to multi-station weather forecasting, two important factors are often overlooked: (1) the spatial information of stations, and (2) different error priors of different stations relative to the foundation model. In this paper, we propose WxFM-XL, a model for adapting univariate time series foundation models to multi-station weather forecasting. WxFM-XL introduces a cross-station error correlation prior graph to capture stationwise error priors with respect to the foundation model. Building on this, we further propose a dynamic fusion mechanism that adaptively integrates a spatial correlation graph with the error correlation prior graph. Experiments on multiple datasets demonstrate that our model outperforms state of the art baselines.
Figures & tables
Figure 1: Visualization of error correlation dependencies for the v-component of wind speed in the French region. (a) Sundial’s forecast error correlations relative to an anchor station (star). (b) Topologies of spatial and band-specific error correlation graphs (showing top 600 edges with unique connections highlighted).
Figure 2: Overview of the WxFM-XL framework.
Models
WxFM-XL (Timer)
WxFM-XL (Sundial)
Timer
Sundial
AdaPTS (Timer)
AdaPTS (Sundial)
Moirai ft
Moirai
Timer-XL ft
Timer-XL
STELLA
CDPNet
MSGNet
Corrformer
Hunan
temp
24
5.14 ±0.01
5.06 ±0.09
5.28
5.78
5.33 ±0.05
5.57 ±0.11
5.65 ±0.27
5.24
5.43 ±0.15
5.26
8.56 ±0.84
7.44 ±0.79
5.89 ±0.39
6.01 ±0.47
96
7.31 ±0.04
7.33 ±0.05
7.52
8.35
7.73 ±0.42
8.51 ±0.51
7.54 ±0.29
7.52
9.29 ±0.27
7.37
16.06 ±1.97
26.94 ±6.19
12.45 ±0.93
8.60 ±0.48
v-wind
24
2.45 ±0.03
2.43 ±0.01
2.63
3.07
2.52 ±0.03
2.54 ±0.14
2.76 ±0.02
2.81
2.58 ±0.01
2.58
2.50 ±0.03
2.63 ±0.09
2.69 ±0.07
3.46 ±0.12
96
3.10 ±0.00
3.30 ±0.08
3.12
3.66
3.23 ±0.11
3.27 ±0.16
3.62 ±0.32
3.83
3.37 ±0.37
3.20
3.43 ±0.34
4.54 ±1.41
4.62 ±0.28
3.95 ±0.09
u-wind
24
2.08 ±0.00
2.02 ±0.00
2.16
2.57
2.14 ±0.13
2.16 ±0.02
2.38 ±0.01
2.37
2.14 ±0.01
2.16
2.03 ±0.01
2.15 ±0.03
2.30 ±0.12
2.14 ±0.05
96
2.15 ±0.03
2.15 ±0.11
2.35
2.80
2.31 ±0.04
2.29 ±0.13
2.71 ±0.03
2.82
2.27 ±0.03
2.35
2.21 ±0.00
2.51 ±0.09
2.89 ±0.15
2.39 ±0.19
Table 1: MSE results on the Hunan regional, French regional, and global datasets with a 96-hour input window and forecast horizons of 24 and 96 hours. Best and second-best results are shown in bold and underlined , respectively, based on unrounded values. Complete MAE results are reported in the appendix.
Model variant
Hunan regional
French regional
temp
v-wind
u-wind
temp
v-wind
u-wind
WxFM-XL (Timer)
5.143 ±0.013
2.450 ±0.034
2.084 ±0.003
6.571 ±0.065
4.501 ±0.032
4.602 ±0.028
w/o frequency domain decomposition
5.393 ±0.022
2.559 ±0.067
2.140 ±0.011
6.773 ±0.065
4.696 ±0.032
4.900 ±0.024
w/o error correlation prior graph
5.430 ±0.033
2.534 ±0.019
2.110 ±0.002
6.808 ±0.124
4.672 ±0.073
4.882 ±0.025
w/o multi-scale temporal module
5.671 ±0.036
2.616 ±0.035
2.149 ±0.021
6.986 ±0.108
5.251 ±0.056
5.551 ±0.035
Table 2: Ablation results (MSE) on the Hunan regional and French regional datasets with a 96-hour input window and a 24-hour forecast horizon. Results are reported as the mean and sample standard deviation over three random seeds. Best results are shown in bold . Complete MAE results are provided in the appendix.
Figure 3: Performance comparison of WxFM-XL (Timer) under different time patch size configurations. The look-back window is set to 96, and the prediction horizon is 24.
Figure 4: Structural properties of prior graphs (taking the v-component of wind speed in the French region as an example).
Appendix figures & tables3 assets
Supplementary material from the paper’s appendix.
Appendix
Models
WxFM-XL (Timer)
WxFM-XL (Sundial)
Timer
Sundial
AdaPTS (Timer)
AdaPTS (Sundial)
Moirai ft
Moirai
Timer-XL ft
Timer-XL
STELLA
CDPNet
MSGNet
Corrformer
Hunan
temp
24
1.552 ±0.031
1.586 ±0.005
1.627
1.679
1.661 ±0.055
1.735 ±0.056
1.715 ±0.103
1.590
1.697 ±0.015
1.662
2.236 ±0.131
2.023 ±0.111
1.760 ±0.110
1.841 ±0.100
96
1.952 ±0.016
1.947 ±0.005
1.987
2.119
2.094 ±0.078
2.861 ±0.127
1.981 ±0.019
1.991
2.269 ±0.041
1.966
3.100 ±0.181
4.027 ±0.564
2.680 ±0.095
2.256 ±0.068
v-wind
24
0.737 ±0.003
0.761 ±0.002
0.745
0.817
0.751 ±0.032
0.763 ±0.020
0.766 ±0.012
0.771
0.794 ±0.002
0.766
0.759 ±0.011
0.797 ±0.013
0.775 ±0.054
0.882 ±0.064
96
0.842 ±0.004
0.931 ±0.028
0.850
0.899
0.875 ±0.040
0.882 ±0.044
0.891 ±0.039
0.898
0.847 ±0.040
0.846
0.888 ±0.045
1.114 ±0.335
1.001 ±0.039
0.949 ±0.073
u-wind
24
0.689 ±0.002
0.661 ±0.018
0.676
0.751
0.698 ±0.023
0.712 ±0.016
0.711 ±0.003
0.710
0.698 ±0.003
0.686
0.674 ±0.010
0.711 ±0.017
0.719 ±0.038
0.676 ±0.045
96
0.696 ±0.004
0.693 ±0.018
0.709
0.795
0.717 ±0.022
0.740 ±0.011
0.767 ±0.005
0.778
0.699 ±0.003
0.720
0.707 ±0.006
0.769 ±0.038
0.792 ±0.042
0.724 ±0.050
Appendix
Table 3: Complete MAE results on the Hunan regional, French regional, and global datasets with a 96-hour input window and forecast horizons of 24 and 96 hours. Results are reported as the mean and sample standard deviation over three random seeds where applicable. Best and second-best results are shown in bold and underlined , respectively.
Model variant
Hunan regional
French regional
temp
v-wind
u-wind
temp
v-wind
u-wind
WxFM-XL (Timer)
1.552 ±0.031
0.737 ±0.003
0.689 ±0.002
1.943 ±0.011
1.487 ±0.006
1.556 ±0.007
w/o frequency domain decomposition
1.682 ±0.041
0.791 ±0.008
0.712 ±0.016
1.985 ±0.020
1.586 ±0.016
1.641 ±0.004
w/o error correlation prior graph
1.684 ±0.038
0.793 ±0.003
0.713 ±0.004
1.977 ±0.022
1.619 ±0.004
1.636 ±0.018
w/o multi-scale temporal module
1.753 ±0.062
0.797 ±0.008
0.714 ±0.010
2.002 ±0.014
1.652 ±0.010
1.737 ±0.015
Appendix
Table 4: Complete MAE results of the ablation study on the Hunan regional and French regional datasets. The input window is 96 hours, and the forecast horizon is 24 hours. Results are reported as the mean and sample standard deviation over three random seeds. Best results are shown in bold .
Figure 5: Representative forecasting cases on the evaluated datasets. The plots compare the ground truth with predictions from the frozen foundation model and WxFM-XL.
Station weather forecasting is fundamentally shaped by both complex spatial dependencies across stations and strong physical coupling among weather variables. However, existing studies often consider these relationships separately and use different datasets and experimental settings, hindering systematic assessment of their individual and joint contributions. In this paper, we introduce M2Weather, a benchmark for joint multi-station and multi-variable weather forecasting. Through multi-criteria quality control and station stratification, we collect 2,809 high-quality stations with 5 physically coupled weather variables across three spatial scales: France, Europe, and Global. This multi-scale design lets us examine whether conclusions persist from national to global station networks. We also introduce unified training and evaluation protocols to enable fair comparison of different station-variable modeling paradigms. To further examine the benefits of modeling station-variable relationships, we design a lightweight, plug-and-play adapter. With a trained weather forecasting model, this adapter can introduce missing station or variable relationships without retraining the model. This enables fair and efficient investigation of station-variable relationships. Systematic evaluation of 16 representative models shows the benefits of jointly modeling station and variable relationships. Completing missing relationships further reduces MSE for all adapted models on all three datasets. Together, these results identify the complementary information across stations and variables as an important resource for improving station weather forecasting. Our code can be obtained at https://github.com/hnu-vis/M2-Weather.
Rongwen Li, Xiao Wang, Mingyang Wang +4
Hunan University · China Meteorological Administration
Multi-station multivariate weather forecasting aims to forecast future weather variables at multiple weather stations from historical surface observations. Existing station forecasting models learn statistical dependencies among discrete stations, but lack explicit physical evolution. Meanwhile, PDE-based weather models provide interpretable physical dynamics, yet require continuous fields and upper-air variables unavailable in surface station data. To bridge this gap, we propose StationPDE, a station-oriented surface PDE learning model. StationPDE constructs a terrain-aware continuous surface field from discrete station observations and decomposes its physical evolution into surface wind transport and upper-air inference. Surface wind transport explicitly evolves observable weather variables, while upper-air inference uses learnable horizontal diffusion to approximate the missing influence of unavailable upper-air variables. A parallel data-driven diffusion branch captures complementary motion patterns, and an adaptive router integrates the two forecasts for station-level multivariate forecasting. Experiments on Weather2K and MeteoNet show that StationPDE consistently outperforms state-of-the-art baselines, reducing MSE by about 9.6% on average compared with the strongest baseline.
Station-based weather forecasting supports daily life and economic activity, yet accurate forecasts require modeling complex spatial dependencies among stations. Recent clustering-based selective modeling offers a promising alternative to dense inter-station interactions. However, a grouping shared across an observation window may obscure local changes in station relationships, while intra-cluster interactions alone may miss important global context. The theoretical advantages of selective interactions over dense connectivity also remain insufficiently understood. We therefore propose STCFormer, an adaptive spatio-temporal Transformer that dynamically groups stations according to their local evolution within each temporal patch. Its Cluster-Guided Attention Block combines fine-grained local attention within clusters and global attention over regional state summaries, allowing each station to access information beyond its own cluster. We further show that a derived Lipschitz upper bound for cluster-conditioned local attention is no larger than its fully connected counterpart, explaining a potential robustness benefit and motivating the design of InfoLoss. Experiments on three real-world weather datasets spanning eight temperature and wind forecasting tasks show that STCFormer achieves the lowest 24-hour mean squared error on all eight tasks and ranks first or second in 47 of 48 comparisons across metrics and forecasting horizons. Ablations and case studies further confirm the benefits of locally adaptive grouping and complementary local-global interactions. Our code can be obtained at https://github.com/hnu-vis/STCFormer.
Rongwen Li, Haixin Xie, Mingyang Wang +5
Hunan University · China Meteorological Administration · Hunan Provincial Meteorological Bureau