Accurate traffic prediction is essential for urban planning but remains challenging due to the irregular patterns caused by unexpected events. While Spatio-Temporal Graph Neural Networks (STGNNs) effectively model periodic data, they often struggle with these aperiodic fluctuations. To address this, we propose SIMBAD, which improves generalization irregular patterns via two key mechanisms: 1) adaptive regulation of periodic signals to prioritize recent signals, and 2) dynamic spatial modeling that adjusts influence between connected nodes based on contextual relations. Built upon simple similarity metrics to adapt to aperiodic patterns, SIMBAD outperforms existing methods on real-world benchmark datasets, demonstrating superior performance in predicting unseen and irregular traffic events.
Figures & tables
Figure 1: Motivating examples on PEMS04 dataset. (a) Varying periodic traffic patterns among connected nodes. (b) Correlation between L1-norms of input and target sequences with respect to their last week counterparts. (c) Performance comparison under growing aperiodicity.
Figure 2: Overall framework of SIMBAD.
Dataset
Nodes
Edges
Timesteps
PEMS03
358
547
26,208
PEMS04
307
340
16,992
PEMS07
883
866
28,224
PEMS08
170
295
17,856
Table 1: Summary of datasets.
Model
PEMS03
PEMS04
PEMS07
PEMS08
Metric
MAE
RMSE
MAPE%
MAE
RMSE
MAPE%
MAE
RMSE
MAPE%
MAE
RMSE
MAPE%
GWNET
14.94
26.06
15.52
19.23
30.76
14.04
20.63
33.26
9.14
15.06
23.79
9.73
DCRNN
16.67
29.06
16.60
21.68
34.19
15.05
23.13
36.13
10.18
16.81
25.91
11.71
AGCRN
16.21
28.57
15.35
19.85
32.96
13.38
21.35
35.12
9.02
16.54
26.23
10.47
STSGCN
18.24
30.51
17.37
21.46
34.07
14.37
24.07
38.69
10.17
17.05
26.47
10.87
STAEformer
16.67
29.56
17.21
18.63
30.86
13.10
19.91
33.94
8.58
13.82
23.55
9.23
Table 2: Performance comparison and ablation study results on PEMS datasets.
Figure 3: (a) shows performance comparison over increasing irregularity. (b) shows an example prediction result of SIMBAD and the best recent baseline LHMformer from Node 88 of PEMS08.
Figure 4: Hyperparameter sensitivity analysis in terms of MAE on four datasets.
Model
PEMS03
PEMS04
PEMS07
PEMS08
DSTAGNN
15.99
19.85
21.84
16.19
+ Ours
16.44
19.53
21.14
14.89
STIDGCN
15.98
18.38
19.20
13.71
+ Ours
15.20
18.27
18.83
13.12
LHMformer
16.22
18.45
19.27
13.66
+ Ours
16.15
18.83
19.76
13.53
Table 3: Modularization results in terms of MAE.
Model
PEMS03
PEMS04
PEMS07
PEMS08
Metric
MAE
RMSE
MAPE%
MAE
RMSE
MAPE%
MAE
RMSE
MAPE%
MAE
RMSE
MAPE%
SIMBAD
14.77
25.87
14.35
18.03
30.08
12.36
17.86
30.99
7.44
12.58
22.13
8.35
No week
15.29
26.79
16.14
19.54
31.59
13.19
19.56
32.93
8.32
14.55
23.52
9.41
No day
15.02
25.91
14.55
18.30
30.40
12.56
18.09
31.35
7.50
12.95
22.53
8.68
Table 4: Performance comparison on different historical windows.
Appendix figures & tables12 assets
Supplementary material from the paper’s appendix.
Appendix
Figure 5: For each dataset, the left figure shows correlation between L1-norm of target and aggregated historical input XH in Eq. 9 to L1-norm of target and the periodic inputs in Eq. 4 . The right figure shows the uncertainty value for each L1-norm correlation. Higher value means higher uncertainty.
Figure 6: Left-side figure shows the current and the respective daily and weekly historical trends. Middle figure shows the prediction performance of comparing baselines. Right-side figure shows the prediction performance of SIMBAD and SIMBAD without masking matrix M of Eq. 11 .
Figure 7: From top to bottom, the panels show the traffic forecasts, predicted similarities d^k and their ground-truth values dk+ , uncertainties sk , value from masking matrix M , and the error reduction over the variant without M . Here, the subscripts 2W , 1W , and 1D denote the periodic reference patterns from two weeks, one week, and one day earlier, respectively. Blue shading marks intervals where all dk+ exceed the 90th percentile and M<0.5 .
Figure 8: L1-norm discrepancy distribution.
Model
PEMS03
PEMS04
PEMS07
PEMS08
Metric
MAE
RMSE
MAPE%
MAE
RMSE
MAPE%
MAE
RMSE
MAPE%
MAE
RMSE
MAPE%
GWNET
14.94
26.06
15.52
19.23
30.76
14.04
20.63
33.26
9.14
15.06
23.79
9.73
+ Ours
15.96 ▼
29.15 ▼
16.55 ▼
18.80 ▲
30.68 ▲
13.17 ▲
19.11 ▲
31.71 ▲
8.40 ▲
14.10 ▲
22.91 ▲
9.61 ▲
DCRNN
16.67
29.06
16.60
21.68
34.19
15.05
23.13
36.13
10.18
16.81
25.91
11.71
+ Ours
15.91 ▲
27.80 ▲
16.51 ▲
20.12 ▲
32.18 ▲
13.75 ▲
19.99 ▲
32.68 ▲
8.55 ▲
15.62 ▲
24.70 ▲
10.11 ▲
AGCRN
16.21
28.57
15.35
19.85
32.96
13.38
21.35
35.12
9.02
16.54
26.23
10.47
Appendix
Table 5: Performance comparison of baseline models with and without the proposed Aperiodicity-Aware Modulation Layer on PEMS datasets. Superscript on +Ours indicate improvement ( ▲ ) or degradation ( ▼ ).
Model
PEMS03
PEMS04
PEMS07
PEMS08
Metric
MAE
RMSE
MAPE%
MAE
RMSE
MAPE%
MAE
RMSE
MAPE%
MAE
RMSE
MAPE%
GWNET
14.63
25.45
14.71
18.88
30.38
13.45
20.52
33.10
8.84
14.72
23.53
9.56
DCRNN
16.31
28.71
16.07
20.91
33.21
13.96
22.66
35.68
10.11
16.13
25.32
10.42
AGCRN
15.93
27.82
14.88
19.47
32.16
13.05
20.91
34.60
8.86
16.04
25.46
10.29
STSGCN
17.65
29.39
16.73
20.97
33.61
13.88
23.78
38.72
10.01
16.64
25.98
10.68
STAEformer
15.81
27.93
16.12
18.41
30.87
12.83
19.73
33.53
8.72
13.70
23.19
9.33
Appendix
Table 6: Performance comparison on the stretched training dataset.
Model
PEMS03
PEMS04
PEMS07
PEMS08
Metric
MAE
RMSE
MAPE%
MAE
RMSE
MAPE%
MAE
RMSE
MAPE%
MAE
RMSE
MAPE%
NLinear
21.07 ± 0.00
34.07 ± 0.01
19.50 ± 0.02
28.80 ± 0.00
45.47 ± 0.01
19.00 ± 0.01
31.28 ± 0.00
49.12 ± 0.01
13.17 ± 0.01
22.76 ± 0.00
36.12 ± 0.01
13.57 ± 0.01
DLinear
20.72 ± 0.01
33.28 ± 0.02
20.73 ± 0.14
28.34 ± 0.00
44.44 ± 0.01
20.63 ± 0.07
30.66 ± 0.00
47.77 ± 0.03
13.31 ± 0.05
22.44 ± 0.01
35.31 ± 0.02
13.78 ± 0.11
GWNET
14.94 ± 0.12
26.06 ± 0.38
15.52 ± 0.79
19.23 ± 0.09
30.76 ± 0.13
14.04 ± 0.51
20.63 ± 0.05
33.26 ± 0.07
9.14 ± 0.17
15.06 ± 0.11
23.79 ± 0.12
9.73 ± 0.02
DCRNN
16.67 ± 0.12
29.06 ± 0.33
16.60 ± 0.93
21.68 ± 0.18
34.19 ± 0.22
15.05 ± 0.69
23.13 ± 0.13
36.13 ± 0.15
10.18 ± 0.14
16.81 ± 0.07
25.91 ± 0.08
11.71 ± 0.58
AGCRN
16.21 ± 0.12
28.57 ± 0.39
15.35 ± 0.38
19.85 ± 0.14
32.96 ± 0.41
13.38 ± 0.24
21.35 ± 0.10
35.12 ± 0.13
9.02 ± 0.07
16.54 ± 0.25
26.23 ± 0.36
10.47 ± 0.19
Appendix
Table 7: Standard deviation results on PEMS datasets.
PEMS03
PEMS04
MAE
RMSE
MAPE
MAE
RMSE
MAPE
Default
14.77
25.87
14.35
18.03
30.08
12.36
temperature ( τ )
0.1
14.99
26.27
14.84
18.04
30.11
12.38
0.3
14.99
26.30
14.66
18.03
30.08
12.37
0.4
15.03
26.35
14.96
18.04
30.08
12.35
Appendix
Table 8: Performance of hyperparameter-tuned variants. Best results are marked in bold.
Model
PEMS03
PEMS04
PEMS07
PEMS08
Metric
Train (s)
Test (s)
Train (s)
Test (s)
Train (s)
Test (s)
Train (s)
Test (s)
GWNET
8.33
1.43
4.17
0.91
27.12
4.00
3.03
0.70
DCRNN
51.69
10.80
28.03
5.52
105.07
44.47
25.76
4.77
AGCRN
17.82
2.93
10.30
1.85
27.45
3.96
11.10
1.91
STSGCN
23.68
6.56
11.58
2.87
97.44
21.29
12.37
1.56
STAEformer
40.46
4.33
19.78
2.29
137.60
14.28
11.26
1.58
Appendix
Table 9: Train per epoch and testing time comparison.
Dataset
Nodes
Edges
Timesteps
METR-LA
207
1,515
34,272
PEMS-BAY
325
2,369
52,116
SD (2019)
716
17,319
35,040
Appendix
Table 10: Summary of datasets.
Dataset
Metric
GWNET
DCRNN
AGCRN
STSGCN
STAEformer
DSTAGNN
STWave
STIDGCN
DTRformer
LHMformer
ASTGCN
SIMBAD
SD (2019)
Average
MAE
19.90
21.74
23.04
204.60
18.86
21.74
19.75
18.47
19.71
19.59
23.60
17.98
RMSE
32.63
35.63
40.69
86.63
32.99
38.28
32.35
31.30
34.30
33.33
41.48
30.15
MAPE
13.54
14.61
15.17
268.05
12.48
13.56
13.25
12.18
12.93
12.81
16.08
11.79
PEMS-BAY
Horizon 3 (15 min)
MAE
1.31
1.35
1.40
1.51
1.36
1.42
1.37
1.34
1.38
1.34
1.82
1.28
RMSE
2.77
2.86
2.98
3.27
2.90
3.05
2.98
2.88
2.88
2.83
3.55
2.76
MAPE
2.74
2.85
3.00
3.77
2.90
3.12
2.93
2.86
2.96
2.85
4.09
2.72
Appendix
Table 11: Performance comparison on SD (2019), PEMS-BAY, and METR-LA.
Figure 9: Correlation between L1-norms of input and target sequences with respect to their last week counterparts.
Traffic forecasting is a fundamental component of intelligent transportation systems, yet remains challenging in real-world settings due to irregular sensor distributions and the high computational cost of modeling large-scale spatiotemporal dependencies. In practical traffic networks, sensors are unevenly distributed across regions, leading to non-uniform spatial structures that limit the effectiveness and scalability of existing graph-based and attention-based models. To address these challenges, we propose PatchSTG, a patch-based spatiotemporal graph Transformer designed for efficient forecasting on irregular sensor networks. The key idea is to introduce a hierarchical spatial representation that partitions sensors into balanced, locality-preserving patches based on geographic information. On top of this structure, a dual attention encoder alternates between intra-patch attention for capturing local interactions and inter-patch attention for modeling global dependencies, reducing computational complexity from quadratic to near-linear scaling. We evaluate PatchSTG on real-world traffic data from Rhode Island and additional large-scale datasets. Experimental results demonstrate that the proposed model achieves stable and competitive forecasting performance across multiple horizons, while significantly improving computational efficiency. Ablation studies further validate the effectiveness of spatial partitioning and dual attention in capturing both local and long-range traffic dynamics. These results suggest that patch-based spatiotemporal modeling provides a scalable and effective framework for traffic forecasting under irregular spatial settings.
Jichao Li, Xuanming Shi
Portsmouth Abbey School · CodingFuture (Shanghai) Education Technology Co., Ltd.
Accurate traffic prediction is essential for optimizing transportation systems, enhancing resource allocation, and improving overall urban administration. Spatio-temporal graph neural networks (GNNs) have achieved state-of-the-art performance and have been widely used in various spatio-temporal prediction scenarios. However, these prediction methods often exhibit low generalization ability, struggling with distribution shifts caused by spatio-temporal dynamics. To address this challenge, we propose an approach to enhance the generalization and adaptation of spatio-temporal GNNs through efficient prompting. Specifically, we introduce a lightweight and model-agnostic prompt tuning framework for spatio-temporal GNNs, named SimpleST. It facilitates adapting pre-trained spatio-temporal GNNs to novel distributions while keeping the model parameters fixed. This prompt mechanism reduces the overhead and complexity of adaptation, enabling efficient utilization of pre-trained models for out-of-distribution generalization. Extensive experiments conducted on five real-world urban spatio-temporal datasets demonstrate the superiority of our approach in terms of prediction accuracy and computational efficiency.
Qianru Zhang, Xinyi Gao, Alexander Zhou +3
School of Computing and Data Science The University of Hong Kong · School of Electrical Engineering and Computer Science The University of Queensland · Department of Computing The Hong Kong Polytechnic University
Accurate traffic forecasting is essential for intelligent transportation systems, supporting a wide range of real-world applications. However, it remains challenging due to two key factors:(1) Traffic series contain heterogeneous temporal patterns, where stable periodic regularities coexist with event-driven fluctuations. Existing methods often treat them within a unified representation, limiting their ability to capture fine-grained temporal dynamics.(2)Spatial dependencies among nodes are inherently dynamic and sparse, while dense all-pairs attention often introduces redundant interactions and amplifies noise. To address these issues, we propose ADMFormer, an Adaptive-Decomposition Transformer with Time-Varying Masked Spatial Attention. Specifically, ADMFormer first employs a time-node adaptive gating mechanism to decouple traffic signals into dominant regularities and residual fluctuations that vary across time and nodes. A dual-branch temporal module is then designed to separately capture global periodic dependencies and high-frequency irregular variations from these two decomposed components. Furthermore, ADMFormer introduces a time-varying masked spatial attention that sparsifies spatial interactions based on real-time traffic states, thereby effectively preserving dynamic and informative dependencies. Extensive experiments on four real-world datasets demonstrate that ADMFormer achieves state-of-the-art performance.
Ruiwen Gu, Qitai Tan, Yahao Liu +1
Shenzhen Ubiquitous Data Enabling Key Lab Shenzhen International Graduate School, Tsinghua University, Shenzhen, China · School of Computer Science and Engineering University of Electronic Science and Technology of China, Chengdu, China