TopoST: Topology-Conditioned Node Specialization for Urban Spatio-Temporal Foundation Models
Organizations: Faculty of Information Science and Computing, University of Macau, Macau, China · School of Artificial Intelligence, Nanchang University, Nanchang, China · School of Computer Science and Engineering, Beihang University, Beijing, China
Abstract
Urban spatio-temporal foundation models must share knowledge across diverse urban scenarios while accommodating heterogeneous node dynamics. Our analysis of 20+ datasets spanning diverse urban scenarios reveals recurring local graph structures across datasets alongside substantial node heterogeneity within local subgraphs. Motivated by these observations, we propose TopoST, which combines shared learning over local subgraphs with topology-conditioned node specialization. The key insight is to make node specialization itself transferable through a shared topology-to-parameter mapping. This mapping uses identity-independent topological representations to generate node-specific temporal and spatial dependency parameters, enabling direct specialization for unseen nodes without target-specific embeddings or model updates. Extensive experiments demonstrate that TopoST achieves remarkable zero-shot generalization across unseen cities and tasks, highlighting topology-conditioned node specialization as an effective mechanism for transferable urban spatio-temporal foundation models. Code is available at https://github.com/weikaiyun/TopoST.
Figures & tables
| Setting | Model | CAD3 | CAD5 | PEMS07M | TrafficSH | CHI-TAXI | NYC-BIKE | ||||||||||||
| MAE | RMSE | MAPE | MAE | RMSE | MAPE | MAE | RMSE | MAPE | MAE | RMSE | MAPE | MAE | RMSE | MAPE | MAE | RMSE | MAPE | ||
| Full-shot | PDFormer | 20.28 | 36.43 | 25.19 | 12.89 | 21.18 | 28.82 | 4.62 | 8.36 | 13.74 | 0.77 | 1.23 | 8.34 | 4.03 | 12.82 | 44.42 | 7.33 | 13.01 | 65.44 |
| STWA | 21.65 | 37.55 | 26.85 | 14.43 | 24.14 | 29.34 | 4.54 | 8.57 | 12.91 | 1.42 | 2.49 | 9.92 | 3.70 | 11.49 | 42.52 | 7.97 | 14.35 | 64.19 | |
| MSDR | 22.74 | 37.15 | 32.37 | 15.44 | 29.52 | 32.49 | 4.81 | 8.61 | 13.90 | 1.84 | 3.55 | 9.91 | 3.55 | 10.39 | 52.88 | 8.08 | 13.97 | 77.56 | |
| AGCRN | 18.72 | 31.93 | 25.45 | 12.88 | 23.78 | 26.29 | 4.61 | 8.63 | 12.81 | 1.33 | 2.45 | 8.51 | 3.60 | 11.31 | 46.48 | 8.13 | 14.46 | 78.36 | |
| MTGNN | 17.59 | 28.92 | 25.22 | 11.70 | 20.30 | 26.75 | 4.52 | 8.06 | 13.11 | 0.81 | 1.26 | 8.29 | 3.27 | 9.87 | 39.38 | 6.48 | 11.49 | 61.52 | |
| Model | Metric | PEMS-03 | PEMS-04 | PEMS-07 | PEMS-08 | OCC- Paris | OCC- Hamburg | PEMS- BAY | METR-LA | Traffic- SH | Bike- NYC | Taxi- NYC | TDrive- BJ | ||||||||||||
| UniST | MAE | 25.22 / | 35.39 | 34.63 / | 46.26 | 44.02 / | 56.86 | 29.88 / | 39.89 | 1.79 / | 2.21 | 6.66 / | 7.41 | 2.18 / | 3.18 | 5.93 / | 8.27 | 0.60 / | 0.73 | 3.33 / | 4.81 | 5.21 / | 6.02 | 37.93 / | 40.48 |
| RMSE | 38.10 / | 55.04 | 50.69 / | 68.29 | 62.03 / | 82.41 | 42.93 / | 57.78 | 3.16 / | 4.01 | 10.98 / | 12.12 | 4.76 / | 6.68 | 12.65 / | 15.75 | 0.84 / | 1.05 | 6.54 / | 9.99 | 14.36 / | 17.24 | 72.97 / | 77.80 | |
| MAPE | 21.30 / | 28.42 | 22.49 / | 28.99 | 19.08 / | 23.83 | 18.28 / | 23.42 | 25.59 / | 30.51 | 55.63 / | 62.52 | 4.26 / | 6.43 | 21.14 / | 30.44 | 7.48 / | 9.21 | 42.11 / | 54.29 | 30.63 / | 34.44 | 51.43 / | 54.04 | |
| OpenCity | MAE | 25.57 / | 27.85 | 32.82 / | 35.36 | 34.50 / | 38.41 | 26.92 / | 29.64 | 1.80 / | 2.03 | 7.07 / | 7.33 | 2.22 / | 2.68 | 5.44 / | 6.38 | 0.45 / | 0.48 | 4.67 / | 5.17 | 12.23 / | 13.50 | 24.11 / | 50.05 |
| RMSE | 49.25 / | 50.82 | 58.42 / | 59.94 | 58.19 / | 61.37 | 47.47 / | 48.89 | 3.99 / | 4.14 | 11.41 / | 11.68 | 4.71 / | 5.70 | 10.46 / | 11.37 | 0.82 / | 0.81 | 11.03 / | 11.79 | 41.34 / | 40.83 | 71.15 / | 69.42 | |
| MAPE | 23.86 / | 27.95 | 22.57 / | 26.28 | 15.21 / | 17.91 | 16.83 / | 19.50 | 35.19 / | 43.62 | 132.37 / | 143.16 | 5.23 / | 6.56 | 13.51 / | 16.39 | 7.21 / | 7.41 | 73.36 / | 85.08 | 53.82 / | 60.91 | 25.17 / | 30.96 | |
| Model | Params (M) | Batch size | Time (h/epoch) | Memory (GiB) |
| UniST | 3.92 | 16 | 4.50 | 17.51 |
| OpenCity | 25.97 | 8 | 5.05 | 94.95 |
| UrbanFM | 2.25 | 16 | 17.74 | 12.90 |
| TopoST | 2.16 | 16 | 3.84 | 1.28 |
| Variant | CAD5 | CHI-TAXI | ||||
| MAE | RMSE | MAPE | MAE | RMSE | MAPE | |
| TopoST (full) | 9.36 | 15.82 | 24.12 | 1.84 | 4.19 | 38.92 |
| w/o temporal specialization | 9.81 | 16.53 | 25.75 | 1.91 | 4.48 | 40.07 |
| w/o spatial specialization | 10.28 | 17.28 | 26.20 | 1.94 | 4.55 | 44.00 |
| w/o node specialization | 9.78 | 16.63 | 25.95 | 1.91 | 4.43 | 41.99 |
| Topology as features | 9.76 | 16.41 | 25.18 | 1.95 | 4.61 | 39.53 |
| Dataset | Metric | Few-shot | Zero-shot | Full-shot | |||||||||
| TopoST | UrbanFM | OpenCity | TopoST | UrbanFM | OpenCity | PDFormer | STWA | AGCRN | MTGNN | GWN | STGCN | ||
| CD-DIDI | MAE | 2.60 | 2.84 | 2.88 | 6.02 | 7.14 | 6.34 | 3.00 | 3.29 | 3.55 | 3.38 | 3.33 | 3.29 |
| RMSE | 3.88 | 4.23 | 4.21 | 7.93 | 9.08 | 9.36 | 4.31 | 4.74 | 5.03 | 4.80 | 4.75 | 4.68 | |
| SZ-DIDI | MAE | 2.42 | 2.46 | 2.61 | 4.43 | 5.28 | 4.66 | 2.75 | 3.36 | 3.16 | 3.08 | 3.14 | 2.87 |
| RMSE | 3.75 | 3.93 | 4.04 | 6.18 | 7.22 | 7.10 | 4.06 | 4.74 | 4.54 | 4.32 | 4.47 | 4.07 | |
Geospatial Foundation Models
Geospatial foundation models turn satellite, map, and Earth-system data into reusable representations for spatial analysis and prediction.
See all 134 papers