msData: A Millisecond-Resolution Network Dataset for Advancing Time Series Foundation Models
Organizations: Department of Computer Science Aalborg University · IBM Research, Ireland · Trinity College Dublin
Abstract
Time series foundation models (TSFMs) require diverse, real-world datasets to adapt across varying domains and temporal frequencies. However, current large-scale datasets predominantly focus on low-frequency time series with sampling intervals, i.e., time resolution, in the range of seconds to years, hindering their ability to capture the nuances of high-frequency time series data. To address this limitation, we introduce a novel dataset, msData, that captures millisecond-resolution wireless and traffic conditions from an operational 5G wireless deployment, expanding the scope of TSFMs to incorporate high-frequency data for pre-training. Further, the dataset introduces a new domain, namely, wireless networks, thus complementing existing more general domains like energy and finance. The dataset also provides use cases for short-term forecasting, with prediction horizons spanning from 1 millisecond (1 step) to 96 milliseconds (96 steps). To demonstrate the utility of the dataset, we benchmark traditional machine learning models, transformer-based deep learning models, and TSFMs on forecasting tasks using representative subsets of the data, including a static mobility pattern within YouTube traffic class and a train mobility pattern within Web Browsing traffic class. Across these data distributions, we demonstrate that most TSFM model configurations perform poorly in both zero-shot and fine-tuned settings. Our work underscores the importance of incorporating high-frequency datasets during pre-training and forecasting to enhance architectures, fine-tuning strategies, generalization, and robustness of TSFMs in real-world applications. Code is available at this repository: https://github.com/khanalsubina/msData. Data is available on: Hugging Face.
Figures & tables
| Dataset | STL Decomposition | ||
| Trend | Seasonality | Residuals | |
| Network | Unstable, step-like shifts. | Weak short-term periodic patterns. Hidden by noise. | Sharp spikes. Bursts of noise. Lots of unpredictable variation. |
| ETTh1 | Mostly steady with small rises and falls. | Small, regular repeating pattern. | Tiny random changes. |
| Electricity | Remains steady throughout. | Strong repeating pattern. | Occasional bursts of noise. |
| Weather | Almost flat but interrupted by sudden sharp spikes. | No seasonality. | Mostly small, but with rare sudden jumps. |
| Traffic | Slowly increasing trend over time. | Strong, regular repeating pattern. | Small random changes. |
| Feature | Description |
| CQI | Channel Quality Indicator |
| MCS | Modulation and Coding Scheme |
| pkt ok | Number of packets sent |
| pkt nok | Number of packets dropped |
| Univariate | Multivariate | |||
| Model | RMSE | MAE | RMSE | MAE |
| RF | ||||
| XGB | ||||
| ARF | ||||
| Naive | ||||
| OLR | ||||
| Fine-tuning Strategy | RMSE | MAE |
| Head-only fine-tuning | 0.0413 | 0.0270 |
| Adapter-based fine-tuning | 0.0522 | 0.0334 |
| Temporal Resolution | Prediction Horizon | ARF | TTM Zero-shot | TTM Fine-tuning | Chronos Zero-shot | ||||
| RMSE | MAE | RMSE | MAE | RMSE | MAE | RMSE | MAE | ||
| 100 ms | 96 | 0.0457 | 0.0262 | 0.0765 | 0.0434 | 0.0743 | 0.0421 | 0.0622 | 0.0338 |
| 200 ms | 48 | 0.0471 | 0.0267 | 0.0870 | 0.0499 | 0.0880 | 0.0496 | 0.0740 | 0.0389 |
| 500 ms | 20 | 0.0398 | 0.0218 | 0.0855 | 0.0490 | 0.0894 | 0.0542 | 0.0711 | 0.0372 |
| 1000 ms | 10 | 0.0297 | 0.0176 | 0.0856 | 0.0500 | 0.0856 | 0.0500 | 0.0580 | 0.0326 |
| 2000 ms | 5 | 0.0289 | 0.0169 | 0.0880 | 0.0527 | 0.0915 | 0.0584 | 0.0671 | 0.0354 |
| Univariate | Multivariate | |||
| Model | RMSE | MAE | RMSE | MAE |
| RF | 0.0751 | 0.0542 | 0.0740 | 0.0536 |
| XGB | 0.0774 | 0.0536 | 0.0758 | 0.0533 |
| ARF | 0.0605 | 0.0366 | 0.0459 | 0.0230 |
| Naive | 0.0727 | 0.0476 | 0.0727 | 0.0476 |
| OLR | 0.0819 | 0.0569 | 0.0817 | 0.0567 |
Appendix figures & tables18 assets
Supplementary material from the paper’s appendix.
Appendix
| Dataset | No. of features |
| Network | 47 |
| ETTh1 | 8 |
| Electricity | 322 |
| Weather | 22 |
| Traffic | 863 |
| Feature | Description |
| CQI | Channel Quality Indicator |
| MCS | Modulation and Coding Scheme |
| pkt ok | Number of packets sent |
| pkt nok | Number of packets dropped |
| id_ue | Number of ue’s connected in the BS |
| pusch_sinr | Noise ratio interference in the Physical Uplink Shared Channel |
| Model | Multivariate | |
| RMSE | MAE | |
| XGB | 0.0347 | 0.0234 |
| ARF | 0.0273 | 0.0155 |
| Naive | 0.0417 | 0.0239 |
| TTM (Zero-shot) | 0.0359 | 0.0230 |
| TTM (Fine-tuning) | 0.0358 | 0.0228 |
| Univariate | Multivariate | |||
| Model | RMSE | MAE | RMSE | MAE |
| XGB | 0.1440 | 0.1087 | 0.1440 | 0.1087 |
| ARF | 0.1728 | 0.1125 | 0.0968 | 0.0634 |
| Naive | 0.1309 | 0.0932 | 0.1309 | 0.0932 |
| TTM (Zero-shot) | 0.1279 | 0.0922 | 0.1279 | 0.0922 |
| Mobility Pattern | Multivariate | |||||||
| Traffic Class : YouTube | Traffic Class : Portscan | |||||||
| Model | ||||||||
| ARF | TTM (Zero-shot) | ARF | TTM (Zero-shot) | |||||
| RMSE | MAE | RMSE | MAE | RMSE | MAE | RMSE | MAE | |
| Static | 0.0166 | 0.0123 | 0.0359 | 0.0230 | 0.0858 | 0.0585 | 0.1192 | 0.0904 |
| Pedestrian | 0.0457 | 0.0262 | 0.0765 | 0.0434 | 0.0819 | 0.0555 | 0.1127 | 0.0860 |
| Learning Rate (LR) | RMSE | MAE | Fine-tune Percent | RMSE | MAE | No. of Epochs | RMSE | MAE |
| 0.01 | 0.0390 | 0.0249 | 10 | 0.0358 | 0.0227 | 50 | 0.0359 | 0.0227 |
| 0.001 | 0.0387 | 0.0247 | 15 | 0.0365 | 0.0226 | 80 | 0.0359 | 0.0227 |
| 0.00001 | 0.0359 | 0.0227 | 25 | 0.0366 | 0.0227 | 100 | 0.0359 | 0.0227 |
| 0.000001 | 0.0359 | 0.0229 | 30 | 0.0367 | 0.0226 |
| Context Length | RMSE | MAE | Batch Size | RMSE | MAE |
| 15 | 0.0350 | 0.0231 | 16 | 0.0330 | 0.0227 |
| 25 | 0.0324 | 0.0217 | 32 | 0.0314 | 0.0218 |
| 35 | 0.0327 | 0.0221 | 128 | 0.0332 | 0.0221 |
| Case | Heads | Layers | RMSE | MAE | ||
| 1 | 64 | 128 | 2 | 3 | 0.0321 | 0.0206 |
| 4 | 0.0319 | 0.0205 | ||||
| 2 | 64 | 128 | 8 | 2 | 0.0320 | 0.0207 |
| 4 | 0.0323 | 0.0207 | ||||
| 3 | 128 | 256 | 8 | 3 | 0.0324 | 0.0208 |
| 4 | 256 | 512 | 0.0324 | 0.0209 |
| Case | Heads | Layers | RMSE | MAE | ||
| 1 | 64 | 128 | 2 | 3 | 0.0326 | 0.0205 |
| 4 | 0.0319 | 0.0206 | ||||
| 2 | 64 | 128 | 8 | 2 | 0.0321 | 0.0206 |
| 4 | 0.0324 | 0.0209 | ||||
| 3 | 128 | 256 | 8 | 3 | 0.0321 | 0.0207 |
| 4 | 256 | 512 | 0.0318 | 0.0207 |
| n_estimators | max_depth | LR = 0.1 | LR = 0.3 | LR = 0.5 |
| 50 | 2 | 0.0342 / 0.0232 | 0.0346 / 0.0231 | 0.0350 / 0.0233 |
| 4 | 0.0339 / 0.0225 | 0.0347 / 0.0228 | 0.0356 / 0.0233 | |
| 6 | 0.0341 / 0.0225 | 0.0352 / 0.0230 | 0.0366 / 0.0238 | |
| 8 | 0.0341 / 0.0225 | 0.0356 / 0.0234 | 0.0381 / 0.0248 | |
| 100 | 2 | 0.0341 / 0.0228 | 0.0346 / 0.0230 | 0.0350 / 0.0232 |
| 4 | 0.0341 / 0.0225 | 0.0350 / 0.0229 | 0.0374 / 0.0244 |
| n_estimators | max_depth | max_features = sqrt | max_features = 1 |
| 50 | None | 0.0342 / 0.0226 | 0.0342 / 0.0228 |
| 2 | 0.0355 / 0.0259 | 0.0403 / 0.0309 | |
| 4 | 0.0347 / 0.0244 | 0.0355 / 0.0257 | |
| 100 | None | 0.0339 / 0.0223 | 0.0342 / 0.0226 |
| 2 | 0.0355 / 0.0259 | 0.0408 / 0.0314 | |
| 4 | 0.0346 / 0.0244 | 0.0358 / 0.0261 |
| Model | Prediction Horizon = 192 | Prediction Horizon = 336 | Prediction Horizon = 720 | |||
| RMSE | MAE | RMSE | MAE | RMSE | MAE | |
| XGB | 0.0399 | 0.0268 | 0.0445 | 0.0313 | 0.0579 | 0.0436 |
| ARF | 0.0204 | 0.0134 | 0.0187 | 0.0140 | 0.0188 | 0.0138 |
| Naive | 0.0533 | 0.0296 | 0.0623 | 0.0366 | 0.0742 | 0.0506 |
| OLR | 0.0622 | 0.0353 | 0.0681 | 0.0398 | 0.0774 | 0.0488 |
| PatchTST | 0.0357 | 0.0228 | 0.0400 | 0.02584 | 0.0494 | 0.0337 |