Benchmarking Time Series Foundation Models for Load Forecasting Under Covariate Uncertainty
Organizations: Department of Electrical and Computer Engineering University of California, Santa Cruz
Abstract
Accurate short-term load forecasting (STLF) is essential for the reliable and efficient operation of modern power systems. While time series foundation models (TSFMs) have recently demonstrated remarkable performance across a wide range of forecasting tasks, their effectiveness for STLF under realistic operational conditions remains largely unexplored. In this paper, we present a comprehensive benchmark of four trained-from-scratch (TFS) models and four TSFMs across three real-world load forecasting datasets under operational scenarios that differ in the availability and quality of future covariate information. Our results show that Chronos-2 consistently achieves state-of-the-art performance in both zero-shot and fine-tuned settings when future covariates are available or accurately forecast. However, its performance degrades as covariate forecasts become increasingly noisy, whereas TimesNet exhibits greater robustness under severe covariate uncertainty. These findings demonstrate the effectiveness of covariate-informed TSFMs for STLF while highlighting the critical role of robust covariate modeling in real-world forecasting applications.
Figures & tables
| Model | Univariate Forecasting | Covariate-Informed Forecasting | Past Covariate Support | Future Covariate Support | Quantile Levels | Max. Context Length | Parameter Count |
| TimesFM 2.5 † | ✓ | ✗ | ✗ | ✗ | 16,384 | 200M | |
| Chronos-2 | ✓ | ✓ | ✓ | ✓ | 8,192 | 120M | |
| Moirai 2.0 | ✓ | ✗ | ✗ | ✗ | 8,192 | 11.4M | |
| TiRex | ✓ | ✗ | ✗ | ✗ | 2,048 | 35M |
| Dataset | Covariates |
| ISO-NE | Day-ahead demand ( DA_DEMD ), dry bulb temperature ( DryBulb ), dew point ( DewPnt ) |
| NAU | Temperature ( temperature ) |
| CAISO | Solar mix ( solar ), wind mix ( wind ), regions 1–5 temperature ( r1_temp_c , …, r5_temp_c ) |
| Model | Hyperparameter | Value |
| DLinear | Moving average kernel | 25 |
| Learning rate | ||
| PatchTST | Model dimension | 128 |
| Hidden dimension | 512 | |
| Encoder layers | 3 | |
| Attention heads | 8 |
| Univariate | Multivariate | Covariate-Informed | |||||||
| Dataset | Metric | TimesFM 2.5 (ZS) | Moirai 2.0 (ZS) | TiRex (ZS) | DLinear | PatchTST | Informer | TimesNet | Chronos-2 (ZS/FT) |
| ISO-NE | MAE | 561.43 | 503.93 | 575.45 | 616.18 | 590.10 | 615.87 | 566.78 | 496.55 / 464.40 |
| MAPE | 3.91 | 3.52 | 4.03 | 4.34 | 4.20 | 4.36 | 4.02 | 3.44 / 3.23 | |
| NAU | MAE | 78.89 | 71.80 | 87.16 | 95.80 | 94.80 | 83.13 | 72.54 | 66.08 / 63.15 |
| MAPE | 3.38 | 3.06 | 3.73 | 4.18 | 4.21 | 3.64 | 3.14 | 2.86 / 2.69 | |
| CAISO | MAE | 732.25 | 646.17 | 730.06 | 842.78 | 769.56 | 897.38 | 698.20 | 604.26 / 567.35 |
| Multivariate | Covariate-Informed | ||||
| Dataset | Metric | Informer | TimesNet | Chronos-2 (ZS/FT) | |
| ISO-NE | MAE | 0 | 317.92 | 263.98 | 266.25/ 229.82 |
| 0.5 | 350.33 | 272.57 | 303.12/ 267.04 | ||
| 1 | 431.35 | 300.64 | 379.80/ 337.32 | ||
| 5 | 1230.29 | 707.22 | 1207.72/ 985.60 | ||
| MAPE | 0 | 2.37 | 1.91 | 1.92/ 1.67 | |