cs.LGNov 16, 2026

Severe but Harmless: Stress-Testing Shift Severity for Frozen Time-Series Forecasters

Authors: Korede R. Bishi, Dominic Okonkwo, Adetayo Okunoye

Organizations: School of Computing, University of Georgia, Boyd Research and Education Center, Athens, GA 30602, USA

Abstract

Zero-shot time-series foundation models (TSFMs) have become attractive alternatives to task-specific models because they handle diverse downstream tasks, including anomaly detection and forecasting, without per-series training. However, time-series data undergo distribution shifts, and the dissimilarity between two regimes is commonly scored with statistical measures such as Wasserstein-1, where a higher score is read as a more severe shift. In systematic experiments using three established severity measures on nine regime shifts from three standard traffic datasets, we show that these measures do not reliably predict degradation for instance-normalized TSFMs. The regimes rated most severe are not the regimes that degrade the models most, and degradation reaches 29% in the lowest-scoring regime. In most cases, the audit shows no positive relationship between measured severity and model degradation. We provide an equivariance-based stress-testing analysis that explains why severity readings can become decoupled from model degradation.

Figures & tables

Explore similar work

CardsList
  1. Time Series Forecasting Benchmarks Need Scenario-Grounded Stress Testing

    Oct 2, 2026Yuyang Zhao, Lian Xu, Hao XueRobust Time Series ForecastingTime Series Forecasting

  2. Do Time Series Foundation Model Benchmarks Hide Regime-Dependent Failures? Evidence from Traffic Speed Forecasting

    Jun 16, 2026Yingshuo Wang, Xian Sun, Lingdong Kong +4Time Series ForecastingForecasting Benchmarks

  3. Do Time-Series Foundation Models Pay Off for Industrial Monitoring? A Cost-Aware Empirical Study

    Aug 24, 2026Guan-Hua Wen, Kuan-Yu ChenTime-Series Foundation ModelsTime-Series Anomaly Detection