cs.LGOct 9, 2026

How Much Computation Does Every Forecast Need? Structured Block Skipping in Two Time-Series Foundation Models

Authors: Max Bourgeat

Organizations: Polytechnique Montréal Montréal, QC, Canada

Abstract

Time-series foundation models use the same network depth for every input, although forecasting windows differ in structure and difficulty. We test whether whole Transformer blocks can be removed at inference time in two pretrained models: Chronos-Bolt and TimesFM 2.5. Our bypasses avoid the original block computation and preserve the dense model exactly when all blocks are enabled. Masks are selected only on calibration windows and evaluated on 1,088 held-out windows from ETTh1, Traffic, Weather, and Exchange. At moderate sparsity, Chronos-Bolt with 7/11 candidate blocks and TimesFM with 16/20 blocks show little change in mean relative forecasting quality across datasets while reducing median A100 batch-1 latency by 11.2% and 13.4%. More aggressive TimesFM skipping accelerates inference further but substantially harms Traffic and Weather. Across both models, different equal-budget masks win on different windows, and a retrospective oracle significantly improves over the best static mask on every dataset. However, dataset-specific masks transfer inconsistently, and Chronos representations do not support reliable unseen-domain routing. These results establish cross-architecture structured redundancy and input-dependent opportunity, but not a deployable dynamic inference method.

Figures & tables

Explore similar work

CardsList
  1. Latent Inference-Time Guidance of Time Series Foundation Models

    Sep 29, 2026Chloé Hashimoto-Cullen, Amaury Durand, Laurent Bozzi +3Time Series ForecastingInference-Time Guidance

  2. Universal Redundancies in Time Series Foundation Models

    Feb 2, 2026Anthony Bao, Venkata Hasith Vattikuti, Jeffrey Lai +1Transformer InterpretabilityKernel Regression