Time-series foundation models use the same network depth for every input, although forecasting windows differ in structure and difficulty. We test whether whole Transformer blocks can be removed at inference time in two pretrained models: Chronos-Bolt and TimesFM 2.5. Our bypasses avoid the original block computation and preserve the dense model exactly when all blocks are enabled. Masks are selected only on calibration windows and evaluated on 1,088 held-out windows from ETTh1, Traffic, Weather, and Exchange. At moderate sparsity, Chronos-Bolt with 7/11 candidate blocks and TimesFM with 16/20 blocks show little change in mean relative forecasting quality across datasets while reducing median A100 batch-1 latency by 11.2% and 13.4%. More aggressive TimesFM skipping accelerates inference further but substantially harms Traffic and Weather. Across both models, different equal-budget masks win on different windows, and a retrospective oracle significantly improves over the best static mask on every dataset. However, dataset-specific masks transfer inconsistently, and Chronos representations do not support reliable unseen-domain routing. These results establish cross-architecture structured redundancy and input-dependent opportunity, but not a deployable dynamic inference method.
Figures & tables
Figure 1: Methodology for both frozen TSFMs. Calibration data select static masks without test leakage; held-out windows then traverse genuinely bypassed architecture-native blocks. The same forecasts support quality, execution, latency, throughput, and retrospective equal-budget oracle analyses. Dashed arrows denote held-out inputs.
Model
Active
ETTh1
Traffic
Weather
Exchange
Mean
Chronos-Bolt
11/11
0.00%
0.00%
0.00%
0.00%
0.00%
9/11
+1.75%
+1.61%
−4.96%
−0.21%
−0.45%
7/11
+2.73%
+14.49%
−22.09%
+0.19%
−1.17%
4/11
+19.55%
+41.43%
+47.13%
+10.96%
+29.77%
2/11
+18.96%
+70.81%
+48.99%
+1.01%
+34.94%
TimesFM 2.5
20/20
0.00%
0.00%
0.00%
0.00%
0.00%
Table 1: Per-dataset static quality change relative to dense (normalized pinball loss; lower is better). Mean is the unweighted mean of the four within-dataset relative changes.
Model
Active
Batch-1 latency
Batch-32 throughput
Chronos-Bolt
11/11
32.32 ms (0.0%)
944.6 series/s (0.0%)
9/11
30.53 ms ( −5.5% )
1001.7 series/s ( +6.0% )
7/11
28.71 ms ( −11.2% )
1065.4 series/s ( +12.8% )
4/11
25.79 ms ( −20.2% )
1177.4 series/s ( +24.6% )
2/11
23.91 ms ( −26.0% )
1263.5 series/s ( +33.8% )
TimesFM 2.5
20/20
61.68 ms (0.0%)
455.1 series/s (0.0%)
Table 2: Measured A100 systems results. Parentheses give change from the model’s dense baseline; throughput uses batch 32.
Figure 2: Quality-latency trade-off. Loss is normalized within model and dataset before averaging; latency is synchronized A100 batch-1 inference.
Figure 3: Cross-dataset transfer at the main budget (7/11 Chronos, 12/20 TimesFM). Each cell is pinball-loss change relative to dense on the evaluation dataset; lower is better. Columns denote mask-selection origin.
Figure 4: Oracle opportunity and diversity. Left: relative gain over the best static equal-budget mask with 95% series-cluster bootstrap intervals. Right: exponential entropy of the winning-mask distribution (maximum five); one denotes a single winner.
Model
Dataset
Static
Oracle
Relative gain
Chronos-Bolt
ETTh1
.2076
.1921
7.5%
Traffic
.1596
.1460
8.5%
Weather
.2056
.1717
16.5%
Exchange
.0158
.0123
21.7%
TimesFM 2.5
ETTh1
.2178
.1915
12.1%
Traffic
.1763
.1706
3.2%
Table 3: Oracle gain over the evaluation-best static equal-budget mask. All absolute-gain 95% series-cluster bootstrap intervals exclude zero.