cs.LGNov 4, 2026

Big Models, Small Gains: Frozen Forecasters as Classifiers on MONSTER

Authors: Rishit Jain, Rishit Kar, Chetashri Bhadane, Nilesh Patil

Organizations: Department of Computer Engineering, Dwarkadas J. Sanghvi College of Engineering, University of Mumbai, India

Abstract

Forecasting foundation models are increasingly used as frozen feature extractors for time series classification, but it remains unclear whether their pretrained representations offer an advantage over strong classifiers that do not require pretraining. This raises an important question: do these representations provide useful information beyond what the model architecture alone can capture, particularly when labelled data are scarce? We present a controlled benchmarking of two forecasting models, Reverso and Chronos-Bolt, on six large datasets from the MONSTER benchmark, using 1%, 10%, and 100% of the available training labels. We compare their frozen representations against four established time series classification methods and random-weight versions of the same forecasting models. Our results show that pretraining improves classification accuracy over random-weight counterparts on five of the six datasets, with gains of up to 23 percentage points. However, the frozen representations do not reliably outperform the strongest non-pretrained baseline in any setting: they perform worse in 15 of 17 settings and tie in the remaining two. Further experiments show that restoring amplitude information recovers part of the performance gap, while fine-tuning and forecast-error features do not close it. These findings highlight the importance of strong task specific baselines and random weight controls when evaluating forecasting foundation models for classification. Our code is available at https://github.com/Rachet2006/frozen-forecasters-monster.

Figures & tables

Appendix figures & tables8 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Foundation Models and Fine-Tuning: Toward a New Generation of Models for Time Series Forecasting

    Jul 25, 2026Morad Laglil, Bertrand Pracca, Emilie Devijver +1Zero-Shot Time Series ForecastingTime-Series Foundation Models

  2. When Do Foundation Models Pay Off? A Break-Even Analysis of Pretrained Time Series Forecasters

    Jul 6, 2026Nicholas Tan Jerome, Frank SimonZero-Shot Time Series ForecastingTime Series Forecasting