cs.LGNov 8, 2026

StatPrompt-LLM: A Lightweight Statistical Refinement for Foundation-Style Time-Series Forecasting

Authors: Aniket Sinha, Veronica W. Tsou

Organizations: The University of Sydney

Abstract

Time-series forecasting has recently seen a paradigm shift with the introduction of foundation-style models that adapt large pretrained language architectures to sequential data. However, effectively exposing fundamental temporal structures, such as trend, scale, and temporal dependence, to these models remains an open challenge, particularly when the available observations are limited. In this paper, we conduct an exploratory empirical study across different generations of forecasting architectures and propose StatPrompt-LLM, a lightweight statistical refinement of Time-LLM. StatPrompt-LLM augments the existing Time-LLM prompting mechanism with dataset-level statistical information and introduces a zero-initialised autoregressive bypass as a complementary linear forecasting pathway. We evaluate our framework on electricity and meteorological time-series benchmarks, including ETTh1, ETTh2, and Weather, under full-prefix and reduced-prefix configurations. Under the 10% reduced-prefix configuration, StatPrompt-LLM achieved lower in-sample prediction errors than Time-LLM, with unweighted average relative reductions across datasets of 40.2% in MSE and 21.4% in MAE. Full-prefix results were more dataset-dependent. Ablation analyses revealed relatively modest and dataset-dependent changes when selected additional statistical descriptor groups were masked within the combined architecture. Computational profiling indicated additional model parameters and runtime overhead relative to Time-LLM.

Figures & tables

Appendix figures & tables3 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Foundation Models and Fine-Tuning: Toward a New Generation of Models for Time Series Forecasting

    Jul 25, 2026Morad Laglil, Bertrand Pracca, Emilie Devijver +1Zero-Shot Time Series ForecastingTime-Series Foundation Models

  2. Reverso: Efficient Time Series Foundation Models for Zero-shot Forecasting

    Feb 19, 2026Xinghong Fu, Yanhong Li, Georgios Papaioannou +1Time-Series Foundation ModelsZero-Shot Time Series Forecasting

  3. Instance-Adaptive Prompts as Context for Time-Series Foundation Models

    Sep 28, 2026Zehao Xiao, Shifeng Xie, Lei Zan +5Time Series ForecastingPrompt Tuning