cs.AIOct 24, 2026

Benchmarking System One Models for Time-Series Decision Making: A Case Study of Jev

Authors: Jianye Wang, Kexin Zhang, Jiayin Xiong, Hao Xue

Organizations: The Hong Kong University of Science and Technology (Guangzhou)

Abstract

Time-series tasks require both accurate predictions and fast decisions. Advances in large models have introduced decision-oriented models that directly output answers and their probabilities, which we call Structured System 1 models. Their applicability to time-series tasks remains underexplored. Using Jev 1.13.0 as a case study, we evaluate time-series classification, event type prediction, oil temperature direction and stock movement prediction, converting continuous forecasting targets into discrete decisions to fit the model interface. We establish a unified evaluation framework using accuracy and AUC. Results show stronger performance on selected explicit temporal patterns and event type prediction, but near-chance discrimination on many numerical sequence classification tasks and stock movement prediction. Some datasets also reveal a gap between ranking quality and final decision accuracy. These findings motivate improvements in temporal representation, domain adaptation, and decision-score alignment. Standardized sample construction, model calls, and result recording support extending the evaluation to future models.

Figures & tables

Appendix figures & tables3 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. TimesJev: Thinking Fast on Time Series with System 1 Sufficiency

    Oct 19, 2026Chenghao Liu, Wei Fan, Jindong Han +4Time Series ReasoningTemporal Representation Learning

  2. General Decision Models: Benchmarking and Insights Beyond Jev

    Oct 2, 2026Feiyu Duan, Jiayu Lin, Jia Wang +6LLM Decision-MakingUncertainty Calibration