Beyond a Universal Forecasting Selector: Demand-Conditioned Model Selection across Demand Patterns and Horizons

Adolfo González

cs.LGSep 3, 2026

Beyond a Universal Forecasting Selector: Demand-Conditioned Model Selection across Demand Patterns and Horizons

Authors: Adolfo González

Organizations: Department of Computer Engineering and Informatics, Faculty of Engineering, University of Santiago of Chile, Santiago, Chile

Abstract

Forecasting-model selection remains difficult in heterogeneous demand because the most suitable decision rule may vary with demand structure, data availability, and forecasting horizon. This study examines whether the selector itself should be treated as a context-dependent component of the forecasting process. Five selection mechanisms - RMSSE, ERA, OWA, CCG-AHSC, and CCG-AHSCD - are compared across 24 optimized forecasting models, nine datasets, three training-testing partitions, and horizons from 1 to 12 cycles. Selector performance is evaluated ex post using Global Relative Accuracy (GRA), statistical tests, and a best-attainable-model reference. No selector dominates across all conditions. CCG-AHSC and CCG-AHSCD are more competitive for Smooth demand and several Erratic configurations, whereas OWA and ERA perform better in Intermittent and Lumpy settings. Selector suitability also changes with historical data availability and horizon, supporting a context-dependent rather than universal approach to forecasting-model selection.

Explore similar work

Adaptive Automatic Model Selection for Demand Forecasting under Heterogeneous Demand Patterns
Feb 15, 2026Adolfo González, Víctor ParadaTime Series Forecasting Forecasting Benchmarks
Department of Computer Engineering and Informatics, Faculty of Engineering, University of Santiago of Chile, Santiago, Chile
Model selection with proper scoring rules on data sets of time series: prefer the mean scaled score
Jun 23, 2026Giorgio Corani, Stefano Damato, Dario Azzimonti +1Model Selection Time Series Forecasting
SUPSI, Istituto Dalle Molle di Studi sull’Intelligenza Artificiale (IDSIA), Lugano, Switzerland
Evaluation Choices Decide the Forecasting Leaderboard: Evidence from a Production Marketplace Panel
Aug 20, 2026Md Rezwanul Islam, Wael MohammedForecasting Benchmarks Benchmark Design
Field Nation LLC, Minneapolis, MN, USA

Feb 15, 2026, cs.LGJ/K move · Enter open · S save

Adaptive Automatic Model Selection for Demand Forecasting under Heterogeneous Demand Patterns

Adolfo González, Víctor Parada

Department of Computer Engineering and Informatics, Faculty of Engineering, University of Santiago of Chile, Santiago, Chile

Time Series Forecasting Forecasting Benchmarks

Open paper AskPDF arXiv

Demand forecasting is critical for inventory planning, procurement, replenishment, production, and capacity decisions in heterogeneous supply chains. However, selecting the most appropriate model for each demand series remains challenging because performance varies across datasets, demand structures, horizons, and evaluation metrics. This study proposes the Adaptive Hybrid Selector (AHS), an automatic model-selection rule that combines observed predictive performance with structural demand information. AHS uses demand frequency and series variability to activate a hierarchical logic based on RMSSE, MAE, sMAPE, and BIAS. The proposed selector is compared with Overall Weighted Average (OWA), a benchmark-relative criterion based on sMAPE and MASE, and Equilibrium Ranking Aggregation (ERA), a comparator based on MAE, RMSE, and R^2 rankings. The empirical evaluation uses the Walmart, M3, M4, and M5 datasets, three training-testing partitions, 22 forecasting models, and horizons of up to 12 cycles. Selector performance is assessed ex post using Global Relative Accuracy (GRA), interpreted as an indicator of volumetric coherence between accumulated forecasted demand and observed demand. Results show that AHS provides the most robust overall behavior, especially in M5, while OWA remains competitive in more regular datasets. ERA shows lower volumetric coherence in most configurations. These findings suggest that automatic model selection should account for demand structure and be evaluated using ex post indicators of volumetric coherence.

Abstract

Explore similar work

Adaptive Automatic Model Selection for Demand Forecasting under Heterogeneous Demand Patterns

Model selection with proper scoring rules on data sets of time series: prefer the mean scaled score

Evaluation Choices Decide the Forecasting Leaderboard: Evidence from a Production Marketplace Panel