cs.LGMar 19, 2026

Rolling-Origin Validation Reverses Model Rankings in Multi-Step PM10 Forecasting: XGBoost, SARIMA, and Persistence

Authors: Federico Garcia Crespi, Eduardo Yubero Funes, Marina Alfosea Simon

Organizations: Departamento de Ingeniería de Computadores, Universidad Miguel Hernández, Elche, Spain · Departamento de Física Aplicada, Universidad Miguel Hernández, Elche, Spain

Abstract

(a) Many air quality forecasting studies report gains from machine learning, but evaluations often use static chronological splits and omit persistence baselines, so the operational added value under routine updating is unclear. (b) Using 2,350 daily PM10 observations from 2017 to 2024 at an urban background monitoring station in southern Europe, we compare XGBoost and SARIMA against persistence under a static split and a rolling-origin protocol with monthly updates. We report horizon-specific skill and the predictability horizon, defined as the maximum horizon with positive persistence-relative skill. Static evaluation suggests XGBoost performs well from one to seven days ahead, but rolling-origin evaluation reverses rankings: XGBoost is not consistently better than persistence at short and intermediate horizons, whereas SARIMA remains positively skilled across the full range. (c) For researchers, static splits can overstate operational usefulness and change rankings. For practitioners, rolling-origin, persistence-referenced skill profiles show which methods stay reliable at each lead time.

Figures & tables

Explore similar work

CardsList
  1. Interpretable PM2.5 Forecasting for Urban Air Quality: A Comparative Study of Operational Time-Series Models

    Mar 26, 2026Moazzam Umer Gondal, Hamad ul Qudous, Asma Ahmad Farhan +1Air Quality PredictionTime Series Forecasting

  2. Benchmarking Scientific Machine Learning Models for Air Quality Data

    Mar 22, 2026Khawja Imran Masud, Venkata Sai Rahul Unnam, Sahara AliAir Quality PredictionForecasting Benchmarks

  3. Quantifying Protocol-Induced Uncertainty in Comparative Predictive-Model Evaluation: Evidence from Large-Scale Daily PM10 Forecasting

    Aug 26, 2026Rafael da Silva, Kiersten MonahanModel SelectionForecasting Benchmarks