Forecasting Benchmarks

Follow this topic Ask about this topic

Momentum

21 papers in the last four weeks, up 250% on the four weeks before. 0.2% of all new papers.

Jul 13Week of Sep 28

Latest papers 147

All topics

AirQualityBench: A Realistic Evaluation Benchmark for Global Air Quality Forecasting
May 7, 2026Xing Xu, Xu Wang, Yudong Zhang +3Benchmark Design Time Series Forecasting
University of Science and Technology of China (USTC), Hefei, Anhui, China · 2Suzhou Institute for Advanced Research, USTC, Suzhou, Jiangsu, China · 3The Hong Kong Polytechnic University, Hong Kong, China
OracleProto: A Reproducible Framework for Benchmarking LLM Native Forecasting via Knowledge Cutoff and Temporal Masking
May 5, 2026Yiding Ma, Chengyun Ruan, Kaibo Huang +2LLM Evaluation Forecasting Benchmarks
Beijing University of Posts and Telecommunications
FinSTaR: Towards Financial Reasoning with Time Series Reasoning Models
May 5, 2026Seunghan Lee, Jun Seo, Jaehoon Lee +7Time Series Reasoning CoT Reasoning
LG AI Research · Seoul, South Korea
CombinationTS: A Modular Framework for Understanding Time-Series Forecasting Models
May 2, 2026Xiaorui Wang, Fanda Fan, Chenxi Wang +9Time Series Forecasting Forecasting Benchmarks
Institute of Computing Technology, Chinese Academy of Sciences, Beijing, China · University of Chinese Academy of Sciences, Beijing, China · Beijing Normal University - Hong Kong Baptist University United International College, Zhuhai, China +1
Extreme Weather Bench: A framework and benchmark for evaluation of high-impact weather
May 1, 2026Amy McGovern, Taylor Mandelbaum, Daniel Rothenberg +6Forecasting Benchmarks Weather Forecasting
Brightband, San Francisco, CA, USA. · School of Meteorology and School of Computer Science, University of Oklahoma, Norman, 73072, OK, USA. · Bureau of Meteorology, Australia. +5
From Prediction to Practice: A Task-Aware Evaluation Framework for Blood Glucose Forecasting
May 1, 2026Alireza Namazi, Heman ShakeriHealthcare Clinical Decision Support
Department of Computer Science University of Virginia Charlottesville, VA, USA · School of Data Science University of Virginia Charlottesville, VA, USA
Foresight Arena: An On-Chain Benchmark for Evaluating AI Forecasting Agents
May 1, 2026Maksym Nechepurenko, Pavel ShuvalovAI Agent Evaluation Forecasting Benchmarks
Director of Research, Devnull, Dubai, UAE · Chief Technology Officer, Devnull, Dubai, UAE
Electricity price forecasting across Norway's five bidding zones in the post-crisis era
Apr 29, 2026My Thi Diem Phan, Trung Tuyen Truong, Hoai Phuong Ha +1Electricity Price Forecasting Time Series Forecasting
Independent researcher · Department of Mathematics, University of Oslo · Department of Computer Science, The Arctic University of Norway +1
Evaluating Strategic Reasoning in Forecasting Agents
Apr 28, 2026Tom Liptay, Dan Schwarz, Rafael Poyiadzi +2LLM Agent Evaluation Forecasting Benchmarks
FutureSearch
Energy-Arena: A Dynamic Benchmark for Operational Energy Forecasting
Apr 27, 2026Max Kleinebrahm, Jonathan Berrisch, Philipp Eiser +11Benchmark Design Time Series Forecasting
Karlsruhe Institute of Technology, Institute for Industrial Production, Karlsruhe, Germany · University of Duisburg-Essen, House of Energy Markets and Finance, Essen, Germany · Karlsruhe Institute of Technology, Institute for Automation and Applied Informatics, Eggenstein-Leopoldshafen, Germany +5
Machine Learning and Deep Learning Models for Short Term Electricity Price Forecasting in Australia's National Electricity Market
Apr 26, 2026Wei Lu, Jay Wang, Dingli Duan +3Gradient-Boosted Decision Trees Electricity Price Forecasting
School of Engineering, Computer & Mathematical Sciences, Auckland University of Technology (AUT), Auckland 1010, New Zealand · Department of Thermal Energy and Power Engineering, Yantai University, Yantai, China · Department of Building Environment and Equipment, School of Civil Engineering, Hefei University of Technology, Hefei, China +1
FETS Benchmark: Foundation Models Outperform Dataset-specific Machine Learning in Energy Time Series Forecasting
Apr 24, 2026Marco Obermeier, Marco Pruckner, Florian Haselbeck +1Time Series Forecasting Forecasting Benchmarks
Julius-Maximilians-Universität Würzburg, Modeling and Simulation Lab, Am Hubland, Würzburg, 97074, Germany · Weihenstephan-Triesdorf University of Applied Sciences, Smart Farming, Am Staudengarten 1, Freising, 85354, Germany · Weihenstephan-Triesdorf University of Applied Sciences, Digital Energy Transition, Hans-Carl-von-Carlowitz-Platz 3, Freising, 85354, Germany
Deep FinResearch Bench: Evaluating AI's Ability to Conduct Professional Financial Investment Research
Apr 22, 2026Mirazul Haque, Antony Papadimitriou, Samuel Mensah +6Quantitative Finance Deep Research Agents
AI Research, JPMorganChase
Agentic Forecasting with Structured Linguistic Beliefs
Apr 20, 2026Kevin MurphyForecasting Benchmarks Probabilistic Forecasting
Department of Computer Science University of British Columbia Vancouver, BC, Canada
IDOBE: Infectious Disease Outbreak forecasting Benchmark Ecosystem
Apr 20, 2026Aniruddha Adiga, Jingyuan Chou, Anshul Chiranth +7Epidemic Forecasting Forecasting Benchmarks
Biocomplexity Institute, University of Virginia, Charlottesville, Virginia, USA · Department of Public and Ecosystem Health Cornell University College of Veterinary Medicine, Ithaca, New York, USA · Johns Hopkins University, Baltimore, Maryland, USA +2
CT Open: An Open-Access, Uncontaminated, Live Platform for the Open Challenge of Clinical Trial Outcome Prediction
Apr 17, 2026Jianyou Wang, Youze Zheng, Longtian Bao +11Healthcare Forecasting Benchmarks
Laboratory for Emerging Intelligence, University of California, San Diego · Elsevier · Department of Dermatology, University of California, San Diego
QuantSightBench: Evaluating LLM Quantitative Forecasting with Prediction Intervals
Apr 17, 2026Jeremy Qin, Maksym AndriushchenkoLLM Evaluation Forecasting Benchmarks
ELLIS Institute Tübingen · Max Planck Institute for Intelligent Systems · Tübingen AI Center
TempusBench: An Evaluation Framework for Time-Series Forecasting
Apr 13, 2026Denizalp Goktas, Gerardo Riaño-Briceño, Omkar Tekawade +14Time Series Forecasting Forecasting Benchmarks
Simulacrum New York City, NY, USA
PreScience: A Dataset and Benchmark for Scientific Forecasting
Feb 24, 2026Anirudh Ajith, Amanpreet Singh, Jay DeYoung +7AI for Science Forecasting Benchmarks
Allen Institute for Artificial Intelligence, Seattle, WA, USA · Knowledge Lab, University of Chicago, Chicago, IL, USA · School of Computer Science and Engineering, Hebrew University of Jerusalem, Israel +1
Adaptive Automatic Model Selection for Demand Forecasting under Heterogeneous Demand Patterns
Feb 15, 2026Adolfo González, Víctor ParadaTime Series Forecasting Forecasting Benchmarks
Department of Computer Engineering and Informatics, Faculty of Engineering, University of Santiago of Chile, Santiago, Chile
OccStress: Stress-Testing the 4D Occupancy Forecasting Chain
Dec 17, 2025Yu Zheng, Jie Hu, Jiaqi Xiong +4Forecasting Benchmarks 3D Occupancy Prediction
Hunan University · ETH Zurich
Scriboora: Rethinking Human Pose Forecasting
Nov 19, 2025Daniel Bermuth, Alexander Poeppel, Wolfgang ReifForecasting Benchmarks Human Pose Estimation
University of Augsburg, Germany
From Leakage to Fidelity: Reliable Benchmarking for Temporal Cascade Prediction
Oct 29, 2025Jie Peng, Rui Wang, Qiang Wang +4Forecasting Benchmarks Temporal Data Leakage
Renmin University of China · Alibaba
fev-bench: A Realistic Benchmark for Time Series Forecasting
Sep 30, 2025Oleksandr Shchur, Abdul Fatir Ansari, Caner Turkmen +5Benchmark Design Time Series Forecasting
AWS · Keystone AI · Prior Labs +2
Glucose-ML: A collection of longitudinal diabetes datasets for development of robust AI solutions
Jul 18, 2025Temiloluwa Prioleau, Baiying Lu, Yanjun CuiForecasting Benchmarks Blood Glucose Forecasting
Department of Computer Science Emory University Atlanta, GA 30322 · Department of Computer Science Dartmouth College Hanover, NH 03755
CanadaFireSat: Toward high-resolution wildfire forecasting with multiple modalities
Jun 10, 2025Hugo Porta, Emanuele Dalsasso, Jessica L. McCarty +1Wildfire Forecasting Forecasting Benchmarks
EPFL, Route des Ronquos 86, Sion, 1950, Wallis, Switzerland · Université Grenoble Alpes, Inria, CNRS, Grenoble INP, LJK, Grenoble, 38000, France · NASA Ames Research Center, Earth Science Division„ Moffett Field, California, 94035, USA
OpenFinGym: A Verifiable Multi-Task Gym Environment for Evaluating Quant Agents
Date pendingKaicheng Zhang, Wen Ge, Lei Jiang +5Quantitative Finance LLM Agent Evaluation
University of Edinburgh · University College London · Alan Turing Institute +1

May 7, 2026, cs.AIJ/K move · Enter open · S save

AirQualityBench: A Realistic Evaluation Benchmark for Global Air Quality Forecasting

Xing Xu, Xu Wang, Yudong Zhang, Huilin Zhao+2

University of Science and Technology of China (USTC), Hefei, Anhui, China · 2Suzhou Institute for Advanced Research, USTC, Suzhou, Jiangsu, China · 3The Hong Kong Polytechnic University, Hong Kong, China

Benchmark Design Time Series Forecasting Forecasting Benchmarks Air Quality Prediction Spatiotemporal Forecasting

Open paper AskPDF arXiv

Air-quality forecasting models are commonly evaluated on regional, preprocessed, and normalized datasets, where missing observations are removed or artificially completed. Such protocols simplify comparison but hide the conditions that dominate real monitoring networks: uneven global coverage, structured missingness, heterogeneous pollutant scales, and deployment cost. We introduce \textbf{AirQualityBench}, a global multi-pollutant benchmark designed to evaluate forecasting models under these realistic conditions. The benchmark contains hourly observations from 3,720 monitoring stations over 2021--2025, covers six major pollutants, and preserves provider-native observation masks. Rather than imputing a dense data tensor, AirQualityBench exposes missingness as part of the forecasting problem and reports errors on valid future observations after inverse transformation to physical concentration scales. Evaluating representative spatio-temporal models under this unified protocol shows that strong performance on sanitized datasets does not reliably transfer to global, fragmented monitoring streams. AirQualityBench therefore serves as a realistic testbed for scalable, mask-aware, and physically interpretable air-quality forecasting. All benchmark data, code, evaluation scripts, and baseline implementations are available at GitHub.

Momentum

Related topics

Latest papers 147