ML Reproducibility

ML: Machine Learning

Overview

Machine learning reproducibility asks whether reported results can be recovered from the data, code, configurations, and execution environments—and whether they hold beyond one run. Common approaches include releasing versioned artifacts and provenance, standardizing benchmark splits and metrics, controlling seeds and numerical computation, and using independent replications with multi-seed uncertainty estimates. These methods are applied across settings such as LLM inference, biomedical prediction, recommender systems, and robotics, where results can shift with hardware, preprocessing, evaluation protocols, or data choice. A central tension is that deterministic reruns and executable code do not guarantee faithful reproduction or robust conclusions, while thorough audits and repeated experiments can be costly.

Latest papers

CardsList

154 papers17 papers in the last four weeks, down 39% on the four weeks before. 0.1% of all new papers.

  1. Glucose-ML: A collection of longitudinal diabetes datasets for development of robust AI solutions

    Jul 18, 2025Temiloluwa Prioleau, Baiying Lu, Yanjun CuiForecasting BenchmarksBlood Glucose Forecasting

  2. Code Benchmarks Should Prioritize Rigor, Reliability, and Reproducibility

    Jan 18, 2025Jialun Cao, Yuk-Kit Chan, Zixuan Ling +12Benchmark ConstructionBenchmark Design

  3. Real Faults in Deep Learning Fault Benchmarks: How Real Are They?

    Dec 20, 2024Gunel Jahangirova, Nargiz Humbatova, Jinhan Kim +2Software Engineering BenchmarksBenchmark Reproducibility

  4. Replicability is Asymptotically Free in Multi-armed Bandits

    Feb 12, 2024Junpei Komiyama, Shinji Ito, Yuichi Yoshida +1Multi-Armed BanditsML Reproducibility