cs.SEMar 16, 2026

Code Sharing In Prediction Model Research: A Scoping Review

Authors: Thomas Sounack, Raffaele Giancotti, Catherine A. Gao, Lasai Barreñada, Hyeonhoon Lee, Hyung-Chul Lee, Leo Anthony Celi, Karel G. M. Moons, +3 more

Organizations: Dana-Farber Cancer Institute · University of Calabria · Northwestern Feinberg School of Medicine · KU Leuven · Seoul National University Hospital · Seoul National University College of Medicine · Massachusetts Institute of Technology · Harvard T.H. Chan School of Public Health · UMC Utrecht · University of Birmingham · University Hospitals Birmingham NHS Foundation Trust · Harvard Medical School

Abstract

Analytical code is essential for reproducing diagnostic and prognostic prediction model research, yet code availability in the published literature remains limited. While the TRIPOD statements set standards for reporting prediction model methods, they do not define explicit standards for repository structure and documentation. This review quantifies current code-sharing practices to inform the development of TRIPOD-Code, a TRIPOD extension reporting guideline focused on code sharing. We conducted a scoping review of PubMed-indexed articles citing TRIPOD or TRIPOD+AI as of Aug 11, 2025, restricted to studies retrievable via the PubMed Central Open Access API. Eligible studies developed, updated, or validated multivariable prediction models. A large language model-assisted pipeline was developed to screen articles and extract code availability statements and repository links. Repositories were assessed with the same LLM against 14 predefined reproducibility-related features. Our code is made publicly available. Among 3,967 eligible articles, 12.2% included code sharing statements. Code sharing increased over time, reaching 15.8% in 2025, and was higher among TRIPOD+AI-citing studies than TRIPOD-citing studies. Sharing prevalence varied widely by journal and country. Repository assessment showed substantial heterogeneity in reproducibility features: most repositories contained a README file (80.5%), but fewer specified dependencies (37.6%; version-constrained 21.6%) or were modular (42.4%). In prediction model research, code sharing remains relatively uncommon, and when shared, often falls short of being reusable. These findings provide an empirical baseline for the TRIPOD-Code extension and underscore the need for clearer expectations beyond code availability, including documentation, dependency specification, licensing, and executable structure.

Figures & tables

Appendix figures & tables6 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. ReproAgent: Contract-Guided Paper-to-Code Reproduction

    Aug 25, 2026Xue Hu, Zewei Pan, Zhongyuan Wang +3Scientific Code GenerationAgentic Code Generation

  2. The Shift Toward Open and Reproducible AI Research

    Jun 15, 2026Kevin L Coakley, Thijs Snelleman, Holger Hoos +1ML ReproducibilityScientific Reproducibility

  3. Foundation Agents Meet Agentic Deep Research: Evidence-Grounded Clinical Code Forecasting

    Aug 17, 2026Junda Wang, Meysam Ghaffari, Akshat Choube +3Clinical PredictionDeep Research Agents