eess.IVNov 6, 2026

Dataset Collections: Challenges of Large-Scale Data Aggregation in 3D Medical Image Datasets

Authors: Yannick Kirchhoff, Saikat Roy, Elisa Stegmeier, Hamideh Haghiri, Constantin Ulrich, Maximilian Rouven Rokuss, Tassilo Wald, Karol Gotkowski, 

Organizations: Division of Medical Image Computing, German Cancer Research Center (DKFZ), Heidelberg, Germany · HIDSS4Health – Helmholtz Information and Data Science School for Health, Helmholtz Association, Karlsruhe/Heidelberg, Germany · Faculty of Mathematics and Computer Science, Heidelberg University, Heidelberg, Germany · Helmholtz Metadata Collaboration (HMC) Hub Health, German Cancer Research Center (DKFZ), Heidelberg, Germany · 

Abstract

The development of deep learning-based medical AI depends on high-quality annotated data. Yet, dataset creation remains constrained by the need for expert radiologist annotations, limiting curated datasets to relatively small cohorts. To overcome this limitation, recent efforts increasingly aggregate disparate public datasets into large-scale dataset collections. However, combining datasets at scale often obscures data provenance, introducing substantial risks of reuse propagation, unintended leakage, bias amplification and distorted data distributions. In this work, we study these problems on a massive collection of 565k 3D radiological images across 1034 public datasets and provide practical resources to address them. Firstly, we formalize dataset collections as a distinct paradigm in medical image analysis and characterize their structural challenges, including reuse propagation, duplication, and provenance fragmentation. Secondly, we perform a large-scale empirical study of duplication on this collection and demonstrate extensive exact and near-duplicate reuse across public datasets via perceptual hashing and manual tracing, identifying a lower bound of 118k duplicate pairs. We make the perceptual hashes publicly accessible for comparison through our website, providing researchers with a standardized reference for identifying potential overlaps and shared provenance. Thirdly, since hashing alone cannot detect all duplicates, we introduce MAP (Metadata for Aggregation and Provenance), a lightweight, portable metadata profile for documenting provenance, known overlaps, and deduplication decisions in dataset collections. Our contributions help dataset collections shift from coarse aggregations to reliable and provenance-aware data scaling mechanisms in medical image analysis. A web tool supporting our work is available at https://mic-dct.dkfz.de/.

Figures & tables

Appendix figures & tables6 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. VIDS: A Verified Imaging Dataset Standard for Medical AI

    Apr 19, 2026Joan S. Muthu, John ShalenMedical ImagingTraining Data Curation

  2. Medical Imaging AI Competitions Lack Fairness

    Dec 19, 2025Annika Reinke, Evangelia Christodoulou, Sthuthi Sadananda +34Medical Image BenchmarksDataset Bias