Dataset Collections: Challenges of Large-Scale Data Aggregation in 3D Medical Image Datasets
Organizations: Division of Medical Image Computing, German Cancer Research Center (DKFZ), Heidelberg, Germany · HIDSS4Health – Helmholtz Information and Data Science School for Health, Helmholtz Association, Karlsruhe/Heidelberg, Germany · Faculty of Mathematics and Computer Science, Heidelberg University, Heidelberg, Germany · Helmholtz Metadata Collaboration (HMC) Hub Health, German Cancer Research Center (DKFZ), Heidelberg, Germany ·
Abstract
The development of deep learning-based medical AI depends on high-quality annotated data. Yet, dataset creation remains constrained by the need for expert radiologist annotations, limiting curated datasets to relatively small cohorts. To overcome this limitation, recent efforts increasingly aggregate disparate public datasets into large-scale dataset collections. However, combining datasets at scale often obscures data provenance, introducing substantial risks of reuse propagation, unintended leakage, bias amplification and distorted data distributions. In this work, we study these problems on a massive collection of 565k 3D radiological images across 1034 public datasets and provide practical resources to address them. Firstly, we formalize dataset collections as a distinct paradigm in medical image analysis and characterize their structural challenges, including reuse propagation, duplication, and provenance fragmentation. Secondly, we perform a large-scale empirical study of duplication on this collection and demonstrate extensive exact and near-duplicate reuse across public datasets via perceptual hashing and manual tracing, identifying a lower bound of 118k duplicate pairs. We make the perceptual hashes publicly accessible for comparison through our website, providing researchers with a standardized reference for identifying potential overlaps and shared provenance. Thirdly, since hashing alone cannot detect all duplicates, we introduce MAP (Metadata for Aggregation and Provenance), a lightweight, portable metadata profile for documenting provenance, known overlaps, and deduplication decisions in dataset collections. Our contributions help dataset collections shift from coarse aggregations to reliable and provenance-aware data scaling mechanisms in medical image analysis. A web tool supporting our work is available at https://mic-dct.dkfz.de/.
Figures & tables
Appendix figures & tables6 assets
Supplementary material from the paper’s appendix.
Appendix
| Transformation | TPR | FPR | Top-1 errors |
|---|---|---|---|
| Intensity clipping HU | 0.962 | 0 | 3/883 |
| Cropping (2 voxels per side) | 0.087 | 0 | 8/883 |
| Padding (2 voxels per side) | 0.078 | 0 | 38/883 |
| Clipping + cropping | 0.085 | 0 | 7/883 |
| Name | Num. images | Link |
|---|---|---|
| A Combined Computational Modeling and Functional Imaging Study - Stage 2 (ds004529) [ 104 ] | 34 | openneuro.org |
| AbdomenAtlas 1.1 [ 48 , 105 , 27 , 29 ] | 9262 | huggingface.co |
| AbdomenCT-1K [ 44 , 106 , 53 , 107 , 56 , 108 ] | 996 | github.com |
| ACDC [ 109 ] | 300 | www.creatis.insa-lyon.fr |
| ACRIN-HNSCC-FDG-PET/CT [ 110 , 111 ] | 134 | www.cancerimagingarchive.net |
| AMOS 2022 [ 89 ] | 600 | zenodo.org |
Training Data Curation
Training data curation improves the quality, diversity, organization, and reliability of datasets used to train machine-learning models.
See all 166 papers