Overview

Medical image benchmarks provide datasets, annotations, and shared protocols for comparing systems on tasks such as segmentation, diagnosis, image synthesis, and report generation across modalities including CT, MRI, X-rays, ultrasound, and pathology. They evaluate methods ranging from U-Net and nnU-Net models to vision transformers, foundation models, and multimodal language models, using measures such as Dice, AUROC, calibration, and expert review. A central challenge is whether strong results transfer across patients, hospitals, scanners, populations, and difficult cases; external testing, patient-level splits, and audits for leakage and shortcuts help expose gaps hidden by average scores. The field is moving toward workflow-based and evidence-grounded evaluation, but there is still tension between standardized, easily comparable scores and measures that reflect clinical safety, uncertainty, and real-world usefulness.

Latest papers

CardsList

373 papers34 papers in the last four weeks, up 3% on the four weeks before. 0.3% of all new papers.

  1. SEEC: A Large-Scale Dataset and Benchmark for Self-Supervised External-Eye Representation Learning

    Nov 19, 2026George R. Nahass, Michelle Fleishaker, Sanjay Ganesh +6Medical Image Representation LearningMedical Image Benchmarks

  2. Harnessing Medical Visual-Language Models with Agentic Evidence Management

    Nov 19, 2026Qiming Huang, Hanze Dong, Jipeng Zhang +3Tool Use in VLMsMedical Visual Question Answering

  3. HEmIF-Bench: Benchmarking H&E-to-mIF Models BeyondVirtual-StainFidelity

    Nov 15, 2026Fuxian Zhao, Hyokeun ParkComputational PathologyVirtual Staining

  4. CaseScope: A Multi-Field Benchmark for Case-Level Pathology Diagnosis with Multimodal LLMs

    Nov 11, 2026Wenchuan Zhang, Chengyang Zhang, Fengling Li +9Computational PathologyMedical Image Benchmarks

  5. GingivitisSeg: A Public Dataset and Comparative Benchmark for Gingivitis Segmentation in Intraoral Images

    Nov 11, 2026Zeynep Ozdemir, Zehra Hasgul, Irem Ulku +3Medical Image SegmentationDental Imaging

  6. The BRIDGE dataset: paired brightfield whole-slide images of prostate core-needle biopsies in paraffin, after deparaffinization and H&E staining

    Nov 10, 2026Julia A. Mielcarz, Justyna Durślewicz, Marek Zdrenka +5Medical Image BenchmarksWhole-Slide Image Analysis

  7. Rethinking Evaluation for Video Capsule Endoscopy: Validation Protocol, Source-Video Diversity, and Cross-Dataset Shift

    Nov 9, 2026Smriti Regmi, Debesh JhaEndoscopyMedical Image Classification

  8. LUCQUE: A lung cancer screening dataset from Québec for reliable AI evaluation

    Nov 9, 2026Johanna Topalis, Yannick Lemaréchal, Gabriel Couture +7LDCT ReconstructionMedical Image Benchmarks

  9. Benchmarking CNNs, Vision Transformers, and Foundation Models for Explainable Brain Tumor MRI Classification: Calibration, Decision Analysis, and External Validation

    Nov 9, 2026Akwasi AsareBrain Tumor ClassificationMedical Imaging

  10. 3D Segmentation in the Clinic: A Grand Challenge

    Nov 7, 2026Bram van Ginneken, Tobias Heimann, Martin StynerLiver Lesion SegmentationMedical Image Segmentation

  11. Beyond Segmentation: Enriching ImageCAS with Coronary Ostia Landmarks, Rooted Centerline Graphs, and Open-Weight Localization Models

    Nov 6, 2026Matteo Leccardi, Andrea Moglia, Marco Morandini +8Medical Image LocalizationAnatomical Landmark Detection

  12. Overview of the ImageCLEFmedical 2026 GANs task: Exploring fingerprint detection, privacy leakage, and synthetic medical image generation

    Nov 6, 2026Alexandra-Georgiana Andrei, Mihai Gabriel Constantin, Mihai Dogariu +8Synthetic Data GenerationGenerative Adversarial Networks

  13. Leakage- and Label-Aware Benchmarking of Class-Imbalance Strategies for Multimodal Chest X-Ray and EHR Classification

    Nov 5, 2026Dang-Khoa Bui, Quang-Huy Tran, Minh-Khoi Nguyen-Bui +4Medical Image BenchmarksData Leakage

  14. Nanopath: Fast, Fair, Open Experimentation for Pathology Foundation Models

    Nov 4, 2026Paul S. Scotti, Hassan Muhammad, Ryan Kim +9Computational PathologyPathology Foundation Models

  15. Trick-or-Treat: Adversarial Evaluation of Multimodal Medical Reasoning with Synthetic Images

    Nov 4, 2026Oishi Banerjee, Eujin Lee, Sung Eun Kim +4Multimodal Model EvaluationMultimodal Reasoning

  16. Representation Learning for 3D Brain Imaging: A Benchmark

    Nov 4, 2026Pierre Falconnier, Robin Trombetta, Nicolas Duchateau +1Medical Image Representation Learning3D Medical Imaging

  17. Reliability-Aware Benchmarking of Self-Supervised Learning in Histopathology Under 1-10% Label Regimes

    Nov 4, 2026Alicem Koyun, Pranjali Changadeo Pingale, Sachin Mote +1Self-Supervised LearningHistopathology Image Classification

  18. Lesion Overlap Ranks PET Segmentation Models but Does Not Certify Patient-Level Tumor Burden

    Nov 3, 2026Tushar Kataria, Gerald Sabin, Ponnuswamy Sadayappan +1PET/CT Tumor SegmentationMedical Image Segmentation

  19. OpenBrain: An Auditable Generated-Label Release for Whole-Brain MRI Parcellation

    Nov 3, 2026Qizhen Lan, Yu-Chun Hsu, Yuxiang Wei +5Brain MRIMedical Image Segmentation

  20. When Cell Crops Share a Parent: Measuring and Isolating Acquisition Leakage in Cervical Cytology Benchmarks

    Nov 3, 2026Snehasish Ghosh, Soham Mitra, Antareep Majumdar +2Data LeakageMedical Image Benchmarks

  21. MedHEB: Benchmarking Medical Embeddings Across Heterogeneous Clinical Evidence

    Nov 2, 2026Yingshu Li, Shaoyang Zhou, Zhanyu Wang +6Multimodal IRMultimodal Embedding

  22. CellPlex: Benchmarking Single-Cell Spatial Proteomics Prediction from H&E

    Nov 2, 2026Zijun Gao, Yijiang Chen, Xiangde Luo +1Virtual StainingMedical Image Benchmarks

  23. Deep Learning for Cervical Cytology Screening: Methods, Algorithms, Challenges and Prospects

    Nov 1, 2026Jiang Yangbo, Zheng NengganMedical Image ClassificationComputational Pathology

  24. BRACHIO: Broad Representations Across Centres for Head-and-neck Imaging Oncology (HECKTOR 2026)

    Oct 29, 2026Roxanne De Maeyer, Ine Dirks, Yannick Brackenier +3OncologyPET/CT Tumor Segmentation

  25. DINOv2 for PET: A Pre-Training Domain Benchmark Across Classification, Segmentation, and Prognosis

    Oct 29, 2026Roxanne De Maeyer, Yannick Brackenier, Vicky De Ridder +3Medical Image AnalysisMedical Image Representation Learning

  26. Interpretable Deep Learning Models for Breast Cancer Diagnosis Using Medical Imaging

    Oct 27, 2026Sami Alnawali, Muhammad Atif Saeed, Abdul Hadi +3Explainable Medical Image AnalysisHistopathology Image Classification