Medical Image Benchmarks

Ask about this topic

Overview

Medical image benchmarks provide datasets, annotations, and shared protocols for comparing systems on tasks such as segmentation, diagnosis, image synthesis, and report generation across modalities including CT, MRI, X-rays, ultrasound, and pathology. They evaluate methods ranging from U-Net and nnU-Net models to vision transformers, foundation models, and multimodal language models, using measures such as Dice, AUROC, calibration, and expert review. A central challenge is whether strong results transfer across patients, hospitals, scanners, populations, and difficult cases; external testing, patient-level splits, and audits for leakage and shortcuts help expose gaps hidden by average scores. The field is moving toward workflow-based and evidence-grounded evaluation, but there is still tension between standardized, easily comparable scores and measures that reflect clinical safety, uncertainty, and real-world usefulness.

Latest papers

CardsList

339 papers31 papers in the last four weeks, up 7% on the four weeks before. 0.2% of all new papers.

  1. WBCBench 2026: A Challenge for Robust White Blood Cell Classification Under Class Imbalance

    Apr 12, 2026Xin Tian, Xudong Ma, Tianqi Yang +4White Blood Cell ClassificationMedical Image Classification

    University of Oxford, Oxford, United Kingdom · University College London, London, United Kingdom · University of Bristol, Bristol, United Kingdom +1

  2. MMRareBench: A Rare-Disease Multimodal and Multi-Image Medical Benchmark

    Apr 12, 2026Junzhi Ning, Jiashi Lin, Yingying Fang +9Medical Image BenchmarksMultimodal Model Evaluation

    Shanghai AI Laboratory · Imperial College London · Shanghai Jiao Tong University +1

  3. Benchmarking CNN- and Transformer-Based Models for Surgical Instrument Segmentation in Robotic-Assisted Surgery

    Apr 10, 2026Sara AmeliMedical Image SegmentationSemantic Segmentation

  4. Benchmarking Deep Learning for Future Liver Remnant Segmentation in Colorectal Liver Metastasis

    Apr 9, 2026Anthony T. Wu, Arghavan Rezvani, Kela Liu +4Medical Image Segmentation3D Medical Image Segmentation

    University of California, Irvine Donald Bren School of Information and Computer Science · University of California, Irvine School of Medicine

  5. Extending ZACH-ViT to Robust Medical Imaging: Corruption and Adversarial Stress Testing in Low-Data Regimes

    Apr 7, 2026Athanasios Angelakis, Marta Gomez-BarreroVision TransformerMedical Image Classification

    BioML Lab, RI CODE, UniBw, Munich, Germany · AUMC, Amsterdam, Netherlands

  6. MedLayBench-V: A Large-Scale Benchmark for Expert-Lay Semantic Alignment in Medical Vision Language Models

    Apr 7, 2026Han Jang, Junhyeok Lee, Heeseong Eum +1HealthcareMedical VLMs

    Seoul National University · Department of Radiology, Seoul National University Hospital · The Advanced Imaging and Computational Neuroimaging (AICON) Laboratory +2

  7. Temporal Inversion for Learning Interval Change in Chest X-Rays

    Apr 6, 2026Hanbin Ko, Kyungmin Jeon, Doowoong Choi +1Longitudinal Medical Image AnalysisMedical VLMs

    Interdisciplinary Program in Bioengineering, Seoul National University Graduate School · Integrated Major in Innovative Medical Science, Seoul National University Graduate School · Dept. of Radiology, Seoul National University Hospital +2

  8. Bridging Restoration and Diagnosis: A Comprehensive Benchmark for Retinal Fundus Enhancement

    Apr 4, 2026Xuanzhao Dong, Wenhui Zhu, Xiwen Chen +8Medical Image Quality AssessmentImage Enhancement

    Arizona State University · Clemson University · LinkedIn Corporation +1

  9. Managing Diabetic Retinopathy with Deep Learning: A Data Centric Overview

    Apr 2, 2026Shramana Dey, Zahir Khan, T. A. PramodKumar +5Medical Image BenchmarksDiabetic Retinopathy Grading

    Indian Statistical Institute, Kolkata, West Bengal, India · Dr. Mohan’s Diabetes Specialties Centre, Madras Diabetes Research Foundation, Chennai, Tamil Nadu, India · Department of Electrical Engineering, National Institute of Technology, Durgapur, West Bengal, India +1

  10. Curia-2: Scaling Self-Supervised Learning for Radiology Foundation Models

    Apr 2, 2026Antoine Saporta, Baptiste Callard, Corentin Dancette +5Medical Imaging Foundation ModelsMedical Imaging

    Raidium, 27 rue du Faubourg Saint-Jacques, 75014 Paris, France. · Department of Vascular and Oncological Interventional Radiology, Hôpital Européen Georges Pompidou, AP-HP, Paris, France · Faculté de Santé, Université Paris-Cité, Paris, France.

  11. DinoDental: Benchmarking DINOv3 as a Unified Vision Encoder for Dental Image Analysis

    Mar 30, 2026Kun Tang, Xinquan Yang, Mianjie Zheng +6Medical Image AnalysisVision Foundation Model Adaptation

    Shenzhen University. · Shenzhen University General Hospital. · Chongqing University.

  12. External Benchmarking of Lung Ultrasound Models for Pneumothorax-Related Signs: A Manifest-Based Multi-Source Study

    Mar 27, 2026Takehiro IshikawaMedical Image BenchmarksMedical Image Classification

    College of Computing, Georgia Institute of Technology, 801 Atlantic Drive NW, Atlanta, GA 30332, USA

  13. Colon-Bench: An Agentic Workflow for Scalable Dense Lesion Annotation in Full-Procedure Colonoscopy Videos

    Mar 26, 2026Abdullah Hamdi, Changchun Yang, Xin GaoVideo Object SegmentationMedical Image Analysis

    King Abdullah University of Science and Technology (KAUST)

  14. An Image Dataset of Common Skin Diseases of Bangladesh and Benchmarking Performance with Machine Learning Models

    Mar 26, 2026Sazzad Hossain, Saiful Islam, Muhammad Ibrahim +3Skin Lesion ClassificationMedical Image Classification

    Department of Computer Science and Engineering, Faridpur Engineering College, Faridpur, Bangladesh · Department of Computer Science and Engineering, University of Dhaka, Dhaka, Bangladesh · Department of Oncology, Labaid Cancer and Super Speciality Center, Dhaka, Bangladesh +1

  15. MedOpenClaw and MedFlowBench: Auditing Medical Agents in Full-Study Workflows

    Mar 25, 2026Weixiang Shen, Chengzhi Shen, Yanzhu Hu +12Medical VLMsMedical Image Benchmarks

    Technical University of Munich (TUM) · TUM University Hospital · LMU Munich +6

  16. Beyond Benchmarks: A Framework for Post Deployment Validation of CT Lung Nodule Detection AI

    Mar 25, 2026Daniel SolimanLung Nodule DetectionMedical Image Analysis

  17. VoDaSuRe: A Large-Scale Dataset Revealing Domain Shift in Volumetric Super-Resolution

    Mar 24, 2026August Leander Høeg, Sophia Wiinberg Bardenfleth, Hans Martin Kjer +3Image Super-ResolutionMedical Image Super-Resolution

    Technical University of Denmark, Kgs. Lyngby, Denmark

  18. CornOrb: A Multimodal Dataset of Orbscan Corneal Topography and Clinical Annotations for Keratoconus Detection

    Mar 22, 2026Mohammed El Amine Lazouni, Leila Ryma Lazouni, Zineb Aziza Elaouaber +8Medical Image BenchmarksMedical Image Analysis

    Biomedical Engineering Laboratory, Abou Bakr Belkaid University, Tlemcen, Algeria · LIST Laboratory, M’Hamed Bougara Boumerdes University, Algeria · Lazouni Clinic, Tlemcen, Algeria +3

  19. GOLDMARK: Governed Outcome-Linked Diagnostic Model Assessment Reference Kit

    Mar 21, 2026Chad Vanderbilt, Gabriele Campanella, Siddharth Singi +10Computational PathologyMedical Image Benchmarks

    Department of Pathology and Laboratory Medicine, Memorial Sloan Kettering Cancer Center, New York, NY, USA · Hasso Plattner Institute for Digital Health at Mount Sinai, Icahn School of Medicine at Mount Sinai, New York, NY, USA

  20. ReXInTheWild: A Unified Benchmark for Medical Photograph Understanding

    Mar 19, 2026Oishi Banerjee, Sung Eun Kim, Alexandra N. Willauer +9Medical VLMsMedical Image Benchmarks

    Department of Biomedical Informatics, Harvard Medical School, Boston, MA · National Strategic Technology Research Institute, Seoul National University Hospital, Seoul, Republic of Korea · Department of Medicine, Division of Gastroenterology, Massachusetts General Hospital, Boston, MA +3

  21. Gastric-X: A Multimodal Multi-Phase Benchmark Dataset for Advancing Vision-Language Models in Gastric Cancer Analysis

    Mar 19, 2026Sheng Lu, Hao Chen, Rui Yin +3Medical VLMsMedical Image Benchmarks

    Ruijin Hospital · University of Cambridge · Nanjing First Hospital +2

  22. Benchmarking CNN-based Models against Transformer-based Models for Abdominal Multi-Organ Segmentation on the RATIC Dataset

    Mar 19, 2026Lukas Bayer, Sheethal Bhat, Andreas MaierMedical Image SegmentationHybrid CNN-Transformer Architectures

    Pattern Recognition Lab Friedrich-Alexander-Universität Erlangen-Nürnberg

  23. MedForge: Interpretable Medical Deepfake Detection via Forgery-aware Reasoning

    Mar 19, 2026Zhihui Chen, Kai He, Qingyuan Lei +4Image Forgery DetectionExplainable Deepfake Detection

    National University of Singapore · The Chinese University of Hong Kong · Hunan University +2

  24. Mind the Rarities: Can Rare Skin Diseases Be Reliably Diagnosed via Diagnostic Reasoning?

    Mar 19, 2026Yang Liu, Jiyao Yang, Hongjin Zhao +10Rare Disease DiagnosisMedical VLMs

    Carnegie Mellon University · University of Alabama at Birmingham · Australian National University +3

  25. 3D MRI-Based Alzheimer's Disease Classification Using Multi-Modal 3D CNN with Leakage-Aware Subject-Level Evaluation

    Mar 18, 2026Md Sifat, Sania Akter, Akif Islam +5Alzheimer's Disease ClassificationMultimodal Classification

    Department of Computer Science and Engineering, University of Rajshahi, Rajshahi, Bangladesh · School of Computer Science and Engineering, University of Aizu, Aizuwakamatsu, Japan · Department of Computer Science and Engineering, Pabna University of Science and Technology, Pabna, Bangladesh

  26. A Comprehensive Benchmark of Histopathology Foundation Models for Kidney Digital Pathology Images

    Mar 16, 2026Harishwar Reddy Kasireddy, Patricio S. La Rosa, Akshita Gupta +12Pathology Foundation ModelsComputational Pathology

    Department of Electrical and Computer Engineering, University of Florida, Gainesville, FL, USA · Seed Production Innovation, Crop Science Division, Bayer Company, St. Louis, MO, USA · Division of Medicine – Quantitative Health, University of Florida, Gainesville, FL, USA +9

  27. LUMINA: A Multi-Vendor Mammography Benchmark with Energy Harmonization Protocol

    Mar 15, 2026Hongyi Pan, Gorkem Durak, Halil Ertugrul Aktas +9Mammography Image ClassificationMedical Image Harmonization

    Department of Radiology, Northwestern University, Chicago, IL, USA · Department of Radiation Oncology, University of Health Sciences Prof. Dr. Cemil Tascioglu City Hospital, Istanbul, Turkey · Department of Radiology, Istanbul University, Istanbul, Turkey

  28. Medical Image Spatial Grounding with Semantic Sampling

    Mar 15, 2026Andrew Seohwan Yu, Mohsen Hariri, Kunio Nakamura +3Medical VLMsMedical Image Grounding

    Case Western Reserve University, Cleveland OH 44106, USA · Cleveland Clinic, Cleveland OH 44106, USA

  29. A comprehensive multimodal dataset and benchmark for ulcerative colitis scoring in endoscopy

    Mar 15, 2026Noha Ghatwary, Jiangbei Yue, Ahmed Elgendy +8Medical Image BenchmarksEndoscopy

    Computer Engineering Department, Arab Academy for Science and Technology,Smart Village, Giza, Egypt · AI in Medicine and Surgery group, School of Computer Science, University of Leeds, LS2 9JT, Leeds, United Kingdom · Department of Electrical and Computer Engineering, Queen’s University, Canada +5

  30. Beyond Medical Diagnostics: How Medical Multimodal Large Language Models Think in Space

    Mar 14, 2026Quoc-Huy Trinh, Xi Ding, Yang Liu +73D Spatial ReasoningMultimodal Large Language Models