Overview

Medical image grounding studies how to connect clinical language—such as a finding in a report or an answer to a question—to the region, slice, or structure that provides visual evidence. This can make image-based diagnoses and reports easier to verify, and can reveal when a model gives a plausible answer without actually reading the image. Common approaches align reports with regions using weak supervision or boxes and masks, add anatomical priors and region prompts, or train vision-language models with grounding objectives, tools, and reinforcement learning. Benchmarks span chest X-rays, CT, MRI, ultrasound, and other modalities, but a central challenge remains: strong semantic answers do not guarantee precise localization, especially in 3D, across views, or under distribution shift.

Latest papers

CardsList

88 papers8 papers in the last four weeks, up 33% on the four weeks before. 0.1% of all new papers.

  1. ORGANIC3D: Grounding 3D CT Vision Language Models in Organ Level Image Text Coupling

    Nov 17, 2026Zelong Liu, Hamza Ahmed, Wynn Wingyi Lee +7Medical VLMs3D VLMs

  2. PeriaTrace: Tooth-Level Grounding Diagnosis and Patient-Facing Explanations from Periapical Radiographs

    Nov 17, 2026Zhenhuan Zhou, Yuchen Zhang, Jingbo Zhu +3Medical Report GenerationMedical Diagnosis

  3. QCAP-VQA: Question-Conditioned Capped Prior-Mass Supervision for Medical Visual Question Answering

    Nov 13, 2026Yining Zhao, Catarina Moreira, Mukesh Prasad +1Medical Visual Question AnsweringMedical Image Grounding

  4. Toward Foundation Detection Models via Example-Based Grounding in EM-DETR

    Nov 10, 2026Sheethal Bhat, Bogdan Georgescu, Awais Mansoor +3Medical Image Object DetectionMedical Imaging Foundation Models

  5. Aligning Medical Vision Language Models at the Capability Boundary with Entropy Adaptive Rubric Grounding

    Oct 29, 2026Hongyu Bai, Jiaqi Zeng, Chunzheng ZhuMedical VLMsReasoning for VLMs

  6. PathCowork: Learning from real-world pathology practice to build AI copilots

    Oct 29, 2026Sheng Wang, Jialu Yao, Maria V. Rossi +22Medical AI AgentsComputational Pathology

  7. A Visual Grounding Benchmark for Retinal OCT with Multimodal Large Language Models

    Oct 22, 2026Ronald Fecso, José Morano, Botond Fazekas +6Medical VLMsMedical Image Grounding

  8. APED-CXR: Adaptive Privileged Evidence Distillation for Chest X-Ray Grounding with Image-Only Inference

    Oct 21, 2026Md Shihabul Islam Shovo, Nishi Kanta Paul, Jamil FayyadMedical Image GroundingAdaptive Knowledge Distillation

  9. Carving Radiology Reports at Their Evidential Joints: Anatomical Region Sets as Generation Units

    Oct 21, 2026Jinwei Yang, Junhao Chen, Jianwei Zhao +3Radiology Report GenerationMedical Image Grounding

  10. PACE-MoE: Adaptive Domain Sampling and Domain-Specific LoRA for Medical Visual Grounding

    Oct 20, 2026Zhenxuan Wang, Jisheng Dang, Ronghao Lin +6Medical Image GroundingAdaptive Sampling

  11. Text-Guided Medical Image Segmentation via Residual Aggregation and Dense Alignment Representations

    Oct 10, 2026Jie Gui, Hang Tu, Yunfeng Dou +3Text-Guided Image SegmentationPromptable Image Segmentation

  12. ΔΔRepresentation: Geometry Supervised Representation Learning of Phenotypes via Counterfactual Reasoning for Medical VLMs

    Oct 7, 2026Hao Wang, Qiwei Zeng, Jinghao Lin +6Medical Image Representation LearningMedical VLMs

  13. BrainTRACE: Tracing Longitudinal, Multimodal, and Volumetric Evidence in Brain MRI Clinical Reasoning

    Oct 5, 2026Qizhen Lan, Mengchen Fan, Hang Zhang +5VLM Evaluation3D Medical Imaging

  14. Scaling 3D Visual Grounding in Abdominal CT

    Oct 2, 2026Sam Church, Danyal Maqbool, Joshua D. Warner +4Medical Image Grounding3D Visual Grounding

  15. Learning Where to Look: Anatomical Grounding and Guided Attention for Cardiac MRI Vision-Language Models

    Sep 30, 2026Bangwei Guo, Xiao Chen, Boris Mailhe +8Medical Visual Question AnsweringMedical Image Grounding

  16. Anatomical Grounding and Leakage-Aware Multimodal Contrastive Learning for Alzheimer's Disease Classification from Structural MRI

    Sep 14, 2026Paul-Gabriel Nicolae, Irina Georgiana MocanuLabel LeakageData Leakage

  17. Concept-Grounded Reasoning with Prompt-Driven Localization for Interpretable Structured Report Generation

    Sep 14, 2026Xinyue Xu, Hongbin Lin, Juangui Xu +5Radiology Report GenerationConcept Bottleneck Models

  18. MetaStructAtlas: A Grounded 3D Vision-Language Dataset and Benchmark for Functional and Structural Reasoning in Whole-Body PET/CT

    Sep 3, 2026Chenguang Zheng, Le Xue, Yichi Zhang +8PET/CT ImagingMedical VLMs

  19. AlphaRAD: Grounded Zero-Shot Classification in Chest Radiology via αα-Corrected Binary Cross Entropy and Factorized Latent Supervision

    Sep 1, 2026Jianzhong You, Yuan Gao, Chris McIntoshChest X-Ray ClassificationMedical Image Classification

  20. Instance-Guided Report Anchoring for Text-Free 3D Abnormality Segmentation in Chest CT

    Aug 31, 2026Zhenyu Bu, Haoyan Ding, Chushu Shen +7Medical Image Segmentation3D Medical Image Segmentation

  21. SlideBank: A Persistent Hierarchical Evidence Bank for Consistent Whole-Slide Reasoning

    Aug 31, 2026Beidi Zhao, Gexin Huang, Ciro Zhang +6Memory-Augmented VLMsMedical Visual Question Answering

  22. CheXGround: Anatomical Region Tokens for Grounded Longitudinal Chest X-ray Interpretation

    Aug 31, 2026Adonay Demewez Gebremedhin, Wessam Shehieb, Sara Alansari +4Radiology Report GenerationRadiology VLMs

  23. From Reasoning to Pixels: Grounded Medical Multimodal LLMs for VQA and Segmentation

    Aug 27, 2026Haowen Gu, Gensheng Pei, Junzhu Mao +3Medical VLMsMedical Image Grounding

  24. PerFact: Perception-Derived Fact Prompting for 3D Brain MRI Report Generation

    Aug 18, 2026Jianyu Sun, Zhenxuan Zhang, Guang Yang +1Radiology Report GenerationMedical VLMs

  25. Counterfactual Anatomy-guided Spatial-Temporal Decoding for Annotation-Free Hallucination Mitigation in Medical VLMs

    Aug 18, 2026Yifan Lu, Adinath Dukre, Abhijit Das +4VLM Hallucination MitigationMedical VLMs

  26. MedPixel: A Unified Pixel-Language Model for Medical Reasoning and Segmentation

    Aug 10, 2026Haoyu Yang, Meixing Shi, Zengjie Chen +5Medical VLMsVLM Reasoning

  27. EliSeg: Verified Target Construction for Report-Grounded Abnormality Segmentation

    Aug 7, 2026Chengyi Peng, Haoyu Yang, Meixing Shi +2Text-Guided Image SegmentationMedical Image Segmentation