Medical Image Grounding

Follow this topic Ask about this topic

Momentum

3 papers in the last four weeks, down 50% on the four weeks before. 0.0% of all new papers.

Jul 13Week of Sep 28

Latest papers 59

All topics

$Δ$ Representation: Geometry Supervised Representation Learning of Phenotypes via Counterfactual Reasoning for Medical VLMs
Oct 7, 2026Hao Wang, Qiwei Zeng, Jinghao Lin +6Medical Image Representation Learning Medical VLMs
The University of Sydney · Shanghai Jiao Tong University · Northeastern University +1
BrainTRACE: Tracing Longitudinal, Multimodal, and Volumetric Evidence in Brain MRI Clinical Reasoning
Oct 5, 2026Qizhen Lan, Mengchen Fan, Hang Zhang +5VLM Evaluation 3D Medical Imaging
University of Texas Health Science Center at Houston · University of Alabama at Birmingham · University of Pittsburgh +3
Learning Where to Look: Anatomical Grounding and Guided Attention for Cardiac MRI Vision-Language Models
Sep 30, 2026Bangwei Guo, Xiao Chen, Boris Mailhe +8Medical VQA Medical Image Grounding
Rutgers University, NJ, USA · United Imaging Intelligence, Boston, MA, USA · University of Texas Southwestern Medical Center, TX, USA +1
Anatomical Grounding and Leakage-Aware Multimodal Contrastive Learning for Alzheimer's Disease Classification from Structural MRI
Sep 14, 2026Paul-Gabriel Nicolae, Irina Georgiana MocanuData Leakage Alzheimer's Disease Classification
Computer Science and Engineering Department, Faculty of Automatic Control and Computers, National University of Science and Technology POLITEHNICA Bucharest, Romania
Concept-Grounded Reasoning with Prompt-Driven Localization for Interpretable Structured Report Generation
Sep 14, 2026Xinyue Xu, Hongbin Lin, Juangui Xu +6Radiology Report Generation Concept Bottleneck Models
The Hong Kong University of Science and Technology · The Chinese University of Hong Kong · The Hong Kong University of Science and Technology (Guangzhou) +3
MetaStructAtlas: A Grounded 3D Vision-Language Dataset and Benchmark for Functional and Structural Reasoning in Whole-Body PET/CT
Sep 3, 2026Chenguang Zheng, Le Xue, Yichi Zhang +8PET/CT Imaging Medical VLMs
Huashan Hospital & Human Phenome Institute, Fudan University, Shanghai, China · Shanghai Academy of Artificial Intelligence for Science, Shanghai, China · Artificial Intelligence Innovation and Incubation Institute, Fudan University, Shanghai, China +1
AlphaRAD: Grounded Zero-Shot Classification in Chest Radiology via $α$ -Corrected Binary Cross Entropy and Factorized Latent Supervision
Sep 1, 2026Jianzhong You, Yuan Gao, Chris McIntoshChest X-Ray Classification Medical Image Classification
Peter Munk Cardiac Centre, University Health Network (UHN), Toronto, Canada · Ted Rogers Centre for Heart Research, Toronto, Canada · Vector Institute, Toronto, Canada +5
Instance-Guided Report Anchoring for Text-Free 3D Abnormality Segmentation in Chest CT
Aug 31, 2026Zhenyu Bu, Haoyan Ding, Chushu Shen +7Medical Image Segmentation 3D Medical Image Segmentation
Siemens Medical Solutions USA, Inc., Malvern, PA, USA · The Ohio State University, Columbus, OH, USA · University of California, Los Angeles, Los Angeles, CA, USA +2
SlideBank: A Persistent Hierarchical Evidence Bank for Consistent Whole-Slide Reasoning
Aug 31, 2026Beidi Zhao, Gexin Huang, Ciro Zhang +6Memory-Augmented VLMs Medical VQA
University of British Columbia · Vector Institute · Harvard University +3
CheXGround: Anatomical Region Tokens for Grounded Longitudinal Chest X-ray Interpretation
Aug 31, 2026Adonay Demewez Gebremedhin, Wessam Shehieb, Sara Alansari +4Radiology Report Generation Radiology VLMs
Ajman University Ajman, United Arab Emirates · University of Birmingham Birmingham, United Kingdom · Khalifa University Abu Dhabi, United Arab Emirates +1
MedPixel: A Unified Pixel-Language Model for Medical Reasoning and Segmentation
Aug 10, 2026Haoyu Yang, Meixing Shi, Zengjie Chen +5Medical VLMs VLM Reasoning
Zhejiang University · Fudan University · Kuaishou +2
EliSeg: Verified Target Construction for Report-Grounded Abnormality Segmentation
Aug 7, 2026Chengyi Peng, Haoyu Yang, Meixing Shi +2Text-Guided Image Segmentation Medical Image Segmentation
1Zhejiang University · 2Shanghai Artificial Intelligence Laboratory
Beyond Fluency: A Clinical Benchmark and Anomaly-Enhanced Baseline for Spine MRI Report Generation
Aug 7, 2026Bruno Palau, Franziska Vogt, Daria Laslo +4VLM Evaluation Radiology Report Generation
ETH Zurich, Switzerland · 2Swiss Institute of Bioinformatics (SIB), Switzerland
LocAnyMed: Vision-Language Grounding for Multimodal Medical Images
Aug 4, 2026Zihan Wang, Tong Liu, Zhiwei Wang +6Medical VLMs Medical Image Grounding
School of Computer Science, Wuhan University, Wuhan, China · College of Computing and Data Science, Nanyang Technological University, Singapore · Australian Artificial Intelligence Institute, School of Computer Science, University of Technology Sydney, Sydney, Australia +1
Location-Aware Fine-Grained Representation Learning for Medical Vision Foundation Models
Aug 2, 2026Myeongkyun Kang, Yanting Yang, Xiaoxiao LiMedical Imaging Foundation Models Medical Image Grounding
The University of British Columbia · Vector Institute
Semantically Calibrated Evidence Composition for CT Vision-Language Learning
Jul 31, 2026Guoliang You, Haifan Gong, Xiaomeng ChuMedical VLMs Medical Image Grounding
University of Pennsylvania · 2The Chinese University of Hong Kong, Shenzhen · 3Yale University
RadPRISM: Schema-stratified radiology-report supervision for concept-disentangled image representations and visual grounding
Jul 31, 2026Fabian Drexel, Marlene Fritzsche, Era Stambollxhiu +15Chest X-Ray Classification Disentangled Representation Learning
Chair for AI in Healthcare and Medicine, Technical University of Munich (TUM) and TUM University Hospital, Munich, Germany · Technical University of Munich, School of Medicine and Health, TUM University Hospital, Klinikum rechts der Isar, Department of Diagnostic and Interventional Radiology, Munich, Germany · Department of Radiology, Charité – Universitätsmedizin Berlin, corporate member of Freie Universität Berlin and Humboldt Universität zu Berlin, Berlin, Germany +5
LoMeVQA: A Comprehensive Benchmark for Longitudinal Medical VQA
Jul 30, 2026Zhilin Wu, Zhangkai Ni, Chengmei Yang +4Longitudinal Medical Image Analysis Medical VQA
Tongji University Shanghai, China · East China Normal University Shanghai, China
PanDent: Toward Comprehensive Tooth-Level Structure-Language Consistency in Dental Radiology
Jul 29, 2026Xiaohan Li, Xinyu Liu, Chang Liu +4Radiology Report Generation Medical Imaging
Faculty of Dentistry, The University of Hong Kong, Hong Kong, China · Department of Computing, Imperial College London, London, United Kingdom · University of Science and Technology of China, Hefei, China +2
Towards Grounded GI Endoscopy VQA via Multi-Task Learning on Small VLMs
Jul 29, 2026Itbaan Safwan, Ramail Khan, Muhammad Annas Shaikh +1Endoscopy Medical VQA
Institute of Business and Administration, Karachi, Pakistan
RadSight: Towards Perceptually Reliable Multimodal Radiology Image Understanding
Jul 24, 2026Jianqin Liu, Weiwei Cao, Wanxing Chang +7Radiology VLMs Medical Image Grounding
1DAMO Academy, Alibaba Group · University of Electronic Science and Technology of China
Spatially Grounded Concept Bottleneck Models for Trustworthy Breast Ultrasound Diagnosis
Jul 22, 2026Moshiur Rahman Tonmoy, Dunren Che, Haitham Y. Adarbah +1Concept Bottleneck Models Medical Image Classification
Department of Electrical Engineering and Computer Science, Texas A&M University–Kingsville (TAMUK), Kingsville, TX 78363, USA
Decouple and Reason: Anatomically Guided Two-Stage Voxel-Level Grounding of Free-Text Findings in 3D Chest CT
Jul 14, 2026Kwang-Hyun Uhm, Inhwa Son, Sung-Jea KoMedical Image Grounding Computed Tomography
Department of Artificial Intelligence, Gachon University, Republic of Korea · MEDAI, Republic of Korea
Super-Generalist: Towards Comprehensive and Accurate Medical Image Understanding via Generalist-Specialist Synergy
Jul 10, 2026Shaoteng Zhang, Weiwei Cao, Wanxing Chang +9Medical Image Classification Medical VLMs
DAMO Academy, Alibaba Group · Department of Radiology, Ningbo No. 2 Hospital, Ningbo, Zhejiang, China · Hupan Lab +5
GRCD: Grounded Region Change Detection for Multi-Finding Chest X-Ray Pairs
Jul 2, 2026OFM Riaz Rahman Aranya, Peyman Najafirad, Kevin DesaiRadiology Report Generation Medical Image Analysis
Department of Computer Science · The University of Texas at San Antonio · San Antonio, Texas, USA
Spatio-Temporal and Clinical Conditioning for Fine-Grained Radiology Report Retrieval
Jul 2, 2026P. Sloan, E. Simpson, M. MirmehdiRadiology Report Generation Medical Image Grounding
Department of Computer Science University of Bristol Bristol, UK
Synergistic Perception-Reasoning Governance: Grounding Medical MLLMs with Verifiable Anatomical Evidence
Jun 30, 2026Rui Hao, Qiankun Li, Junyuan Mao +4Radiology Report Generation Medical VQA
Huazhong University of Science and Technology, Wuhan, China · Imperial Global Singapore, Imperial College London, London, United Kingdom · Nanyang Technological University, Singapore, Singapore +2
Detecting Clinical Hallucinations in LVLMs via Counterfactual Visual Grounding Uncertainty
Jun 26, 2026Xiao Song, Haonan Qin, Zhaoxu Zhang +3Hallucination Detection in VLMs VLM Hallucination
School of Intelligent Science and Technology, Nanjing University, Suzhou, China · School of Biomedical Engineering, Nanjing University, Suzhou, China · National Institute of Healthcare Data Science at Nanjing University, Nanjing University, Nanjing, China
Enhancing Brain MRI Anomaly Detection and Reasoning with ROI Rethink and Synthetic Data
Jun 24, 2026Shangkun Li, Jie Xu, Yi Guo +2Medical Image Anomaly Detection VLM Reasoning
College of Biomedical Engineering, Fudan University, Shanghai, China
E-MRL: Cross-view Aligned Evidence-driven Multimodal Reinforcement Learning for Reliable 3D Tumor Analysis
Jun 22, 2026Sijing Li, Zhongwei Qiu, Zhuoya Wang +6Medical Image Grounding VLM Hallucination Mitigation
Zhejiang University · DAMO Academy, Alibaba Group · Hupan Lab +3

Oct 7, 2026, cs.CVJ/K move · Enter open · S save

$Δ$ Representation: Geometry Supervised Representation Learning of Phenotypes via Counterfactual Reasoning for Medical VLMs

Hao Wang, Qiwei Zeng, Jinghao Lin, Shuchang Ye+5

The University of Sydney · Shanghai Jiao Tong University · Northeastern University+1

Medical Image Representation Learning Medical VLMs Medical Image Grounding Geometric Representation Learning

Open paper AskPDF arXiv

Medical vision-language models (VLMs) have shown increasing potential for radiological image interpretation. Medical VLMs encode radiological images into visual representations that capture both anatomical and phenotypic information for diagnosis. Existing approaches improve pathological phenotype representations through semantic-guided representation alignment. However, pathological phenotypes arise as lesion-specific visual changes superimposed on underlying normal anatomy. Such semantic alignment approaches fail to model the phenotype-specific increment relative to the corresponding normal anatomical representation. To address this gap, we propose \textbf{

Δ

Representation}, a visual phenotype representation learning framework based on counterfactual reasoning for medical VLMs. It comprises \textbf{BaseAnatomy}, a geometry-supervised representation learning module, and \textbf{

Δ

Phenotype}, a counterfactual incremental representation learning module. BaseAnatomy provides fine-grained geometric supervision through spatial relationships across and within anatomical structures.

Δ

Phenotype computes the representation increment between lesion representations and their corresponding normal anatomical representations, and supervises increments associated with the same phenotype to cluster in the representation space. Experiments on \textit{ReXGroundingCT} and \textit{LIDC-IDRI} demonstrate that

Δ

Representation effectively structures pathological phenotype representations and improves lesion grounding and phenotype characterization accuracy in medical VLMs. Code is available at https://anonymous.4open.science/r/deltarep-CF6D.

Momentum

Related topics

Latest papers 59