Radiology VLMs

VLM: Vision-Language Model

Follow this topic Ask about this topic

Momentum

7 papers in the last four weeks, up 75% on the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28

Latest papers 59

All topics

Geometry-Supervised Visual Representation Learning for Multi-Phenotype Lesion Interpretation in Medical VLMs
Oct 7, 2026Hao Wang, Qiwei Zeng, Shuchang Ye +5Visual Representation Learning Medical Image Representation Learning
The University of Sydney · Shanghai Jiao Tong University · Northeastern University
Anatomy-aware Fine-grained Multimodal Fusion for Laryngopharyngeal Cancer T-Staging Prediction Using CT and Radiology Report
Oct 5, 2026Xingyue Zhao, Yanzhou Su, Fang Zhang +12Radiology VLMs Multimodal Classification
DAMO Academy, Alibaba Group · Department of Neurosurgery, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China · Hupan Laboratory, Hangzhou, China +6
Unmentioned Checklist Findings Change How Reinforcement Learning Appears to Improve Chest Radiograph Report Checking
Oct 4, 2026Ali Vosoughi, Akhil Kasturi, Chenliang Xu +1Radiology VLMs Radiology Report Evaluation
Department of Computer Science, University of Rochester, Rochester, NY 14627, USA. · Department of Electrical and Computer Engineering, University of Rochester, Rochester, NY 14627, USA. · Department of Imaging Sciences, University of Rochester Medical Center, Rochester, NY 14642, USA. +1
PLRS-IC: A Dual-Calibration Framework for Chest X-Ray Vision-Language Alignment
Sep 30, 2026Qixing Zhao, Jinpeng LiRadiology VLMs Vision-Language Alignment
South China University of Technology
SentZero: An Enhanced Sentence-Centric Vision-Language Pretraining for Multi-Task Zero-Shot Chest X-Ray Analysis
Sep 28, 2026Hangyul Yoon, Hyungyung Lee, Edward Choi +1Contrastive Learning Radiology VLMs
Kim Jaechul Graduate School of AI, Korea Advanced Institute of Science and Technology (KAIST)
Med-AR: Autoregressive Vision-Language Pretraining for Long-Tailed Chest X-Ray Classification and Uncertainty-Aware Evaluation
Sep 24, 2026Janhavi Prabhu, Sahil, Akshay V +3Long-Tailed Classification Chest X-Ray Classification
Qure.ai, Bangalore, India
NV-Reason-CT: 3D Visual Language Model for CT Analysis
Sep 23, 2026Andriy Myronenko, Dong Yang, Yucheng Tang +13Radiology Report Generation Radiology VLMs
NVIDIA, Santa Clara, CA · NIH, Bethesda, MD · University of Oxford, Oxford, UK +4
ModaLens: Measuring Image Sensitivity in Report-Conditioned Medical VLMs
Sep 14, 2026Sebastián Andrés Cajas Ordóñez, Maximin Lange, Quang Bui +9VLM Evaluation Radiology VLMs
MIT Critical Data, Massachusetts Institute of Technology · King’s College London · American International School Vienna +6
A radiographic world model for clinical reasoning and evidence generation
Sep 7, 2026Suyang Xi, Songtao Hu, Shansong Wang +8Chest X-Ray Classification Radiology VLMs
Department of Computer Science and Informatics, Emory University, Atlanta, GA, USA. · Department of Radiation and Cellular Oncology, The University of Chicago, Chicago, IL, USA. · Department of Radiation Oncology and Winship Cancer Institute, Emory University, Atlanta, GA, USA. +2
NeoRed: A Knowledge-Logic-Alignment Multimodal Large Language Model for Neonatal Respiratory Disease Diagnosis
Sep 3, 2026Yinan Liu, Hongtai Xia, Haoran Xu +3Radiology Report Generation Chest X-Ray Classification
School of Computer Science and Technology, Tongji University Shanghai, China
Solving the Needle-in-a-Haystack Problem in Mammography Vision-Language Model with Differentiable Subset Sampling
Sep 2, 2026Young Seok Jeon, Beatrice Brown-Mulry, Rohan Satya Isaac +5Radiology VLMs Medical Image Localization
Department of Radiology, Emory University, Atlanta, GA, USA
CheXGround: Anatomical Region Tokens for Grounded Longitudinal Chest X-ray Interpretation
Aug 31, 2026Adonay Demewez Gebremedhin, Wessam Shehieb, Sara Alansari +4Radiology Report Generation Radiology VLMs
Ajman University Ajman, United Arab Emirates · University of Birmingham Birmingham, United Kingdom · Khalifa University Abu Dhabi, United Arab Emirates +1
How Good are Foundation Models in Longitudinal MRI Disease Progression Reasoning?
Aug 13, 2026Wafa Al Ghallabi, Ritesh Thawkar, Sara Ghaboura +6Radiology VLMs Medical Image Analysis
Mohamed bin Zayed University of Artificial Intelligence, Abu Dhabi, UAE · Department of Health Abu Dhabi, Abu Dhabi, UAE · Fatima College of Health Sciences, Abu Dhabi, UAE +1
Resolution Meets Reduction: Efficient Visual Context for 3D Radiology Report Generation
Aug 9, 2026Jonathan Suprijadi, Raphael Stock, Moritz Langenberg +10Radiology Report Generation Radiology VLMs
Division of Medical Image Computing, German Cancer Research Center (DKFZ), Heidelberg, Germany
Positive-Unlabeled Preference Optimization For Chest X-ray Report Generation
Aug 5, 2026Yuta Kobayashi, Pradyun Ramesh, Muhammad Ahmed Chaudhry +5Radiology Report Generation Radiology VLMs
Columbia University · Stanford University · Emory University
CARE-X: Towards Clinically Useful Radiology VLMs with Auxiliary Supervision, Reward-Aligned Learning, and Tool-Augmented Measurement
Aug 4, 2026Mercy Prasanna Ranjit, Anirban Porya, Sathvik Joel +8Radiology Report Generation Chest X-Ray Classification
Microsoft Research India · Medha AI, Narayana Health, India. · RTIICS, Narayana Health, India
HarMoE: Multi-Source Chest Radiograph Pretraining with Dataset-Disentangled Experts
Aug 3, 2026Haozhe Luo, Ziyu Zhou, Shelley Zixin Shu +1Multi-Source Domain Adaptation Chest X-Ray Classification
ARTORG Center for Biomedical Engineering Research, University of Bern · Kaiko.AI, Zurich, Switzerland · Shanghai Jiao Tong University, Shanghai, China
Learning to See Locally and Align Clinically with Pathology Semantics for Radiology Report Generation
Jul 31, 2026Xuan Cuong NgoRadiology Report Generation VLM Robustness
RadPRISM: Schema-stratified radiology-report supervision for concept-disentangled image representations and visual grounding
Jul 31, 2026Fabian Drexel, Marlene Fritzsche, Era Stambollxhiu +15Chest X-Ray Classification Disentangled Representation Learning
Chair for AI in Healthcare and Medicine, Technical University of Munich (TUM) and TUM University Hospital, Munich, Germany · Technical University of Munich, School of Medicine and Health, TUM University Hospital, Klinikum rechts der Isar, Department of Diagnostic and Interventional Radiology, Munich, Germany · Department of Radiology, Charité – Universitätsmedizin Berlin, corporate member of Freie Universität Berlin and Humboldt Universität zu Berlin, Berlin, Germany +5
SPARC-Rad: A Multimodal Benchmark Dataset and Evaluation Pipeline for Spatial and Anatomical Reasoning in Radiology Vision-Language Models
Jul 30, 2026Satvik Tripathi, Mustafa Ege Seker, Kristian Quevada +8Radiology VLMs Medical Image Analysis
Department of Radiology, Perelman School of Medicine, University of Pennsylvania, Philadelphia, Pennsylvania, USA · Department of Radiology, University of Wisconsin–Madison School of Medicine and Public Health, Madison, Wisconsin, USA · Department of Radiology, Cooper University Hospital, Cooper Medical School of Rowan University, Camden, New Jersey, USA +5
SCALPEL: Semantic Cross-modal Alignment via LLM-Powered Encoder Learning for Medical Vision-Language Representation
Jul 29, 2026Yunzhan Fu, Enyu Bao, Xiangyu Shen +4Radiology VLMs Medical VLMs
School of Computer Science, Hangzhou Dianzi University, China
Forensic Reproducibility Audit of a Radiology Vision-Language Model Benchmark: From Intended Protocol to Released Artifact
Jul 28, 2026Mateusz KozłowskiVLM Evaluation Radiology VLMs
Independent Researcher, Kraków, Poland
KANEx: Translating Kolmogorov-Arnold Networks' Interpretability to Medical Explainability
Jul 27, 2026Krithi Shailya, Ananya Lakshmi Ravi, Venkatanathan K. V. +4Radiology VLMs Kolmogorov-Arnold Networks
Centre for Responsible AI, Wadhwani School of Data Science and AI, Indian Institute of Technology Madras, Chennai, India · Vanderbilt University School of Medicine, Nashville, USA
RadSight: Towards Perceptually Reliable Multimodal Radiology Image Understanding
Jul 24, 2026Jianqin Liu, Weiwei Cao, Wanxing Chang +7Radiology VLMs Medical Image Grounding
1DAMO Academy, Alibaba Group · University of Electronic Science and Technology of China
DobicVLM: Aligning Chest X-Ray Report Generation with Clinically-Grounded Programmatic Rewards via Group Relative Policy Optimization
Jul 21, 2026Thanni Adewuyi, Angelica Obayi, Andem Aniekan +10Radiology Report Generation Radiology VLMs
Dobic Health · HelpMum Africa · University of Ibadan
Region-Grounded Vision-Language Learning for Detection-Guided Mammographic Lesion Classification
Jul 17, 2026Zhengbo Zhou, Jiren Li, Dooman Arefan +2Radiology VLMs Vision-Language Models
Intelligent Systems Program, University of Pittsburgh, Pittsburgh, PA, USA · Department of Radiology, University of Pittsburgh, Pittsburgh, PA, USA · Department of Biomedical Informatics and Bioengineering, University of Pittsburgh, Pittsburgh, PA, USA
When Can Test-Time Adaptation Help Zero-Shot CT Vision-Language Models?
Jul 17, 2026Ailar Mahdizadeh, Puria Azadi Moghadam, Xiangteng He +1Zero-Shot Learning Radiology VLMs
University of British Columbia · 2Vector Institute
Learning Anatomy-Grounded CT Vision-Language Representations with Organ-Hierarchical Report Knowledge
Jul 12, 2026Guoliang You, Hongming Li, Yuanwang Zhang +1Radiology VLMs Medical VLMs
Department of Radiology, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA 19104, USA · School of Engineering and Applied Science, University of Pennsylvania, Philadelphia, PA 19104, USA
REVA-PO: Stabilizing Reinforcement Learning for Chest X-ray Report Generation
Jul 11, 2026Li Guo, Anas M. Tahir, Z. Jane WangRadiology Report Generation Radiology VLMs
University of British Columbia, Vancouver, BC, Canada
CT-CLIP Representations for Multimodal Lung Cancer Survival Prediction
Jul 9, 2026Sofie Allgöwer, Mikael Johansson, Andreas Hallqvist +4Medical Imaging Foundation Models Radiology VLMs
Chalmers University of Technology, Gothenburg, Sweden · Umeå University, Umeå, Sweden · Sahlgrenska University Hospital, Gothenburg, Sweden +1

Oct 7, 2026, cs.CVJ/K move · Enter open · S save

Geometry-Supervised Visual Representation Learning for Multi-Phenotype Lesion Interpretation in Medical VLMs

Hao Wang, Qiwei Zeng, Shuchang Ye, Jinghao Lin+4

The University of Sydney · Shanghai Jiao Tong University · Northeastern University

Visual Representation Learning Medical Image Representation Learning Medical Image Analysis Radiology VLMs

Open paper AskPDF arXiv

Medical vision-language models (VLMs) have shown increasing potential for clinical image interpretation. However, these models still struggle to interpret multi-phenotype lesions whose diagnosis requires the joint assessment of multiple pathological phenotypes. Existing vision-language alignment methods produce visual representations that fail to preserve anatomical hierarchies and relationships among phenotypic subclasses. This stems from their reliance on semantic supervision, which lacks geometric constraints to preserve these relationships in the visual embedding space. Moreover, the sparsity of lesion-related anatomical and phenotypic representations makes it difficult for medical VLMs to capture important diagnostic evidence. To address these limitations, we propose \textbf{PureVision}, a geometry-supervised visual representation learning framework for multi-phenotype lesion interpretation in medical VLMs. It combines a geometry-supervised representation learning module, \textbf{PureEyes}, and an anatomy-guided evidence aggregation module, \textbf{PureNeurons}. PureEyes provides geometric supervision through ideal spatial distributions that encode anatomical hierarchies and phenotypic subclass relationships. PureNeurons projects visual representations into the learned latent space, using their positions to selectively aggregate lesion-specific anatomical and phenotypic evidence. Experiments on \textit{LIDC-IDRI}, \textit{CBIS-DDSM}, and \textit{3DReasonKnee} demonstrate that PureVision improves lesion grounding and phenotype characterization in visual question answering and radiology report generation. Code is available at: https://anonymous.4open.science/r/purevision-06C2.

Momentum

Related topics

Latest papers 59