Radiology VLMs

VLM: Vision-Language Model

Overview

Radiology vision-language models connect images such as chest X-rays, CT, and MRI with reports and clinical questions to support diagnosis, report writing, image retrieval, and tracking change over time. Common approaches include contrastive image-report pretraining, instruction-tuned multimodal language models, and anatomy-aware grounding; newer systems also use clinical rewards, retrieval, tools, and expert gaze to guide their outputs. Evaluation spans tasks and benchmarks such as MIMIC-CXR, IU X-Ray, and CT-RATE, with growing attention to localization, longitudinal reasoning, uncertainty, and performance across institutions and languages. A central challenge is ensuring that fluent answers reflect image evidence rather than text cues or learned shortcuts, so benchmark scores must be weighed against robustness tests and radiologist assessment.

Latest papers

CardsList

128 papers16 papers in the last four weeks, up 14% on the four weeks before. 0.1% of all new papers.

  1. Bilateral Evidence Selection and Reasoning for Mammography Vision--Language Models

    Nov 19, 2026Zhengbo Zhou, Dooman Arefan, Shandong WuRadiology VLMsReasoning for VLMs

  2. Rethinking Contrastive Targets in Radiology Language-Image Pretraining

    Nov 18, 2026Yunhe Gao, Ashwin Kumar, Jiaming Liu +8Contrastive LearningContrastive Language-Image Pretraining

  3. Diagnostic Accuracy and Navigation Behavior of Vision-Language Model Agents Reading Emergency CT and MRI Examinations

    Nov 17, 2026Jonathan Lichtle, Aymen Meddeb, Antonin Birot +10Radiology VLMsVLM Evaluation

  4. CARET: Clinical Assertion-Aware Residual Calibration for Medical Image-Text Alignment

    Nov 13, 2026Yifan Jin, Tao LiuRadiology VLMsMedical VLMs

  5. TransXplainRRG: A Radiologist-Evaluated LVLM for Chest Radiograph Report Generation

    Nov 12, 2026Chayan Mondal, Duc-Son Pham, Tele Tan +4Radiology Report GenerationRadiology VLMs

  6. A frontier machine intelligence for human neuroimaging

    Nov 11, 2026Chenhui Zhao, Akshay Rao, Akhil Kondepudi +19Radiology VLMsMedical VLMs

  7. Uni-Loc: Weakly Supervised 3D CT Pathology Localization via Spatially Grounded Vision-Language Classification

    Nov 9, 2026Hao-Chih Lee, Zahi A. Fayad, Xueyan MeiMedical Image LocalizationRadiology VLMs

  8. Answer or Defer? Testing VLMs' Stated Confidence on Brain MRI

    Nov 9, 2026Amir Sabbaghziarani, Parsa Ghazvinian, Sepehr Salem +1Radiology VLMsSelective Prediction for VLMs

  9. Guided Co-Attention with Adaptive Gating for Multimodal Medical Data Fusion

    Nov 7, 2026Muntaqim Ahmed Raju, Priyanka Siddappa, Md Shifat Haider Al Amin +2Multimodal FusionGated Multimodal Fusion

  10. Uncertainty, Not Concealment: A Mechanistic Reappraisal of Sycophancy in Vision-Language Models

    Nov 6, 2026Mohamed I. Eldagla, Zeyad H. ElShafei, Ahmed M. AnterSycophancy in VLMsRadiology VLMs

  11. A 3D foundation model unifying CT interpretation and segmentation

    Nov 4, 2026Yulu Xie, Zilong Li, Shen Xu +14Medical Imaging Foundation ModelsMedical Image Analysis

  12. Multimodal Prompt Learning with Dual-Granularity Contrastive Alignment for Preoperative Prediction of Lung Adenocarcinoma Invasiveness Using 3D CT

    Nov 2, 2026Qing Huang, Xiaotong Tan, Lintong Yao +6Prompt-Based Multimodal LearningMedical Image Classification

  13. Zero-shot evaluation of open vision-language models as System 1 decision models on radiology tasks

    Nov 1, 2026Bradley J Erickson, Sara SalehiRadiology VLMsVLM Evaluation

  14. CheXPoT: Post-Hoc Visual Verification and Correction of VLM-Generated Radiology Reports

    Oct 31, 2026Joey Guo, Rayan Ansari, Alaa YoussefVLM Hallucination MitigationRadiology VLMs

  15. Explainable Multimodal AI Approach to Reduce Unnecessary Breast Biopsies

    Oct 26, 2026Sadam Hussain, Mansoor Ali, Daly Betzabeth Avendaño-Avalos +1Breast CancerRadiology VLMs

  16. APED-CXR: Adaptive Privileged Evidence Distillation for Chest X-Ray Grounding with Image-Only Inference

    Oct 21, 2026Md Shihabul Islam Shovo, Nishi Kanta Paul, Jamil FayyadMedical Image GroundingAdaptive Knowledge Distillation

  17. TIM: Temporal Decoupling with Iterative Mutual-Refinement Model for Longitudinal Radiology Report Generation

    Oct 19, 2026Yiheng Dong, Yi Lin, Shilong Huang +2Radiology Report GenerationRadiology VLMs

  18. SCCL-DT: Semantic-Conflict-Aware Contrastive Learning with Dual-Rule Teacher Distillation for Zero-Shot Chest X-Ray Diagnosis

    Oct 15, 2026Ting Liu, Haoran Lai, HaobinChen +2Radiology VLMsContrastive Learning

  19. CAPTOR: a vision-language foundation model for Chest-Abdomen-Pelvis Oncologic CT

    Oct 9, 2026Séléna Jean-Mactoux, Sophie Loizillon, Ghina Jardali +3Medical Image RetrievalRadiology VLMs

  20. A4-MR: Abnormality Aware Anatomical Alignment for MR

    Oct 9, 2026Noel D'souza, Zhijian Yang, Nishank Singla +15Medical Imaging Foundation ModelsRadiology VLMs

  21. Efficient Multi-Granularity Knowledge Transfer for Radiology Report Generation

    Oct 8, 2026Xubin Zhong, Zheyu Zhang, Wenjian Qin +1Radiology Report GenerationRadiology VLMs

  22. Geometry-Supervised Visual Representation Learning for Multi-Phenotype Lesion Interpretation in Medical VLMs

    Oct 7, 2026Hao Wang, Qiwei Zeng, Shuchang Ye +5Visual Representation LearningMedical Image Representation Learning

  23. Anatomy-aware Fine-grained Multimodal Fusion for Laryngopharyngeal Cancer T-Staging Prediction Using CT and Radiology Report

    Oct 5, 2026Xingyue Zhao, Yanzhou Su, Fang Zhang +12Radiology VLMsMultimodal Classification

  24. Unmentioned Checklist Findings Change How Reinforcement Learning Appears to Improve Chest Radiograph Report Checking

    Oct 4, 2026Ali Vosoughi, Akhil Kasturi, Chenliang Xu +1Radiology VLMsRadiology Report Evaluation

  25. Homogeneous Semantic Alignment and Hierarchical Expert Routing for Radiology Report Generation

    Oct 3, 2026Erjian Zhang, Jiayuan Ma, Liejun Wang +3Radiology Report GenerationRadiology VLMs

  26. Reliability Stress Tests and Decision-Time Routing for Chest X-ray Vision-Language Models

    Oct 1, 2026Xinye Yang, Zhusi Zhong, Scott Collins +3Medical VLMsVLM Evaluation