Radiology VLMs

VLM: Vision-Language Model

Overview

Radiology vision-language models connect images such as chest X-rays, CT, and MRI with reports and clinical questions to support diagnosis, report writing, image retrieval, and tracking change over time. Common approaches include contrastive image-report pretraining, instruction-tuned multimodal language models, and anatomy-aware grounding; newer systems also use clinical rewards, retrieval, tools, and expert gaze to guide their outputs. Evaluation spans tasks and benchmarks such as MIMIC-CXR, IU X-Ray, and CT-RATE, with growing attention to localization, longitudinal reasoning, uncertainty, and performance across institutions and languages. A central challenge is ensuring that fluent answers reflect image evidence rather than text cues or learned shortcuts, so benchmark scores must be weighed against robustness tests and radiologist assessment.

Latest papers

CardsList

128 papers16 papers in the last four weeks, up 14% on the four weeks before. 0.1% of all new papers.

  1. OmniCT: Towards a Unified Slice-Volume LVLM for Comprehensive CT Analysis

    Feb 18, 2026Tianwei Lin, Zhongwei Qiu, Wenqiao Zhang +12Radiology VLMsMedical VLMs

  2. MedProbCLIP: Probabilistic Adaptation of Vision-Language Foundation Model for Reliable Radiograph-Report Retrieval

    Feb 17, 2026Ahmad Elallaf, Yu Zhang, Yuktha Priya Masupalli +4Radiology VLMsVision-Language Models

  3. Concept-Enhanced Multimodal RAG: Towards Interpretable and Accurate Radiology Report Generation

    Feb 17, 2026Marco Salmè, Federico Siciliano, Fabrizio Silvestri +3Radiology Report GenerationRadiology VLMs

  4. TotalFM: An Organ-Separated 3D-CT Foundation Model Leveraging Large-Scale Routine Clinical Radiology Data

    Jan 1, 2026Kohei Yamamoto, Tomohiro Kikuchi3D Foundation ModelsMedical Imaging Foundation Models

  5. Generalised Medical Phrase Grounding

    Nov 30, 2025Wenjun Zhang, Shekhar S. Chandra, Aaron NicolsonRadiology VLMsHealthcare

  6. Exploring the Capabilities of Large Language Model Encoders for Image-Text Retrieval in Chest X-rays

    Sep 17, 2025Hanbin Ko, Gihun Cho, Inhyeok Baek +5Image-Text RetrievalRadiology VLMs

  7. Automatic Fine-grained Segmentation-assisted Report Generation

    Jul 22, 2025Frederic Jonske, Constantin Seibold, Osman Alperen Koras +6Radiology Report GenerationRadiology VLMs

  8. Multimodal Large Language Model driven Radiology Report Generation with Clinical Knowledge Enhancement

    Mar 11, 2024Miaojing Shi, Tianyu Cen, Zijie Yue +3Radiology Report GenerationRadiology VLMs