Medical VLMs

VLM: Vision-Language Model

Follow this topic Ask about this topic

Momentum

22 papers in the last four weeks, up 22% on the four weeks before. 0.2% of all new papers.

Jul 13Week of Sep 28

Latest papers 266

All topics

AlphaRAD: Grounded Zero-Shot Classification in Chest Radiology via $α$ -Corrected Binary Cross Entropy and Factorized Latent Supervision
Sep 1, 2026Jianzhong You, Yuan Gao, Chris McIntoshChest X-Ray Classification Medical Image Classification
Peter Munk Cardiac Centre, University Health Network (UHN), Toronto, Canada · Ted Rogers Centre for Heart Research, Toronto, Canada · Vector Institute, Toronto, Canada +5
Benchmarking Vision-Language Models for Automated Pathology Diagnosis and Report Generation
Sep 1, 2026Yumi Lee, Harim Oh, Hyoryung Kim +52Computational Pathology Medical VLMs
BrainDiff: Longitudinal Report Generation for Multimodal Brain MRI
Sep 1, 2026Krish Patel, Peirong LiuRadiology Report Generation Longitudinal Medical Image Analysis
Department of Electrical and Computer Engineering, Data Science and AI Institute, Johns Hopkins University
Co-Annotator: Expert-Distilled ViT and VLM for Visual and Documentation Guidance in Age-Related Macular Degeneration
Aug 31, 2026Ziheng "Leo" Li, Benjamin Freeman, Akshay Raman +5Medical Report Generation Medical Image Analysis
Columbia University
MVC-Bench: Benchmarking Calibration of Medical Vision-Language Models
Aug 27, 2026Ashshak Sharifdeen, Shihab Aaqil Ahamed, Ufaq Khan +6VLM Evaluation VLM Robustness
1Mohamed bin Zayed University of AI · 2Sabaragamuwa University of Sri Lanka · 3Digital Platform Development, SLT PLC
HounsWorld: A Multimodal World Model for Hidden Patient-State Readout, Reconstruction, and Simulation
Aug 13, 2026Yunhao Bai, Zhongwei Qiu, Guangyu Guo +5Medical Report Generation World Model Learning
1Shanghai Key Laboratory of Multidimensional Information Processing, East China Normal University · 2DAMO Academy, Alibaba Group · 3Hupan Laboratory +1
Mr3D-VL: A generalist vision language foundation model for Multiparametric 3D Magnetic Resonance Imaging
Aug 13, 2026Zhi Qiao, Xintong Wu, Yichu He +1Medical Imaging Foundation Models 3D Medical Imaging
United Imaging Intelligence, Shanghai, China
Look What the Probes Dragged In! Real-World Chest X-ray Shortcuts in MedCLIP
Aug 12, 2026Nikolette Pedersen, Regitze Sydendal, Veronika Cheplygina +1Chest X-Ray Classification Medical VLMs
Pattern Recognition Revisited Lab (PURRlab) IT University of Copenhagen, Denmark
CT- $Δ$ Bench: A Benchmark for Longitudinal 3D Medical Imaging Difference Reporting with Vision-Language Models
Aug 12, 2026Kegeng Tang, Jingbo Wang, Shaogang Ren +1Radiology Report Generation Longitudinal Medical Image Analysis
University of Tennessee at Chattanooga
CARE: Confidence-Aware Reasoning for Reliable Medical VQA
Aug 11, 2026Yuetian Du, Yucheng Wang, Zhenyuan Chen +9Medical VQA Medical VLMs
Zhejiang University · Ant Group · University of Michigan +1
MIRA: Medical Image Reflection for Agentic Diagnosis
Aug 11, 2026Shengzhi Wang, Jun Yang, Kai Wu +11Medical Image Analysis LLM Agent Verification
Tongji University · École Normale Supérieure – PSL · Nanjing University +2
MedUP: Awakening Unified Understanding and Perception in Medical Vision-Language Models
Aug 11, 2026Yuan Wang, Hualiang Wang, Yixin Chen +6Unified Multimodal Models Vision-Language Grounding
Zhejiang University · Fudan University
Towards Expert-level Medical AI for Real-time Video Consultations
Aug 10, 2026Mahvish Nagda, Jihyeon Lee, Matthew Thompson +37Audio-Visual Understanding Medical VLMs
Google Research · Google DeepMind
MedPixel: A Unified Pixel-Language Model for Medical Reasoning and Segmentation
Aug 10, 2026Haoyu Yang, Meixing Shi, Zengjie Chen +5Medical VLMs VLM Reasoning
Zhejiang University · Fudan University · Kuaishou +2
Bootstrapping Vision-Language Model for Hysteroscopic Surgical Scene Segmentation
Aug 10, 2026Jun Huang, Meiyi Chen, Zijie Yue +6Text-Guided Image Segmentation Medical VLMs
College of Electronic and Information Engineering, Tongji University, Shanghai, China. · Department of Obstetrics and Gynecology, Tongji Hospital of Tongji University, Shanghai, China. · School of Medicine, Tongji University, Shanghai, China. +1
Diagnosing as Cardiologists Do: ECG Agents with Doctor-Grounded Priors for Clinical Reasoning Across Diseases and Populations
Aug 10, 2026Hongxiang Gao, He-yang Xu, Yuwen Li +6Electrocardiography Electrocardiogram Classification
State Key Laboratory of Digital Medical Engineering, Southeast University · School of Instrument Science and Engineering, Southeast University
An Agentic AI Framework Overcomes Fundamental Limitations of Large Language Models for Glaucoma Detection from Fundus Photography
Aug 7, 2026Jalil Jalili, Hossein Taghizad, Anuwat Jiravarnsirikul +8Medical Imaging Medical Image Classification
Division of Ophthalmology Informatics and Data Science, Viterbi Family Department of Ophthalmology, Shiley Eye Institute, University of California, San Diego, La Jolla, CA, USA. · Hamilton Glaucoma Center, Viterbi Family Department of Ophthalmology, Shiley Eye Institute, University of California, San Diego, La Jolla, CA, USA · Department of Electrical and Computer Engineering, University of Quebec at Trois-Rivières, Trois-Rivières, QC, Canada +2
DistMedVL: Distributional Vision-Language Alignment for Uncertainty-Aware Medical Image Segmentation
Aug 6, 2026Jiaxuan Li, Qing Xu, Xiangjian He +4Cross-Modality Medical Image Segmentation Medical VLMs
School of Computer Science, University of Nottingham Ningbo China, Ningbo, Zhejiang, China · School of Computer Science, University of Nottingham, UK
Text-Guided Refinement of Multi-sequence Glioma Subregion Segmentation with a Vision-Language Foundation Model
Aug 5, 2026Zach Eidex, Yu-nong Lin, Mojtaba Safari +4Interactive Medical Image Segmentation Medical Imaging Foundation Models
Department of Biomedical Informatics, Emory University School of Medicine, Atlanta, GA, USA · Department of Radiation and Cellular Oncology, The University of Chicago, Chicago, IL, USA · Department of Radiation Oncology, Winship Cancer Institute, Emory University School of Medicine, Atlanta, GA, USA
Evaluating the Diagnostic Robustness of Vision-Language Models Under Visual and Textual Perturbations
Aug 5, 2026Ali Khoramfar, Mohammad Javad Dousti, Alireza Mohamadian +1VLM Evaluation VLM Robustness
Department of Electrical and Computer Engineering, College of Engineering, University of Tehran, Tehran, Iran · Advanced Diagnostic and Interventional Radiology Research Center (ADIR), Tehran University of Medical Sciences, Tehran, Iran
EndoVLM: An Endoscopy Vision-Language Pre-training Model via Anatomy-Guided Sparsity and Progressive Alignment
Aug 5, 2026Zhenyu Yi, Jianwei Xu, Yue Hu +6Medical Imaging Foundation Models Medical VLMs
1DAMO Academy, Alibaba Group · 3Shanghai Jiao Tong University · 4Hupan Lab +3
LocAnyMed: Vision-Language Grounding for Multimodal Medical Images
Aug 4, 2026Zihan Wang, Tong Liu, Zhiwei Wang +6Medical VLMs Medical Image Grounding
School of Computer Science, Wuhan University, Wuhan, China · College of Computing and Data Science, Nanyang Technological University, Singapore · Australian Artificial Intelligence Institute, School of Computer Science, University of Technology Sydney, Sydney, Australia +1
Open-Linguistic Concept Unified Learning for Cross-Site Interpretable Dermatology Image Diagnosis
Aug 4, 2026Chengyu Wu, Junpeng Tan, Wanxiang Luo +3Concept Bottleneck Models Medical Diagnosis
Zhejiang University Hangzhou, China · Westlake University Hangzhou, China · Harbin Institute of Technology Shenzhen, China +1
NeuroMosaic: Anatomically Grounded Multimodal Large Language Modeling for Molecularly Aware Glioma Reasoning from 3D MRI and Clinical Narratives
Aug 4, 2026Yantong Liu, Zheyu Zhang, Runpeng Liu +3Multimodal Large Language Models Medical VLMs
Department of Computer Information Engineering, Kunsan National University, Gunsan 54150, Republic of Korea · School of Vehicle and Mobility, Tsinghua University, Beijing 100084, China
Confident but Unreliable: A Behavioral Safety Audit of Vision-Language Models on Brain MRI
Aug 3, 2026Amir Sabbaghziarani, Mohammadsajad Abavisani, Sergey PlisVLM Evaluation VLM Hallucination
TReNDS Center Atlanta, GA, USA
Auditing Medical Vision-Language Models on Chest Radiographs: Estimating Reference Agreement Across Institutions
Aug 1, 2026Pengyang Yu, Yiou Wang, Zhongping Dong +3Chest X-Ray Classification Medical VLMs
School of Computer Science, University College Dublin, Dublin, Ireland · Department of Medical Imaging, The Third Affiliated Hospital of Southern Medical University, Guangzhou, China · Dublin City University, Dublin, Ireland
ORCA: ORgan-Centroid Aggregation for Training-Free 3D CT Visual Token Compression
Jul 31, 2026Renjie Liang, Zijian Xu, Jinqian Pan +6Medical VLMs Visual Token Merging
University of Florida, Gainesville, FL, USA · University of Southern California, Los Angeles, CA, USA · National University of Singapore, Singapore
Semantically Calibrated Evidence Composition for CT Vision-Language Learning
Jul 31, 2026Guoliang You, Haifan Gong, Xiaomeng ChuMedical VLMs Medical Image Grounding
University of Pennsylvania · 2The Chinese University of Hong Kong, Shenzhen · 3Yale University
Real-Time Visual Obstruction Detection in Surgical Augmented Reality
Jul 31, 2026Shih-Chin Yang, Yanming Xiu, Hanting Ye +3Efficient Inference Medical VLMs
Department of Computer Science, Duke University · Department of Electrical and Computer Engineering, Duke University
Learning How Much, Not Just What: Cross-Patient Burden Order for CT Vision-Language Pretraining
Jul 31, 2026Guoliang You, Haifan Gong, Xiaomeng ChuRepresentation Learning Medical Image Analysis
University of Pennsylvania · The Chinese University of Hong Kong, Shenzhen · Yale University

Sep 1, 2026, cs.CVJ/K move · Enter open · S save

AlphaRAD: Grounded Zero-Shot Classification in Chest Radiology via $α$ -Corrected Binary Cross Entropy and Factorized Latent Supervision

Jianzhong You, Yuan Gao, Chris McIntosh

Peter Munk Cardiac Centre, University Health Network (UHN), Toronto, Canada · Ted Rogers Centre for Heart Research, Toronto, Canada · Vector Institute, Toronto, Canada+5

Chest X-Ray Classification Medical Image Classification Medical VLMs Medical Image Grounding Multimodal Contrastive Learning Zero-Shot Medical Image Segmentation

Open paper AskPDF arXiv

Vision-Language Pretrained Models (VLPMs) offer a scalable path to open-vocabulary chest radiology understanding, yet two aspects remain underexplored: how structured clinical semantics extracted from medical reports can reduce in-batch noise during contrastive learning, and how cross-modal fusion can be designed to produce more faithful spatial grounding without added complexity. We introduce AlphaRAD, addressing these opportunities through two contributions. First, we construct a large-scale structured medical concept space from medical reports parsed by a Large Language Model for training, thereby mitigating in-batch learning noise and removing heuristic pair matching in contrastive learning, and thus naturally positioning AlphaRAD as a medical concept discriminator trained via

α

-Corrected Binary Cross-Entropy. Second, we propose FLaS (Factorized Latent Supervision), an extremely simple yet effective cross-modal feature fusion module that factorizes VLPM representations into independent subspaces, using dedicated alignment supervision to enhance the expressiveness of spatial grounding without introducing additional model parameters. Through extensive empirical validation, AlphaRAD shows strong zero-shot generalization across diverse chest radiology tasks. Notably, it establishes state-of-the-art average performance across 16 classification benchmarks, while achieving individual state-of-the-art results via distinct gains on 7 grounding/phrase grounding and 3 segmentation datasets.

Momentum

Related topics

Latest papers 266