Medical VLMs

VLM: Vision-Language Model

Follow this topic Ask about this topic

Momentum

22 papers in the last four weeks, up 22% on the four weeks before. 0.2% of all new papers.

Jul 13Week of Sep 28

Latest papers 266

All topics

OpenMedReason: Scientific Reasoning Supervision for Medical Vision-Language Models
Jun 10, 2026Negin Baghbanzadeh, Pritam Sarkar, Michael Colacci +6Medical VQA Medical VLMs
York University · Vector Institute · University of British Columbia +5
FADA: Accessible fetal ultrasound interpretation and annotation with a selectively distilled unified vision-language model
Jun 9, 2026Mahmood Alzubaidi, Uzair Shah, Raden Muaz +6Ultrasound Image Segmentation Selective Knowledge Distillation
College of Science and Engineering , Hamad Bin Khalifa University,2026 Doha, Qatar. · Center for Clinical Precision Medicine and Genomics, HMC, Doha, Qatar.Jun · 3Advanced AlRazi Diagnostic Center, Al-Hodeidah, Yemen. +1
MAGIS: Evidence-Based Multi-Agent Reasoning for Interpretable Strabismus Clinical Decision-Making
Jun 8, 2026Xikai Tang, Yifan Wang, Jiafan Zhuang +12Medical Diagnosis Medical VLMs
School of Information and Software Engineering, University of Electronic Science and Technology of China, Chengdu, 611731, China · Shenzhen Institute for Advanced Study, University of Electronic Science and Technology of China, Shenzhen, 518000, China · Joint Shantou International Eye Center of Shantou University and The Chinese University of Hong Kong, Shantou, 515041, China +5
Learnable Token Sparsification for Efficient Gigapixel Whole Slide Image Reasoning
Jun 7, 2026Jingzhi Chen, Landi He, Zhuo Chen +2Efficient VLM Inference Medical VLMs
Shenzhen University of Advanced Technology
MedSIGHT: Towards Grounded Visual Comprehension in Medical Large Vision-Language Models
Jun 4, 2026Aofei Chang, Le Huang, Alex James Boyd +4Medical VLMs Medical Image Segmentation
GE HealthCare · College of Information Sciences and Technology, The Pennsylvania State University, State College, PA, USA · GE Healthcare, Bellevue, WA, USA.
MMBU: A Massive Multi-modal Biomedical Understanding Benchmark to Probe the Perception Capabilities of Vision-Language Models
Jun 4, 2026Ryan D'Cunha, Alejandro Lozano, Xiaoxiao Sun +17Medical Image Analysis Medical VLMs
Stanford University, Stanford, CA, USA · Instituto Tecnológico de Monterrey, Mexico · Monash University, Melbourne, VIC, Australia +4
EasyLens: A Training-Free Plug-and-Play Subtle-Lesion Representation Amplifier for Medical Vision-Language Models
Jun 4, 2026Hao Wang, Qiwei Zeng, Jinghao Lin +6VLM Adaptation Medical Image Anomaly Detection
School of Computer Science, The University of Sydney, Sydney, NSW, Australia · Jilin University, Changchun, China · Northeastern University, Shenyang, China +1
Noise-Aware Visual Representation Learning for Medical Visual Question Answering
Jun 4, 2026I Putu Adi Pratama, Bahadorreza Ofoghi, Atul Sajjanhar +1VLM Robustness Denoising Autoencoders
Deakin University, 221 Burwood Highway, Burwood, Victoria 3125, Australia
Geometry-Aware Distillation for Prompt Tuning Biomedical Vision-Language Models
Jun 3, 2026Tran Dinh Tien, Zhiqiang ShenVLM Adaptation VLM Distillation
Department of Machine Learning Mohamed bin Zayed University of Artificial Intelligence
BreastGPT: A Multimodal Large Language Model for the Full Spectrum of Breast Cancer Clinical Routine
Jun 3, 2026Yang Liu, Jiajin Zhang, Danyang Tu +8Breast Cancer Medical Imaging
DAMO Academy, Alibaba Group · Zhejiang University · West China Hospital +1
Beyond Symmetric Alignment: Spectral Diagnostics of Modality Imbalance in Vision-Language Models in the Medical Domain
Jun 3, 2026Alessandro Gambetti, Qiwei Han, Cláudia Soares +1VLM Evaluation Modality Imbalance
NOVA School of Science and Technology · Lisbon, Portugal · Nova School of Business and Economics +2
Large AI Models in Dental Healthcare: From General-Purpose Systems to Domain-Specific Foundation Models
Jun 1, 2026Sema Helali, Lina Abu Nada, Sausan Al Kawas +3Medical Imaging Foundation Models Medical VLMs
Department of Computer Science and Software Engineering, College of Information Technology, United Arab Emirates University, Al Ain, 15551, UAE · Department of Oral and Craniofacial Health Sciences, College of Dental Medicine, University of Sharjah, Sharjah, UAE · Weill Cornell Medicine-Qatar, Doha, Education City, Qatar +1
Cross-modal linkage risk in clinical vision-language models
Jun 1, 2026Soroosh Tayebi Arasteh, Mahshad Lotfinia, Sven Nebelung +1Medical VLMs Privacy Protection in VLMs
Lab for AI in Medicine, RWTH Aachen University, Aachen, Germany · Department of Diagnostic and Interventional Radiology, University Hospital RWTH Aachen, Aachen, Germany
Beyond Captions: Context-Grounded Reconstruction for Biomedical Multimodal Continued Pretraining
May 31, 2026Guanghao Zhu, Zeyu Liu, Zhitian Hou +10Vision-Language Models Multimodal Pretraining
The Hong Kong Polytechnic University · Sun Yat-sen University · PolyU-Daya Bay Technology and Innovation Research Institute
Ryze: Evidence-Enriched Data Synthesis from Biomedical Papers
May 30, 2026Yeqi Huang, Yue Chen, Yanwei Ye +2VLM Adaptation Synthetic Data Generation
University of Edinburgh, United Kingdom
ASAP: Advancing Medical Volumetric Representation Learning with Anatomy-aware Semantically-adaptive Pre-training
May 30, 2026Rongsheng Wang, Fenghe Tang, Zihang Jiang +10Medical VLMs Medical Image Grounding
School of Biomedical Engineering, Division of Life Sciences and Medicine, University of Science and Technology of China (USTC), Hefei, Anhui, China 230026 · Medical Imaging, Robotics, Analytic Computing & Learning (MIRACLE) Lab, YRD-RIGHT, USTC Suzhou Institute for Advanced Research, Suzhou, Jiangsu, China 215123 · Jiangsu Provincial Key Laboratory of Multimodal Digital Twin Technology, Suzhou, Jiangsu, China 215123 +5
Simple Token-Efficient Vision-Language Model for Case-level Pathology Synoptic Report Generation
May 29, 2026Zhiyuan Yang, Jiahao Cheng, Vincent Quoc-Huy Trinh +1Computational Pathology Medical Report Generation
Department of Computer Science and Software Engineering (CSSE), Concordia University, Montreal, Canada · Axe Cancer, Centre de recherche du CHUM, Université de Montréal, Montreal, Canada · Institut de recherche en immunologie et cancérologie (IRIC), Université de Montréal
CardioLens: Revealing the Clinical Reality Gap of MLLMs via Multi-Sequence Cardiac MRI Evaluations
May 28, 2026Zixian Su, Hongkai Zhang, Fan Gao +12Magnetic Resonance Imaging Medical VLMs
Beijing Academy of Artificial Intelligence · Beijing Anzhen Hospital · Beihang University +1
Pocket-Dentist: On-Device Dental Image Understanding via Efficient Multimodal Large Language Models
May 28, 2026Kai Bian, Xucheng Guo, Bin Chen +4Medical Imaging Efficient VLM Inference
The University of Auckland, New Zealand · Shandong University, China · The University of Melbourne, Australia
VITAL: Visual-Semantic Dual Supervision for Enhanced and Interpretable Latent Reasoning in Medical MLLMs
May 27, 2026Qiaoru Li, Shaotian Liang, Jintao Chen +4Medical VQA VLM Interpretability
3Tencent · 1Zhejiang University · 2Shanghai AI Laboratory +1
OphIn-500K: Curating Web-Scale Visual Instructions for Scaling Ophthalmic Multimodal Large Language Models
May 27, 2026Xuanzhao Dong, Wenhui Zhu, Xiwen Chen +13Medical Image Analysis Medical VQA
1Arizona State University · 2Clemson University · 3Washington University in St. Louis +5
Not All Tokens Matter Equally: Dynamic In-context Vector Distillation with Decisive-Token Supervision for Long-form Medical Report Generation
May 26, 2026Ning Wu, Rui Liu, Xinkun Lin +5Medical Report Generation Long-Form Document Generation
UNSW Sydney, Sydney, Australia · University of Technology Sydney, Sydney, Australia · School of Computer Science and Engineering, Sun Yat-sen University, China +2
MedVol-R1: Reward-Driven Evidence Grounding for Volumetric Reasoning Segmentation
May 26, 2026Zichun Wang, Hairong Shi, Bingzheng Wei +2Image Segmentation Reinforcement Learning
School of Biological Science and Medical Engineering, Beihang University, Beijing, China · Center for Information and Computer Science, School of Science for Open and Environmental Systems, Graduate School of Science and Technology, Keio University, 2026 Kanagawa, Japan · Bytedance Inc., China +1
BioFact-MoE: Biologically Factorized Mixture of Experts for Vision-Language Prognostic Modeling in Hepatocellular Carcinoma
May 25, 2026Junlin Yang, Tian Yu, Nicha C. Dvornek +6Radiology VLMs Cancer Survival Prediction
Department of Radiology & Biomedical Imaging, Yale University, New Haven, CT, 06510, USA · Department of Biomedical Engineering, Yale University, New Haven, CT, 06510, USA · Department of Electrical Engineering, Yale University, New Haven, CT, 06510, USA +1
CNNs, Transformers, Hybrid, and Vision Language Models for Skin Cancer Detection
May 25, 2026Durjoy Dey, Yuhong Yan, Hassan HajjdiabHybrid CNN-Transformer Architectures Vision Transformer
Department of Computer Science and Software Engineering, Concordia University, Montreal, Canada · Ebovir Biotechnologie Inc., Montreal, Canada
Benchmarking Convolutional, Transformer, Hybrid, and Vision Language Models for Multi Disease Retinal Screening
May 25, 2026Durjoy Dey, Aymane Ajbar, Yuhong YanHybrid CNN-Transformer Architectures Vision Transformer
Department of Computer Science and Software Engineering Concordia University Montreal, QC, Canada · Ebovir Biotechnologie Inc. Montreal, QC, Canada
RAPTOR+: A Visually Grounded Vision-Language Framework to Improve Clinical Trust and Auditability in Automated Cancer Referral Processing
May 25, 2026Sofiat Abioye, Ufaq Khan, Shazad Ashraf +4Document Understanding Healthcare
Birmingham City University, Birmingham, England, UK · Mohamed bin Zayed University of Artificial Intelligence (MBZUAI), Abu Dhabi, UAE · University Hospitals Birmingham NHS Foundation Trust, Birmingham, England, UK +1
Universal Boosts, Specific Suppressors: Sparse Autoencoder Steering of Medical Vision-Language Models
May 24, 2026Farhad Nooralahzadeh, Benjamin Gundersen, Nicolas Deperrois +7Radiology Report Generation Healthcare
University of Zurich and University Hospital of Zurich, Switzerland · Zurich University of Applied Sciences, Switzerland · Kobe University, Japan +3
Parameter-Efficient VLMs for Gastrointestinal Endoscopy: Medical Image Generation and Clinical Visual Question Answering
May 24, 2026Ojonugwa Oluwafemi Ejiga Peter, Frederick Akor Ejiga, Fahmi Khalifa +1Endoscopy Medical Imaging
Computer Science Department, Morgan State University, Baltimore, USA. · International Organization for Migration (IOM), Geneva, Switzerland. · Electrical & Computer Engineering Department, Morgan State University, Baltimore, USA.
From Theory to Decision Rule: Calibrating the Noisy-Label Crossover for Vision-Language Model Weak Supervision Across Three Medical-Imaging Benchmarks
May 23, 2026Bruce Changlong Xu, Jose James, Alexander RyuVision-Language Models Medical Image Classification
Department of Computer Science, Stanford University, Stanford, CA, USA · Mayo Clinic, Rochester, MN, USA.

Jun 10, 2026, cs.CVJ/K move · Enter open · S save

OpenMedReason: Scientific Reasoning Supervision for Medical Vision-Language Models

Negin Baghbanzadeh, Pritam Sarkar, Michael Colacci, Abeer Badawi+5

York University · Vector Institute · University of British Columbia+5

Medical VQA Medical VLMs VLM Reasoning Visually Grounded Reasoning Medical Image Benchmarks

Open paper AskPDF arXiv

High-stakes clinical use of large vision-language models (LVLMs) requires reasoning that is grounded in visual evidence and clinical knowledge, not just correct final answers. We introduce OpenMedReason, a large-scale, open multimodal medical reasoning corpus comprising approximately 450K image-question-answer instances whose reasoning traces are primarily derived from curated biomedical, human-authored scientific articles. OpenMedReason provides high-fidelity supervision beyond synthetic chains of thought, covering diverse medical domain vision modalities such as radiological scans, microscopic images, visible light photographs, charts, and others. We complement it with OpenMedReason-Bench, a held-out benchmark that allows fine-grained evaluation of LVLMs along three complementary axes of capability, including perception, medical knowledge, and rationale, enabling diagnostic evaluation beyond final-answer accuracy. OpenMedReason is a rich training resource that exhibits its effectiveness in both supervised fine-tuning (SFT) and reinforcement-based alignment. Training with OpenMedReason yields a 20% average improvement in VQA accuracy over the base model and achieves performance within 4.2% of the strongest comparable-scale medical LVLMs. Fine-grained performance analysis confirms that the gains are not concentrated in any single axis: OpenMedReason improves perception, medical knowledge, and rationale jointly, and its reasoning traces are preferred over those of the base model in 86.1% of pairwise comparisons. We release the code and dataset at huggingface.co/datasets/neginb/OpenMedReason.

Momentum

Related topics

Latest papers 266