Medical VLMs

VLM: Vision-Language Model

Follow this topic Ask about this topic

Momentum

22 papers in the last four weeks, up 22% on the four weeks before. 0.2% of all new papers.

Jul 13Week of Sep 28

Latest papers 266

All topics

Towards Enhancing 3D Spatial Reasoning in Medical Multimodal Large Language Models
Jul 15, 2026Zhuoyuan Fu, Zeshang Li, Yiqiong Zhang +53D Spatial Reasoning 3D Medical Imaging
University of International Relations, Beijing, China · University of Trento, Trento, Italy
LaGuadia: Language-Guided Adaptive Distillation from Pathology Foundation Models
Jul 13, 2026Gangsu Kim, Won-Ki JeongComputational Pathology Pathology Foundation Models
Department of Computer Science and Engineering, College of Informatics, Korea University, Republic of Korea
The Path to Self-Evolving Clinical Systems: Scaling Medical Agents from Assistance to Autonomy
Jul 13, 2026Chunzheng Zhu, Lei Tian, Bohan Tan +15Healthcare LLM Agent Self-Improvement
1Hunan University · 2ByteDance · 3Duke University +6
Learning Anatomy-Grounded CT Vision-Language Representations with Organ-Hierarchical Report Knowledge
Jul 12, 2026Guoliang You, Hongming Li, Yuanwang Zhang +1Radiology VLMs Medical VLMs
Department of Radiology, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA 19104, USA · School of Engineering and Applied Science, University of Pennsylvania, Philadelphia, PA 19104, USA
TCLA: Training-Free Class-wise Logit Adaptation for Medical Vision-Language Models
Jul 10, 2026Tianyou Jiang, Ziyu ZhouFew-Shot Domain Adaptation VLM Adaptation
University of Bern, Bern, Switzerland · Shanghai Jiao Tong University, Shanghai, China
Super-Generalist: Towards Comprehensive and Accurate Medical Image Understanding via Generalist-Specialist Synergy
Jul 10, 2026Shaoteng Zhang, Weiwei Cao, Wanxing Chang +9Medical Image Classification Medical VLMs
DAMO Academy, Alibaba Group · Department of Radiology, Ningbo No. 2 Hospital, Ningbo, Zhejiang, China · Hupan Lab +5
OmniFood-Bench: Evaluating VLMs for Nutrient Reasoning and Personalized Health Advice
Jul 9, 2026Qian Jiang, Zhecheng Shi, Jingpu Yang +2VLM Evaluation Medical VLMs
Northeastern University at Qinhuangdao · The Hong Kong University of Science and Technology (Guangzhou) · BeiHang University +1
MedPMC: A Systematic Framework for Scaling High-Fidelity Medical Multimodal Data for Foundation Models
Jul 8, 2026Hyunjae Kim, Dain Kim, Pan Xiao +25Medical Imaging Foundation Models Training Data Curation
Yale University, New Haven, CT, USA · Korea University, Seoul, South Korea · Washington University in St. Louis, St. Louis, MO, USA +4
Seeing What Matters: Lesion-Aware High-Resolution Patch Discovery and Fusion for Chest X-ray Report Generation
Jul 8, 2026Yingshu Li, Yunyi Liu, Zhenghao Chen +5Radiology Report Generation Medical Image Analysis
The University of Sydney, Sydney, NSW 2006, Australia · The University of Newcastle, Newcastle, NSW 2308, Australia · University of Wollongong, Wollongong, NSW 2522, Australia +1
Cross-Contextual Vision-Language Adaptation with LoRA for Personalized Severe Adverse Event Detection in Clinical Wound Monitoring
Jul 6, 2026Aditi Naiknaware, Jian Sun, Aminreza Khandan +4VLM Adaptation Low-Rank Adaptation
1San Diego State University · University of California, Los Angeles · University of California, Davis
Evaluating and Understanding Model Editing for Medical Vision Language Models
Jul 6, 2026Guli Zhu, Chenwei Wu, Liyue ShenKnowledge Editing Medical VLMs
EECS, University of Michigan, Ann Arbor, MI 48105, USA
IRIS: An Intelligent Vision-Language System for Ocular Surface Diseases via Topic Tree and Scene-Driven VQA Generation
Jul 5, 2026Hao Wei, Wenjin Qi, Dasen Dai +2Visual Question Answering Vision-Language Models
The Chinese University of Hong Kong, Shatin, Hong Kong, China · Westlake University, Xihu District, Hangzhou, Zhejiang Province, China
CogRad: A Cognitively-Inspired Multi-Agent Framework for Radiology Report Generation
Jul 4, 2026Saif Ur Rehman Khan, Hasaan Maqsood, Sebastian Vollmer +2Radiology Report Generation Medical VLMs
Department of Computer Science, Rhineland-Palatinate Technical University of Kaiserslautern-Landau, Kaiserslautern, 67663, Germany. · 2German Research Center for Artificial Intelligence, Kaiserslautern, 67663, Germany. · 3Intelligentx GmbH (intelligentx.com), Kaiserslautern, Germany. +1
Do Medical Vision Language Models Actually See? A Counterfactual Grounding Framework and Hard-Negative Contrastive Training for Visually-Reliant Medical VLMs
Jul 4, 2026Anas Zafar, Leema Krishna Murali, Siddhant Bharadwaj +2VLM Evaluation Counterfactual Evaluation
The University of Texas MD Anderson Cancer Center · Eisai Inc. · Cohere Labs Community +1
Towards Real-World Ultrasound Understanding: Large Vision-Language Models from Multi-Image Examinations with Long-Form Reports
Jul 2, 2026Bingcong Yan, Chunlei Li, Jingliang Hu +3VLM Adaptation Ultrasound Imaging
1MedAI Technology (Wuxi) Co. Ltd. · 2Technical University of Munich
MMIR-TCM: Memory-Integrated Multimodal Inference and Retrieval for TCM Clinical Decision Support
Jul 2, 2026Lihui Luo, Joongwon Chae, Ziyan Chen +13Multimodal RAG Medical Diagnosis
Institute of Biopharmaceutics and Health Engineering, Tsinghua Shenzhen International Graduate School, Shenzhen, 518000, China · Chinese Medicine Guangdong Laboratory, Zhuhai, 519000, China · XiaoMing TCM Hospital, Shenzhen, 518000 China +3
Breaking Failure Cascades: Step-Aware Reinforcement Learning for Medical Multimodal Reasoning
Jun 30, 2026Junha Jung, Minbyul Jeong, Suhyeon Lim +5Process Reward Models Medical VQA
Korea University · AIGEN Sciences · Upstage AI +3
Evo-PI: Aligning Medical Reasoning via Evolving Principle-Guided Supervision
Jun 30, 2026Xianda Zheng, Huan Gao, Meng-Fen Chiang +3LLM Alignment Medical VLMs
School of Computer Science, University of Auckland · Sapiens · National Yang Ming Chiao Tung University +3
Token-Sparse Medical Multimodal Reasoning via Dual-Stream Reinforcement Learning
Jun 30, 2026Kaitao Chen, Weiqian Zhao, Jiamin Wu +6Efficient Multimodal Inference Medical VQA
1Fudan University · 2Shanghai Artificial Intelligence Laboratory · 3Shanghai Jiao Tong University +1
Synergistic Perception-Reasoning Governance: Grounding Medical MLLMs with Verifiable Anatomical Evidence
Jun 30, 2026Rui Hao, Qiankun Li, Junyuan Mao +4Radiology Report Generation Medical VQA
Huazhong University of Science and Technology, Wuhan, China · Imperial Global Singapore, Imperial College London, London, United Kingdom · Nanyang Technological University, Singapore, Singapore +2
HyperVLP: Enhancing Hierarchical Surgical Video-Language Pre-training in Hyperbolic Space
Jun 30, 2026Yaojun Hu, Kun Yuan, Nassir Navab +3Hierarchical Representation Learning Surgical Video Understanding
Zhejiang University, Hangzhou, China · University of Strasbourg, CNRS, INSERM, ICube, UMR7357, Strasbourg, France · IHU Strasbourg, Strasbourg, France +1
Latent-CURE for Breast Cancer Diagnosis
Jun 29, 2026Weiyi Zhao, Xiaoyu Tan, Lu Gan +2Breast Cancer Long-Tail Learning
School of Electronic and Electrical Engineering, Shanghai University of Engineering Science, Shanghai 201620, China · Tencent YouTu Lab, Shanghai 200232, China · Integrative Clinical Research Ward, Clinical Medicine Research Institute, Zhongshan Hospital, Fudan University, Shanghai 200032, China
SonoCLIP: Mask-Guided Region-Aware Vision-Language Pretraining for Fetal Ultrasound Analysis
Jun 28, 2026Hang Su, Chao Sun, Zhaofan Li +3Medical Imaging Foundation Models Ultrasound Imaging
School of Computer Science, Wuhan University, Wuhan, China · Institute of Artificial Intelligence, Wuhan University, Wuhan, China · Department of Ultrasound, Renmin Hospital of Wuhan University, Wuhan, China +2
When Does Synthetic CT Transfer? A Label-Free Donor/Host Diagnostic for Medical Vision-Language Model Routing on Real Lung CT
Jun 28, 2026Fakrul Islam TusharVLM Evaluation Synthetic-to-Real Domain Adaptation
Department of Radiology and Imaging Sciences, University of Arizona
Detecting Clinical Hallucinations in LVLMs via Counterfactual Visual Grounding Uncertainty
Jun 26, 2026Xiao Song, Haonan Qin, Zhaoxu Zhang +3Hallucination Detection in VLMs VLM Hallucination
School of Intelligent Science and Technology, Nanjing University, Suzhou, China · School of Biomedical Engineering, Nanjing University, Suzhou, China · National Institute of Healthcare Data Science at Nanjing University, Nanjing University, Nanjing, China
EchoSonar-R: A Multi-View Reasoning-Enabled Model for Disease Classification and Report Generation in Echocardiography
Jun 26, 2026Darya Taratynova, Ahmed Aly, Numan Saeed +1Medical Report Generation Echocardiography
Division of Computing and Mathematical Sciences, Mohamed Bin Zayed University of Artificial Intelligence (MBZUAI), Abu Dhabi, UAE
Aloe-Vision: Robust Vision-Language Models for Healthcare
Jun 25, 2026Jaume Guasch-Martí, Enrique Lopez-Cuena, Martín Suárez-Fernández +3VLM Evaluation VLM Robustness
Barcelona Supercomputing Center (BSC)
CORTEX: A Structured Reasoning Benchmark for Trustworthy 3D Chest CT MLLMs
Jun 25, 2026Hashmat Shadab Malik, Anees Ur Rehman Hashmi, Numan Saeed +3Radiology Report Generation 3D Medical Imaging
MBZUAI, Abu Dhabi, UAE · Hasso Plattner Institute, Potsdam, Germany · Khalifa University, Abu Dhabi, UAE
Just how sure are you? Improving Verbalized Uncertainty Calibration in Medical VQA
Jun 25, 2026Eren Senoglu, Federico Toschi, Nicolo Brunello +2Medical VQA Language Model Calibration
Politecnico di Milano
TAVR-VLM: Risk-Conditioned Causal Grounding for Hallucination-Resistant Report Generation
Jun 25, 2026Zhixiang Lu, Xiwei Liu, Sifan Song +5Radiology Report Generation Medical VLMs
Xi’an Jiaotong-Liverpool University · University of Liverpool · Mohamed bin Zayed University of Artificial Intelligence +2

Jul 15, 2026, cs.CVJ/K move · Enter open · S save

Towards Enhancing 3D Spatial Reasoning in Medical Multimodal Large Language Models

Zhuoyuan Fu, Zeshang Li, Yiqiong Zhang, Hangui Lin+4

University of International Relations, Beijing, China · University of Trento, Trento, Italy

3D Spatial Reasoning 3D Medical Imaging Multimodal Large Language Models Medical VLMs Medical Reasoning

Open paper AskPDF arXiv

While Multimodal Large Language Models (MLLMs) have demonstrated remarkable success in 2D medical image understanding, their extension to 3D volumetric imaging remains hindered by prohibitive annotation costs and dataset opacity. Current data formats, predominantly consisting of rigid Visual Question Answering (VQA) pairs or unstructured final clinical reports, typically fail to capture explicit clinical reasoning. To address this limitation, we introduce a large-scale structured reasoning dataset constructed via a novel slice-wise data synthesis paradigm. Inspired by the genuine diagnostic workflow of radiologists, this paradigm models visual cognition by decomposing the complex 3D reading process, translating global clinical priors into fine-grained, per-slice observations that are subsequently synthesized into an interpretable Chain-of-Thought (CoT). Crucially, this synthesized reasoning framework enforces essential clinical principles: sequential spatial tracking, multi-slice spatial awareness for artifact mitigation, and differential exclusion. To validate this approach, we instruction-tune a standard 2D-pretrained MLLM baseline using the synthesized data to enhance its volumetric comprehension. Comprehensive evaluations across multiple 3D medical benchmarks demonstrate that our method yields significant performance improvements over the 2D baseline. Furthermore, the resulting model exhibits robust spatial reasoning capabilities and rivals resource-intensive native 3D architectures, effectively bridging the performance gap. Ultimately, this data-centric strategy unlocks deep volumetric understanding and highly interpretable clinical logic without requiring computationally expensive 3D-specific pre-training. The complete repository, including datasets and training workflows, is publicly available at https://github.com/2020420145009/hounsfield.

Momentum

Related topics

Latest papers 266