Medical VLMs

VLM: Vision-Language Model

Ask about this topic

Momentum

22 papers in the last four weeks, up 22% on the four weeks before. 0.2% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 266

All topics
CardsList

  1. SurgAtlas: A Large-Scale Surgical Video-Language Dataset with 2,391 Hours of Open and Minimally Invasive Surgery

    Jun 24, 2026Filippos Bellos, Andre S. Gala-Garza, Miaowei Wang +8Medical VQASurgical Video Understanding

    University of Michigan Ann Arbor, Michigan, USA · University of Edinburgh Edinburgh, United Kingdom · Vanderbilt University Medical Center Nashville, Tennessee, USA +3

  2. Disease-Centric Vision-Language Pretraining with Hybrid Visual Encoding for 3D Computed Tomography

    Jun 24, 2026Bowen Shi, Weiwei Cao, Ruifeng Yuan +5Contrastive Learning3D Medical Imaging

    DAMO Academy, Alibaba Group · Hupan Lab, 310023, Hangzhou, China · Shanghai Jiao Tong University, China +2

  3. Teach-to-Reason: Competition-Guided Reasoning with a Self-Improving Teacher

    Jun 24, 2026Xiao Han, Hao Liu, Zhimin Bao +5Medical VQAMedical VLMs

    1AIRC, Midea Group

  4. Text Over Image: Auditing Multimodal Robustness in Synthetic Medical Image Detection

    Jun 24, 2026Ching-Hao Chiu, Hao-Wei Chung, Gelei Xu +7Multimodal RobustnessMedical VLMs

    University of Notre Dame, Notre Dame, IN, USA. · IBM Research, Yorktown Heights, NY, USA. · Department of Cardiology, Boston Children’s Hospital, Boston, MA, USA. +2

  5. Multilingual Hematology Visual Question Answering Dataset

    Jun 24, 2026Hajra Malik, Hafiza Tooba Aftab, Abdul Rehman +2Medical VQAMedical VLMs

    Information Technology University, Lahore · King Edward Medical University, Lahore

  6. BioMedVR: Confusion-Aware Mixture-of-Prompt Experts for Biomedical Visual Reprogramming

    Jun 23, 2026Jiaxiang Liu, Tianxiang Hu, Juwei Guan +5VLM AdaptationMedical VLMs

    Guangdong Institute of Intelligence Science and Technology, Zhuhai, China · Zhejiang University, Hangzhou, China · Southeast University, Nanjing, China +3

  7. MedBench v5: A Dynamic, Process-Oriented, and Hallucination-Aware Benchmark for Clinical Multimodal Models

    Jun 23, 2026Jinru Ding, Chuchu Jiang, Lu Lu +12AI Agent BenchmarksMedical VLMs

    1Shanghai Artificial Intelligence Laboratory

  8. Brain-Adapter: A Dual-Stream Vision-Language MIL Framework for Comprehensive 3D CT Diagnosis of Acute Intracranial Pathologies

    Jun 22, 2026Zhenyu Yi, Zhiyun Song, Yusong Sun +6VLM Adaptation3D Medical Imaging

    School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China · Department of Computing, Imperial College London, London, UK

  9. CADRE: Stable, Parameter Efficient Adaptation of Medical Vision Language Models with Bounded Forgetting and Prior Drift

    Jun 22, 2026Amrita Singh, Rishabh JhaVLM AdaptationElastic Weight Consolidation

    Mindriser’s Consortium, Kathmandu, Nepal · University of Victoria, BC, Canada

  10. Efficient Multimodal Clinical Question Answering for Pulmonary Embolism Risk Assessment

    Jun 21, 2026Xiangyuan Xue, Yang Yu, Yan Gao +5Efficient Multimodal InferenceMultimodal QA

    University of Auckland, Auckland, New Zealand · University of Cambridge, Cambridge, United Kingdom · University of Adelaide, Adelaide, Australia +1

  11. SAGE: An Expert-Annotated South Asian GI Endoscopy Dataset for Multimodal Learning and Hallucination Analysis

    Jun 20, 2026Niyoj Oli, Sachin Acharya, Sandesh Pokhrel +7EndoscopyMedical Imaging

    Nepal Applied Mathematics and Informatics Institute for Research, Nepal · University of Utah, USA · GastroIntestinal Department, Dhulikhel Hospital, Nepal +3

  12. GTA-Net: Cooperative Game Theory for Vision-Language Alignment in Chest X-Ray Report Generation

    Jun 20, 2026Saif ur Rehman Khan, Imad Ahmed Waqar, Sebastian Vollmer +2Radiology Report GenerationMedical VLMs

    Department of Computer Science, Rhineland-Palatinate Technical University of Kaiserslautern-Landau, Kaiserslautern 67663, Germany · German Research Center for Artificial Intelligence (DFKI), Kaiserslautern 67663, Germany · IntelligentX GmbH (intelligentx.com), Kaiserslautern, Germany +1

  13. MEDLAYXPLAIN: Benchmarking the Expert-Lay Gap in Medical Vision-Language Models

    Jun 19, 2026Han Jang, Junhyeok Lee, Songsoo Kim +4VLM EvaluationMedical VLMs

    1Seoul National University · 2Seoul National University Hospital · 3Seoul National University College of Medicine +1

  14. PROTON: Prototype-Based Test-Time Online OOD Detection for Medical VLMs

    Jun 18, 2026Abhijit Das, Nichula Wasalathilaka, Yifan Lu +4Medical VLMsOOD Detection

    MBZUAI, Abu Dhabi, UAE · University of Peradeniya, Sri Lanka · Khalifa University, Abu Dhabi, UAE +2

  15. Confidence Calibration for Multimodal LLMs: An Empirical Study through Medical VQA

    Jun 18, 2026Yuetian Du, Yucheng Wang, Ming Kong +4Multimodal QALanguage Model Calibration

    College of Computer Science and Technology, Zhejiang University · School of Computer Science and Technology, Xidian University · Zhihui Medical Technology (Shanghai) Co., Ltd., Shanghai, China +1

  16. REVEAL++: Differentiable Phenotypic Grouping for Vision-Language Retinal Modeling of Alzheimer's Disease Risk

    Jun 17, 2026Ethan Elio Meidinger, Seowung Leem, Zeyun Zhao +1Contrastive LearningMedical Image Analysis

    University of Virginia, Charlottesville, VA, USA · J. Crayton Pruitt Family Department of Biomedical Engineering, Herbert Wertheim College of Engineering, University of Florida, Gainesville, FL, USA

  17. Hallucination Detection and Correction in Medical VLMs via Counter-Evidence Verification

    Jun 17, 2026Nan Zhou, Ke Zou, Meng Liu +5Hallucination Detection in VLMsVision-Language Models

    the College of Computer Science, Sichuan University. · Yong Loo Lin School of Medicine, National University of Singapore. · National Key Laboratory of Autonomous Intelligent Unmanned Systems, Beijing2026 Institute of Technology. +2

  18. Evaluation of Medical Vision Language Models HuluMed and MedGemma, and general purpose chatbots Gemma 3, ChatGPT Plus, and Claude Pro on real previously unseen wound images

    Jun 16, 2026Yunzhe Xue, Mohammed Saim Ahmed Quadri, Neal Panse +2VLM EvaluationMedical VQA

    Department of Data Science, New Jersey Institute of Technology, Newark, NJ, USA · Department of Computer Science, New Jersey Institute of Technology, Newark, NJ, USA · Vascular and Endovascular Surgery, Robert Wood Johnson Hospital, New Brunswick, NJ, USA

  19. The Slop Paradox: How Synthetic Standardization Erodes Clinical Uncertainty and Cross-Modal Alignment in AI-Rewritten Radiology Reports

    Jun 16, 2026Samar AnsariMedical VLMsVision-Language Alignment

    School of Computing and Engineering Sciences University of Chester Chester, CH1 4BJ, United Kingdom

  20. Enhancing Pathological VLMs with Cross-scale Reasoning

    Jun 16, 2026Chi Phan, Tianyi Zhang, Qiaochu Xue +5Visual Question AnsweringComputational Pathology

    Department of Electrical and Computer Engineering, National University of Singapore, Singapore · PuzzleLogic Pte Ltd, Singapore · Department of Pathology, Fujian Medical University Cancer Hospital & Fujian Cancer Hospital, Fuzhou, China

  21. Revisiting LLM Adaptation for 3D CT Report Generation: A Study of Scaling and Diagnostic Priors

    Jun 15, 2026Vanshali Sharma, Andrea M. Bejar, Halil Ertugrul Aktas +43D Medical ImagingMedical VLMs

    Department of Radiology Northwestern University Chicago, USA · Department of Computer Science Aalto University, Finland · Department of Computer Science University of South Dakota South Dakota, USA

  22. Vision-Language Models as Zero-Annotation Oracles in Histopathology

    Jun 15, 2026Vishal Jain, Giorgio Buzzanca, Sarah Cechnicka +6Computational PathologyHistopathology Image Segmentation

    Imperial College London, London, UK · Leiden University Medical Center, Leiden, The Netherlands · KU Leuven, Leuven, Belgium +3

  23. Uncertainty Is Not a Safety Net for Clinical VQA, but Can It Anticipate Model Failure?

    Jun 15, 2026Arnisa Fazla, Alberto Testoni, Ameen Abu-Hanna +2VLM EvaluationVLM Robustness

    Department of Medical Informatics, Amsterdam University Medical Center, University of Amsterdam, Amsterdam, The Netherlands. · Amsterdam Public Health, Methodology, Amsterdam, The Netherlands. · MaiNLP, Center for Information and Language Processing, LMU Munich, Germany. +1

  24. Unified Multimodal Model for Brain MRI Imputation and Understanding

    Jun 15, 2026Zhiyun Song, Che Liu, Tian Xia +2Missing-Modality LearningUnified Multimodal Models

    Department of Computing, Imperial College London, London, UK · Department of Brain Sciences, Imperial College London, London, UK

  25. Calibrated Triage, Not Autonomy: Confidence Estimation for Medical Vision-Language Models

    Jun 14, 2026Reza Khanmohammadi, Kundan Thind, Mohammad M. GhassemiVLM EvaluationSelective Prediction

    Michigan State University East Lansing, MI, USA · Henry Ford Health Detroit, MI, USA

  26. Object Tokens as a Bridge Between Segmentation and Visual Question Answering in Robotic Surgery

    Jun 14, 2026Yiping Li, Ronald de Jong, Romy van Jaarsveld +5Medical VQASurgical Video Understanding

    Department of Biomedical Engineering, Eindhoven University of Technology, The Netherlands · Department of Surgery, University Medical Center Utrecht, The Netherlands · Department of Electrical Engineering, Eindhoven University of Technology, The Netherlands

  27. ReportQA: QA-Based Radiology Report Evaluation

    Jun 13, 2026Yiming Shi, Shaoshuai Yang, Xi Chen +10Radiology Report GenerationMedical VLMs

    Department of Electronic Engineering, Tsinghua University · Beijing Electronic Digital & Intelligence · College of AI, Tsinghua University +1

  28. HSQ-VLM: A Novel Spatially-Constrained Quadrant Segmentation VLM Model for Explainability in Diabetic Retinopathy

    Jun 11, 2026Shivum TelangMedical VLMsMedical Image Segmentation

    Pittsburgh, Pennsylvania

  29. OpenMedQ: Broad Open Pretraining for Medical Vision-Language Models

    Jun 11, 2026Ibrahim Gulluk, Max Van Puyvelde, Olivier GevaertMedical VQAMedical Image Classification

    Department of Electrical Engineering, Stanford University · Department of Biomedical Data Science, Stanford University School of Medicine · Department of Mathematical Modelling, Statistics and Bioinformatics, Ghent University

  30. Analyzing and Improving Fine-grained Preference Optimization in Medical LVLMs

    Jun 10, 2026Shayan Mohammadizadehsamakosh, Pritam Sarkar, Leonid Sigal +2Medical VLMsMedical Image Grounding

    York University · Vector Institute · University of British Columbia +1