Medical VLMs

VLM: Vision-Language Model

Ask about this topic

Momentum

22 papers in the last four weeks, up 22% on the four weeks before. 0.2% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 266

All topics
CardsList

  1. Scientific Domain Knowledge Improves Vision-Language Fundus Models

    May 4, 2026Verena Jasmin Hallitschke, Carsten Eickhoff, Philipp BerensHealthcareMedical Diagnosis

    1Hertie Institute for AI in Brain Health, University of Tübingen, Tübingen, Germany · Institute for Applied Medical Informatics, University of Tübingen, Tübingen, Germany · 2Tübingen AI Center, Tübingen, Germany

  2. Ultrasound Vision-Language Alignment via Contrastive Learning

    May 4, 2026Zhuoyang Lyu, Yiyang Zhang, Tongxin Wang +1Cross-Modal AlignmentUltrasound Imaging

    Department of Biostatistics Harvard T. H. Chan School of Public Health Boston, MA, USA

  3. Exploring Prompt Alignment with Clinical Factors in Zero-Shot Segmentation VLMs for NSCLC Tumor Segmentation

    May 2, 2026Suraj Pai, Thibault Heintz, Cosmin Ciausu +3VLM RobustnessImage Segmentation

    Artificial Intelligence in Medicine Program, Mass General Brigham, Harvard Medical School, USA

  4. Echo-α: Large Agentic Multimodal Reasoning Model for Ultrasound Interpretation

    Apr 30, 2026Jing Zhang, Wentao Jiang, Tao Huang +8Medical Image AnalysisMultimodal Reasoning

    School of Computer Science, Wuhan University, China · The Central Hospital of Wuhan, China · Taizhou Hospital of Zhejiang Province, China +1

  5. Iterative Multimodal Retrieval-Augmented Generation for Medical Question Answering

    Apr 30, 2026Xupeng Chen, Binbin Shi, Chenqian Le +5Multimodal RAGRetrieval-Augmented Generation

    New York University, New York, USA · Tsinghua University, Beijing, China · Independent Researcher +1

  6. Auditing Frontier Vision-Language Models for Trustworthy Medical VQA: Grounding Failures, Format Collapse, and Domain Adaptation

    Apr 30, 2026Xupeng Chen, Binbin Shi, Chenqian Le +5VLM EvaluationHealthcare

    New York University, New York, USA · Tsinghua University, Beijing, China · Columbia University, New York, USA +1

  7. CheXthought: A global multimodal dataset of clinical chain-of-thought reasoning and visual attention for chest X-ray interpretation

    Apr 29, 2026Sonali Sharma, Jin Long, George Shih +7Chest X-Ray ClassificationMedical Image Analysis

    Center for Artificial Intelligence in Medicine and Imaging, Stanford University, Stanford, CA, USA · Department of Radiology, Stanford University, Stanford, CA, USA · Department of Pediatrics, Stanford University School of Medicine, Stanford, California, USA +6

  8. MedSynapse-V: Bridging Visual Perception and Clinical Intuition via Latent Memory Evolution

    Apr 29, 2026Chunzheng Zhu, Jiaqi Zeng, Junyu Jiang +2Memory-Augmented Language ModelsMedical Image Analysis

    Hunan University, Changsha, China

  9. Toward Multimodal Conversational AI for Age-Related Macular Degeneration

    Apr 28, 2026Ran Gu, Benjamin Hou, Mélanie Hébert +5Medical DiagnosisMedical VQA

    Division of Intramural Research, NaMonal Library of Medicine, NaMonal InsMtutes of Health, Bethesda, Maryland, USA · 2. Division of Epidemiology and Clinical ApplicaMons, NaMonal Eye InsMtute, NaMonal InsMtutes of Health, Bethesda, Maryland, USA · 1. Division of Intramural Research, NaMonal Library of Medicine, NaMonal InsMtutes of Health, Bethesda, Maryland, USA

  10. Learning from Medical Entity Trees: An Entity-Centric Medical Data Engineering Framework for MLLMs

    Apr 28, 2026Jianghang Lin, Haihua Yang, Deli Yu +6Training Data CurationMultimodal QA

    Key Laboratory of Multimedia Trusted Perception and Efficient Computing, Ministry of Education of China, Xiamen University, China · ByteDance · Northeastern University

  11. Sum-of-Checks: Structured Reasoning for Surgical Safety with Large Vision-Language Models

    Apr 24, 2026Weiqiu You, Cassandra Goldberg, Amin Madani +2EndoscopySurgical Video Understanding

    Department of Computer and Information Science, University of Pennsylvania, Philadelphia, PA, USA. · Department of Surgery, University of Toronto, Toronto, ON, Canada. · Surgical Artificial Intelligence Research Academy, University Health Network, Toronto, ON, Canada. +1

  12. Weighting What Matters: Boosting Sample Efficiency in Medical Report Generation via Token Reweighting

    Apr 22, 2026Alexander Weers, Daniel Rueckert, Martin J. MentenMedical Report GenerationHealthcare

    TUM School of Computation, Information and Technology, Technical University of Munich, DE · Munich Center for Machine Learning (MCML), DE · Department of Computing, Imperial College London, UK

  13. InVitroVision: a Multi-Modal AI Model for Automated Description of Embryo Development using Natural Language

    Apr 22, 2026Nicklas Neu, Thomas Ebner, Jasmin Primus +4VLM AdaptationMedical VLMs

    Software Competence Center Hagenberg GmbH,Softwarepark 32a,Hagenberg, 4232, Upper Austria, Austria · Kinderwunsch Zentrum Kepler Universitätsklinikum,Krankenhausstraße 26, Linz, 4021 Upper Austria, Austria · Wunschkind Klinik Dr. Brunbauer, Ebendorferstraße 6/4 Vienna, 1010, Vienna, Austria

  14. Infection-Reasoner: A Compact Vision-Language Model for Wound Infection Classification with Evidence-Grounded Clinical Reasoning

    Apr 21, 2026Palawat Busaranuvong, Reza Saadati Fard, Emmanuel Agu +4HealthcareMedical Diagnosis

    Worcester Polytechnic Institute, USA

  15. REVEAL: Multimodal Vision-Language Alignment of Retinal Morphometry and Clinical Risks for Incident AD and Dementia Prediction

    Apr 20, 2026Seowung Leem, Lin Gu, Chenyu You +2Alzheimer's DiseaseMedical Imaging

    J. Crayton Pruitt Family Department of Biomedical Engineering, University of Florida, United2026 States · Research Institute of Electrical Communication, Tohoku University, Japan · Department of Applied Mathematics & Statistics, Stony Brook University, United StatesApr +1

  16. ProtoCLIP: Prototype-Aligned Latent Refinement for Robust Zero-Shot Chest X-Ray Classification

    Apr 20, 2026Florian Kittler, Sheethal Bhat, Andreas MaierVLM RobustnessChest X-Ray Classification

    Friedrich-Alexander University Erlangen-Nuremberg, Erlangen 91054, Germany

  17. Medical Image Understanding Improves Survival Prediction via Visual Instruction Tuning

    Apr 20, 2026Xixi Liu, Jorge Lazo, Andreas Hallqvist +8Clinical Outcome PredictionMedical VLMs

    Chalmers University of Technology, Gothenburg, Sweden

  18. Can LLM-Generated Text Empower Surgical Vision-Language Pre-training?

    Apr 20, 2026Chengan Che, Chao Wang, Jiayuan Huang +2Surgical Video UnderstandingMedical VLMs

    Visual Understanding Research Group, Department of Informatics, King’s College London, UK

  19. BioVLM: Routing Prompts, Not Parameters, for Cross-Modality Generalization in Biomedical VLMs

    Apr 19, 2026Mainak Singha, Tanisha Gupta, Ankit Jha +3Cross-Modal LearningPrompt Learning

    University of Trento, Italy · Carnegie Mellon University, USA · LNMIIT Jaipur, India +3

  20. PBSBench: A Multi-Level Vision-Language Framework and Benchmark for Hematopathology Whole Slide Image Interpretation

    Apr 19, 2026Yuanlong Wang, Weichi Chen, Adrian Rajab +4Computational PathologyMedical VQA

    The Ohio State University · The Ohio State University Wexner Medical Center

  21. When Background Matters: Breaking Medical Vision Language Models by Transferable Attack

    Apr 19, 2026Akash Ghosh, Subhadip Baidya, Sriparna Saha +1VLM RobustnessAdversarial Attacks on VLMs

    Indian Institute of Technology Patna1 · Work done as Visiting Researcher at MBZUAI · MBZUAI3 +1

  22. DREAM: Dynamic Retinal Enhancement with Adaptive Multi-modal Fusion for Expert Precision Medical Report Generation

    Apr 19, 2026Nagur Shareef Shaik, Teja Krishna Cherukuri, Dong Hye YeMedical ImagingMedical Report Generation

    Department of Computer Science, Georgia State University, Atlanta, GA USA

  23. Bias-constrained multimodal intelligence for equitable and reliable clinical AI

    Apr 18, 2026Cheng Li, Weijian Huang, Jiarun Liu +6Unified Multimodal ModelsAlgorithmic Fairness

    Paul C. Lauterbur Research Center for Biomedical Imaging, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China. · Pengcheng Laboratory, Shenzhen, China. · University of Chinese Academy of Sciences, Beijing, China. +3

  24. Expert-Annotated Embryo Image Dataset with Natural Language Descriptions for Evidence-Based Patient Communication in IVF

    Apr 16, 2026Nicklas Neu, Thomas Ebner, Jasmin Primus +4Medical VLMsExplainable Medical Image Analysis

    1Software Competence Center Hagenberg, Hagenberg, 4232, Austria · 2Kepler Universitätsklinikum, Kinderwunsch Zentrum, Linz, 4020, Austria · 3Wunschkind Klinik Dr. Brunbauer, Wien, 1010, Austria

  25. MedP-CLIP: Medical CLIP with Region-Aware Prompt Integration

    Apr 13, 2026Jiahui Peng, He Yao, Jingwen Li +9Promptable Image SegmentationMultimodal Pretraining

    aSichuan University, Chengdu, 610065, China · bXinjiang University, Urumqi, 830046, China · cAlibaba Group, Hangzhou, 310023, China +3

  26. MedLayBench-V: A Large-Scale Benchmark for Expert-Lay Semantic Alignment in Medical Vision Language Models

    Apr 7, 2026Han Jang, Junhyeok Lee, Heeseong Eum +1HealthcareMedical VLMs

    Seoul National University · Department of Radiology, Seoul National University Hospital · The Advanced Imaging and Computational Neuroimaging (AICON) Laboratory +2

  27. An Approach to Enriching Surgical Video Datasets for Fine-Grained Spatial-Temporal Understanding of Vision-Language Models

    Apr 1, 2026Lennart Maack, Alexander SchlaeferMedical VQASurgical Video Understanding

    Hamburg University of Technology, Germany

  28. SurgTEMP: Temporal-Aware Surgical Video Question Answering with Text-guided Visual Memory for Laparoscopic Cholecystectomy

    Mar 31, 2026Shi Li, Vinkle Srivastav, Shih-Min Yin +7Medical VQASurgical Video Understanding

    University of Strasbourg, CNRS, INSERM, ICube, UMR7357, Strasbourg, France · IHU Strasbourg, Strasbourg, France · Department of General Surgery, Kaohsiung Chang Gung Memorial Hospital, Chang Gung University College of Medicine, Kaohsiung, Taiwan +1

  29. Calibrated Confidence Expression for Radiology Report Generation

    Mar 31, 2026David Bani-Harouni, Chantal Pellegrini, Julian Lüers +6Radiology Report GenerationMedical VLMs

    Computer Aided Medical Procedures, Technical University of Munich, Germany · Munich Center for Machine Learning (MCML), Germany · Department of Diagnostic and Interventional Radiology, TUM Klinikum rechts der Isar, Germany +3

  30. A Comparative Study in Surgical AI: Potential and Limitations of Data, Compute, and Scaling

    Mar 28, 2026Kirill Skobelev, Eric Fithian, Yegor Baranovski +9Surgical Video UnderstandingLanguage Model Scaling

    Center for Applied AI, Chicago Booth, Chicago, IL, USA · 2Surgical Data Science Collective, Washington D.C., USA · 3Children’s National Hospital, Washington D.C., USA +1