Medical Visual Question Answering

Also known as VQA

Overview

Medical visual question answering (MedVQA) asks models to interpret images such as X-rays, scans, pathology slides, and surgical videos in response to clinical questions, supporting tasks from finding specific abnormalities to integrating evidence across views or time. Common approaches adapt vision-language models with medical image-question datasets, while newer methods add region grounding, clinical knowledge, stepwise reasoning, or tools for measurements and image navigation. Benchmarks increasingly test spatial, temporal, multilingual, and multi-image reasoning, as well as whether answers actually depend on the visual evidence. A central challenge remains that high answer accuracy can coexist with shortcut use, hallucinations, poor calibration, or weak generalization across modalities and clinical settings.

Latest papers

CardsList

183 papers8 papers in the last four weeks, down 58% on the four weeks before. 0.1% of all new papers.

  1. Harnessing Medical Visual-Language Models with Agentic Evidence Management

    Nov 19, 2026Qiming Huang, Hanze Dong, Jipeng Zhang +3Tool Use in VLMsMedical Visual Question Answering

  2. OmniTongue: A Comprehensive MLLM Benchmark for Automated Tongue Diagnosis in Traditional Chinese Medicine

    Nov 17, 2026Liuyi Xu, Yun Guo, Shusheng Li +3Medical VLMsMedical Diagnosis

  3. MedJev: A System One Vision-Language Decision Model for Fast and Effective Medical Image Understanding

    Nov 16, 2026Fan Zhang, Hao Wu, Jinyang Wu +5Medical VLMsVLM Inference

  4. QCAP-VQA: Question-Conditioned Capped Prior-Mass Supervision for Medical Visual Question Answering

    Nov 13, 2026Yining Zhao, Catarina Moreira, Mukesh Prasad +1Medical Visual Question AnsweringMedical Image Grounding

  5. EndoSCOP-V: A Multi-Turn Video Understanding Evaluation Framework for Multimodal Models in Endoscopy Reporting and Clinical Reasoning

    Nov 7, 2026Abhishek Tyagi, Tanmay Jain, Vilas Biradar +15MLLM EvaluationEndoscopy

  6. Density-Aware Calibration for Resource-Efficient Medical Vision-Language Models

    Oct 31, 2026Tien-Dat Dam, Huu-Thuan Huynh, Minh-Triet Tran +1VLM CalibrationMedical VLMs

  7. GRASP: Group-Adaptive Hybrid RL-SFT Post-Training for Medical VQA without Reasoning Annotations

    Oct 25, 2026Wanqi Dong, Wanyue Dong, Jingze Ge +1Medical Visual Question AnsweringMedical VLMs

  8. Conviction Without Evidence: Verdict Stability Is Independent of Visual Grounding in Medical Vision--Language Models

    Oct 25, 2026Federico Felizzi, Francesco Andrea Causio, Bianca Destro Castaniti +17Medical VLMsVisual Evidence Sensitivity in VLMs

  9. MIS-VQA: An Annotation-Driven Surgical Vision-Language Dataset for Complex Surgical Understanding

    Oct 25, 2026Mohamed Hamdy, Iheb Zouari, Fatmaelzahraa Ahmed +6Medical Visual Question AnsweringSurgical Video Understanding

  10. Learning When to Collaborate: Selective Multi-Agent Medical Reasoning via Uncertainty-Aware Routing

    Oct 24, 2026Jiacheng Hou, Xueliang Cui, Dan Lu +1Multi-Agent ReasoningMedical Visual Question Answering

  11. Enhancing RAG-based Medical VQA with Gated Multimodal Representations

    Oct 16, 2026Daniela Jimenez-Pano, Hugo Jair Escalante, Delia Irazú Hernández-FaríasGated Multimodal FusionMedical Visual Question Answering

  12. When Evidence Vanishes: Distilling Visual-Evidence Dependency in Medical Vision-Language Models

    Oct 16, 2026Qizhen Lan, Yiling Ma, Ruiqi Chen +8Medical VLMsVisual Evidence Sensitivity in VLMs

  13. MedSTP: Preserving Subspace and Transition Evidence for Medical VQA Token Pruning

    Oct 15, 2026Mengchen Fan, Qizhen Lan, Xi Xiao +6Visual Token PruningMedical Visual Question Answering

  14. PlanPath: Exploration-Guided Orchestration for Patient-Level Pathology Reasoning

    Oct 13, 2026Jiusong Ge, Mingzhao He, Qidong Liu +8Pathology Visual Question AnsweringMedical Visual Question Answering

  15. Seeing Through the Forgery Is Not Enough: Regressive Sycophancy under Fabricated Evidence in Medical Vision-Language Models

    Oct 13, 2026Sadif Ahmed, Soumya Swagata Biswas, Rifat Shahriyar +1Sycophancy in VLMsMedical VLMs

  16. PathPilot: An Adaptive Question-Conditioned Multi-Magnification Navigation Agent for Whole-Slide Image Analysis

    Oct 12, 2026Zhengyang Xu, Han Li, Jingsong Liu +5Whole-Slide Image AnalysisComputational Pathology

  17. A doctrine-grounded visual question answering dataset for Tactical Combat Casualty Care

    Oct 5, 2026Junseob Kim, Jade Chng, Ayman Ali +5Medical Visual Question AnsweringVideo Question Answering

  18. MedPrune: Topology-Efficient Multimodal Multi-Agent Communication Evolution for Medical VQA Tasks

    Oct 5, 2026Jiuheng Wan, Runze Li, Chen Chen +5Communication Topology OptimizationMedical Visual Question Answering

  19. BrainTRACE: Tracing Longitudinal, Multimodal, and Volumetric Evidence in Brain MRI Clinical Reasoning

    Oct 5, 2026Qizhen Lan, Mengchen Fan, Hang Zhang +5VLM Evaluation3D Medical Imaging

  20. Localization Lens for Improving Medical Vision-Language Models

    Oct 3, 2026Hasan Farooq, Murtaza Taj, Mehwish Nasim +1Contrastive Learning for VLMsMedical VLMs

  21. CineMR: Tool-Integrated Vision-Language Reasoning for Quantitative Cardiac MRI Assessment

    Oct 1, 2026Kunyang Li, Hai Nguyen, Joshua Lowe +6Tool Use in VLMsMedical Visual Question Answering

  22. Learning Where to Look: Anatomical Grounding and Guided Attention for Cardiac MRI Vision-Language Models

    Sep 30, 2026Bangwei Guo, Xiao Chen, Boris Mailhe +8Medical Visual Question AnsweringMedical Image Grounding

  23. CRAFT: Causal Responsibility and Failure Tracing in Medical Vision Language Models

    Sep 30, 2026Chunzheng Zhu, Jiaqi Zeng, Hongbo Zhao +3Abstention in VLMsVision-Language Models

  24. See, Measure, and Reason: Learning Visually Grounded Reasoning in Pathology

    Sep 28, 2026Chengyang Zhang, Wenchuan Zhang, Bo Li +8Computational PathologyMedical Visual Question Answering

  25. Contamination, Prior, or Evidence? Decomposing and Training Evidence Use in Whole-Slide Vision-Language Models

    Sep 26, 2026Wenhao Zhang, Zhongliang Zhou, Shiyuan Zhang +6Pathology Visual Question AnsweringMedical VLMs

  26. Representation-guided in-context learning for medical image interpretation with multimodal large language models

    Sep 21, 2026Minda Zhao, Fangyu Hu, Yan Luo +8Medical Image AnalysisMultimodal Large Language Models