Medical Visual Question Answering

Also known as VQA

Overview

Medical visual question answering (MedVQA) asks models to interpret images such as X-rays, scans, pathology slides, and surgical videos in response to clinical questions, supporting tasks from finding specific abnormalities to integrating evidence across views or time. Common approaches adapt vision-language models with medical image-question datasets, while newer methods add region grounding, clinical knowledge, stepwise reasoning, or tools for measurements and image navigation. Benchmarks increasingly test spatial, temporal, multilingual, and multi-image reasoning, as well as whether answers actually depend on the visual evidence. A central challenge remains that high answer accuracy can coexist with shortcut use, hallucinations, poor calibration, or weak generalization across modalities and clinical settings.

Latest papers

CardsList

183 papers8 papers in the last four weeks, down 58% on the four weeks before. 0.1% of all new papers.

  1. A Unified Vision-Language Model for PSMA PET/CT Report Generation, Visual Question Answering, and Lesion Segmentation

    Sep 14, 2026Yang Xing, Jiong Wu, Savas Ozdemir +11Radiology Report GenerationMedical Visual Question Answering

  2. Option-Aware Retrieval and Task-Specific VLM Adaptation for Medical VQA

    Sep 14, 2026Tristan Kirscher, Niklas C. Koser, Soren PirkVLM AdaptationMultiple-Choice Question Answering

  3. A visual large language foundational model for medical image recognition using clinician-contributed online resources

    Sep 7, 2026Lingxuan Hou, Yuhua Xie, Yue Hu +14Medical Visual Question AnsweringMedical VLMs

  4. Separating Capability from Confidence: Grounded Dual-State Calibration for GRPO-Trained Medical Vision-Language Models

    Sep 6, 2026Yangyang Xie, Ke Hao, Jiaqi Liu +2Confidence Estimation for VLMsVLM Calibration

  5. MedQA-MM: Shortcuts Behind Medical Visual Reasoning

    Sep 3, 2026Benlu Wang, Yifan Zhang, Jiaqing Yu +7Medical Visual Question AnsweringShortcut Learning

  6. Candidate-Expanding Routing with Permutation-Stabilized Experts for Mixed-Format Medical VQA

    Sep 1, 2026Hai-Dang Nguyen, Huy-Hieu PhamMemory-Augmented VLMsVisual Question Answering

  7. SlideBank: A Persistent Hierarchical Evidence Bank for Consistent Whole-Slide Reasoning

    Aug 31, 2026Beidi Zhao, Gexin Huang, Ciro Zhang +6Memory-Augmented VLMsMedical Visual Question Answering

  8. Source-Dependent Deference in Medical Imaging Agents Under Falsified Findings: A Pilot Audit

    Aug 30, 2026Ridam Roy, Md Shahriar Rashid, Md. Rajib MiaTool-Use EvaluationMedical Visual Question Answering

  9. PROVE: Proof-guided Regime-aware Operator Verification for Hallucination Detection in Medical Visual Question Answering

    Aug 28, 2026Keyang Zhou, Siyi Li, Zhongnan Shi +3Hallucination Detection in VLMsMedical Visual Question Answering

  10. From Reasoning to Pixels: Grounded Medical Multimodal LLMs for VQA and Segmentation

    Aug 27, 2026Haowen Gu, Gensheng Pei, Junzhu Mao +3Medical VLMsMedical Image Grounding

  11. MedFG-VQA: Low-Frequency Memory and Graph Attention for Lightweight Medical VQA

    Aug 27, 2026Haowen Gu, Gensheng Pei, Zeren Sun +4Medical Visual Question AnsweringMemory-Augmented VLMs

  12. SeVeR: Selective Visual Exposure and Retrieval for 3D Medical Image Question Answering

    Aug 26, 2026Yaojun Hu, Danyang Tu, Yang Liu +8Medical Visual Question AnsweringMedical VLMs

  13. Analyzing and Mitigating Cross-Lingual Degradation in Multilingual Medical VQA

    Aug 23, 2026Jingbo Wang, Sendong Zhao, Haochun Wang +2Medical Visual Question AnsweringMedical VLMs

  14. A Modular Agent for Reliable and Auditable Spatial Relation Verification in CT Scans

    Aug 21, 2026Simon Vincent Abel, Heiko Hillenhagen, Michael Götz +3Medical Image AnalysisMedical Visual Question Answering

  15. Polish Medical Visual Question Answering: Vision-Language Models Underutilize Visual Evidence

    Aug 13, 2026Jakub Pokrywka, Łukasz Grzybowski, Antoni Lasik +3Medical Visual Question AnsweringMultilingual VLM Evaluation

  16. CARE: Confidence-Aware Reasoning for Reliable Medical VQA

    Aug 11, 2026Yuetian Du, Yucheng Wang, Zhenyuan Chen +9Medical Visual Question AnsweringMedical VLMs

  17. Agentic Visual Reasoning in Whole-Slide Pathology Images via Active Perception

    Aug 9, 2026Jingyun Chen, Fengchun Liu, Linghan Cai +5Active PerceptionMedical Visual Question Answering

  18. Frequency-Domain Dual-Branch Fusion for Medical Visual Question Answering

    Aug 8, 2026Yusra Tariq, Rakesh Chandra JoshiMedical Visual Question AnsweringMultimodal Fusion

  19. Beyond Relevance: Bayesian Evidence Acquisition for Agentic Whole-Slide Image Reasoning

    Aug 6, 2026Bryan Wong, Xun Xu, Huazhu Fu +2Visual Question AnsweringComputational Pathology

  20. CARVE: Cross-Slice Anisotropic Reallocation of Visual Evidence for Efficient 3D Medical Volume Understanding

    Aug 5, 2026Zhenyu Yi, Qiang Hu, Zhenhao Li +33D Medical ImagingMedical Visual Question Answering

  21. Slot2Text: Object-Centric Visual Tokenization for Efficient and Spatially Traceable Surgical MLLMs

    Aug 2, 2026Guiqiu Liao, Matjaz Jogan, Daniel A. HashimotoImage TokenizationHealthcare

  22. SPARC-Rad: A Multimodal Benchmark Dataset and Evaluation Pipeline for Spatial and Anatomical Reasoning in Radiology Vision-Language Models

    Jul 30, 2026Satvik Tripathi, Mustafa Ege Seker, Kristian Quevada +8Radiology VLMsMedical Image Analysis

  23. PathView-Bench: Can Multimodal Large Language Models Achieve Fine-grained Multiscale Understanding of Pathology Images?

    Jul 30, 2026Zongyi Chen, Yu Liang, Jie Lin +1Computational PathologyMedical Visual Question Answering

  24. LoMeVQA: A Comprehensive Benchmark for Longitudinal Medical VQA

    Jul 30, 2026Zhilin Wu, Zhangkai Ni, Chengmei Yang +4Longitudinal Medical Image AnalysisMedical Visual Question Answering

  25. Position, Not Provenance: Separating Reasoning Mediation from Sycophancy in Medical Vision-Language Models

    Jul 29, 2026Supratik Bhowal, Subhrajyoti Basu, Aritra Gir Mahanta +1Medical Visual Question AnsweringMedical VLMs