Medical Visual Question Answering

Also known as VQA

Overview

Medical visual question answering (MedVQA) asks models to interpret images such as X-rays, scans, pathology slides, and surgical videos in response to clinical questions, supporting tasks from finding specific abnormalities to integrating evidence across views or time. Common approaches adapt vision-language models with medical image-question datasets, while newer methods add region grounding, clinical knowledge, stepwise reasoning, or tools for measurements and image navigation. Benchmarks increasingly test spatial, temporal, multilingual, and multi-image reasoning, as well as whether answers actually depend on the visual evidence. A central challenge remains that high answer accuracy can coexist with shortcut use, hallucinations, poor calibration, or weak generalization across modalities and clinical settings.

Latest papers

CardsList

183 papers8 papers in the last four weeks, down 58% on the four weeks before. 0.1% of all new papers.

  1. Ophiuchus: Incentivizing Tool-augmented "Think with Images" for Joint Medical Segmentation, Understanding and Reasoning

    Dec 16, 2025Yankai Jiang, Yujie Zhang, Peng Zhang +5Image SegmentationTool Use in VLMs

  2. Echo-CoPilot: A Multiple-Perspective Agentic Framework for Reliable Echocardiography Interpretation

    Dec 6, 2025Moein Heidari, Ali Mehrabian, Mohammad Amin Roohi +5Medical Visual Question AnsweringEchocardiography

  3. MultiViewDx: Evidence-Linked Multi-View Clinical Diagnosis

    Oct 19, 2024Junda Wang, Zonghai Yao, Yujan Ting +5HealthcareMedical Image Analysis