Medical Visual Question Answering

Also known as VQA

Overview

Medical visual question answering (MedVQA) asks models to interpret images such as X-rays, scans, pathology slides, and surgical videos in response to clinical questions, supporting tasks from finding specific abnormalities to integrating evidence across views or time. Common approaches adapt vision-language models with medical image-question datasets, while newer methods add region grounding, clinical knowledge, stepwise reasoning, or tools for measurements and image navigation. Benchmarks increasingly test spatial, temporal, multilingual, and multi-image reasoning, as well as whether answers actually depend on the visual evidence. A central challenge remains that high answer accuracy can coexist with shortcut use, hallucinations, poor calibration, or weak generalization across modalities and clinical settings.

Latest papers

CardsList

175 papers19 papers in the last four weeks, up 46% on the four weeks before. 0.1% of all new papers.

  1. Ryze: Evidence-Enriched Data Synthesis from Biomedical Papers

    May 30, 2026Yeqi Huang, Yue Chen, Yanwei Ye +2VLM AdaptationSynthetic Data Generation

  2. Pocket-Dentist: On-Device Dental Image Understanding via Efficient Multimodal Large Language Models

    May 28, 2026Kai Bian, Xucheng Guo, Bin Chen +4Medical ImagingEfficient VLM Inference

  3. VITAL: Visual-Semantic Dual Supervision for Enhanced and Interpretable Latent Reasoning in Medical MLLMs

    May 27, 2026Qiaoru Li, Shaotian Liang, Jintao Chen +4Medical Visual Question AnsweringVLM Interpretability

  4. OphIn-500K: Curating Web-Scale Visual Instructions for Scaling Ophthalmic Multimodal Large Language Models

    May 27, 2026Xuanzhao Dong, Wenhui Zhu, Xiwen Chen +13Medical Image AnalysisMedical Visual Question Answering

  5. Towards Reliable Fetal Ultrasound Interpretation with Multi-Agent Collaboration

    May 25, 2026Xiaotian Hu, Mingxuan Liu, Junwei Huang +13Multi-Agent LLM SystemsMedical Visual Question Answering

  6. Parameter-Efficient VLMs for Gastrointestinal Endoscopy: Medical Image Generation and Clinical Visual Question Answering

    May 24, 2026Ojonugwa Oluwafemi Ejiga Peter, Frederick Akor Ejiga, Fahmi Khalifa +1EndoscopyMedical Imaging

  7. EchoVQA: Enabling Conversational Assistance for Point-of-Care Cardiac Ultrasound

    May 22, 2026Filippos Bellos, Yutong Li, Jessie N Dong +6Medical Visual Question AnsweringEchocardiography

  8. PathNavigate: A Training-Free Pathology Agent with Surprise-Guided Scan and Shared Slide Memory for Whole-Slide Image VQA

    May 22, 2026Chunze Yang, Qidong Liu, Wenjie Zhao +10HealthcareMedical Visual Question Answering

  9. RoboSurg-VQA: A Multimodal Benchmark for Surgical Segmentation-Aware Visual Question Answering

    May 21, 2026Chengyi Zhang, Zi Ye, Ziyang WangMedical Visual Question AnsweringMedical Image Benchmarks

  10. Towards Clinically Interpretable Ophthalmic VQA via Spatially-Grounded Lesion Evidence

    May 21, 2026Xingyue Wang, Bo Liu, Meng Wang +4Medical Visual Question AnsweringFundus Imaging

  11. JMed48k: A Multi-Profession Japanese Medical Licensing Benchmark for Vision-Language Model Evaluation

    May 21, 2026Yue Xun, Junyu Liu, Qian Niu +10VLM EvaluationHealthcare

  12. Look-Closer-Then-Diagnose: Confidence-Aware Ultrasound VQA via Active Zooming

    May 20, 2026Yue Zhou, Erxuan Wu, Yikang Sun +5Visual Question AnsweringUncertainty Estimation for VLA Models

  13. VIHD: Visual Intervention-based Hallucination Detection for Medical Visual Question Answering

    May 20, 2026Jiayi Chen, Benteng Ma, Zehui Liao +3Hallucination Detection in VLMsHealthcare

  14. NeuroQA: A Large-Scale Image-Grounded Benchmark for 3D Brain MRI Understanding

    May 19, 2026Mohammad H. Abbasi, Favour Nerrise, Shaurnav Ghosh +12Healthcare3D Medical Imaging

  15. Rethinking Visual Attribution for Chest X-ray Reasoning in Large Vision Language Models

    May 19, 2026Guangzhi Xiong, Qiao Jin, Sanchit Sinha +2Medical Visual Question AnsweringVLM Interpretability

  16. M3QuestionIngM^3 QuestionIng: Multi-modal Multi-span Medical Question Answering

    May 19, 2026Anisha Saha, Vaibhav Rathore, Abhisek Tiwari +3Medical Visual Question AnsweringMultimodal QA

  17. Wasserstein Equilibrium Decoding for Reliable Medical Visual Question Answering

    May 18, 2026Luca Hagen, Johanna P. Müller, Weitong Zhang +2HealthcareEfficient VLM Inference

  18. How Good LLMs Are at Answering Bangla Medical Visual Questions? Dataset and Benchmarking

    May 18, 2026Rafid Ahmed, Intesar Tahmid, Mir Sazzat Hossain +3VLM EvaluationMultilingual Language Model Evaluation

  19. SurgLQA: Scalable Long-Horizon Surgical Video Question Answering

    May 18, 2026Diandian Guo, Xikai Yang, Ruiyang Li +2Temporal Video GroundingTest-Time Scaling

  20. UCSF-PDGM-VQA: Visual Question Answering dataset for brain tumor MRI interpretation

    May 16, 2026Shiv Ghosh, Junayd Lateef, Chih-Hua Liu +3VLM EvaluationMedical Visual Question Answering

  21. MI-CXR: A Benchmark for Longitudinal Reasoning over Multi-Interval Chest X-rays

    May 15, 2026Sunghwan Steve Cho, Yunseok Han, Jaeyoung DoVLM EvaluationHealthcare

  22. RoiMAM: Region-of-Interest Medical Attention Model for Efficient Vision-Language Understanding

    May 15, 2026Jiayan Yang, Zhuoyu Wu, Wenqi FangHealthcareEfficient VLM Inference

  23. Verification Mirage: Mapping the Reliability Boundary of Self-Verification in Medical VQA

    May 11, 2026Ruinan Jin, Beidi Zhao, Myeongkyun Kang +2VLM EvaluationVision-Language Models

  24. RadThinking: A Dataset for Longitudinal Clinical Reasoning in Radiology

    May 11, 2026Wenxuan Li, Pedro R. A. S. Bassi, Xinze Zhou +3HealthcareMedical Visual Question Answering

  25. DeepTumorVQA: A Hierarchical 3D CT Benchmark for Stage-Wise Evaluation of Medical VLMs and Tool-Augmented Agents

    May 10, 2026Yixiong Chen, Wenjie Xiao, Pedro R. A. S. Bassi +7VLM EvaluationTool Use in VLMs

  26. LiteMedCoT-VL: Parameter-Efficient Adaptation for Medical Visual Question Answering

    May 10, 2026Runze Ma, Shunbo Jia, Haonan Lyu +2CoT DistillationHealthcare

  27. Lost in Volume: The CT-SpatialVQA Benchmark for Evaluating Semantic-Spatial Understanding of 3D Medical Vision-Language Models

    May 9, 2026Mashrafi Monon, Umaima Rahman, Asif Hanif +2VLM Evaluation3D Spatial Reasoning

  28. MedVIGIL: Evaluating Trustworthy Medical VLMs Under Broken Visual Evidence

    May 8, 2026Hanqi Jiang, Junhao Chen, Mingyu Kang +12VLM EvaluationVLM Robustness

  29. MedHorizon: Towards Long-context Medical Video Understanding in the Wild

    May 7, 2026Bodong Du, Bowen Liu, Yang Yu +8HealthcareMedical Visual Question Answering

  30. CXR-ContraBench: Benchmarking Negated-Option Attraction in Medical VLMs

    May 7, 2026Zhengru Fang, Yanan Ma, Yu Guo +5VLM EvaluationChest X-Ray Classification