Medical VQA

VQA: Visual Question Answering

Follow this topic Ask about this topic

Momentum

10 papers in the last four weeks, up 67% on the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28

Latest papers 115

All topics

RadThinking: A Dataset for Longitudinal Clinical Reasoning in Radiology
May 11, 2026Wenxuan Li, Pedro R. A. S. Bassi, Xinze Zhou +3Healthcare Medical VQA
Department of Computer Science, Johns Hopkins University · Clinic of Radiology and Nuclear Medicine, University Hospital Basel · Department of Oncology, Johns Hopkins School of Medicine
DeepTumorVQA: A Hierarchical 3D CT Benchmark for Stage-Wise Evaluation of Medical VLMs and Tool-Augmented Agents
May 10, 2026Yixiong Chen, Wenjie Xiao, Pedro R. A. S. Bassi +7VLM Evaluation Tool Use in VLMs
Johns Hopkins University · University of Bologna · Center for Biomolecular Nanotechnologies, Istituto Italiano di Tecnologia +3
LiteMedCoT-VL: Parameter-Efficient Adaptation for Medical Visual Question Answering
May 10, 2026Runze Ma, Shunbo Jia, Haonan Lyu +2CoT Distillation Healthcare
School of Information Technology Monash University Malaysia · Faculty of Innovation Engineering Macau University of Science and Technology · Department of Bioelectronics Faculty of Biomedical Engineering Shenzhen University of Advanced Technology +1
Lost in Volume: The CT-SpatialVQA Benchmark for Evaluating Semantic-Spatial Understanding of 3D Medical Vision-Language Models
May 9, 2026Mashrafi Monon, Umaima Rahman, Asif Hanif +2VLM Evaluation 3D Spatial Reasoning
Mohamed Bin Zayed University of Artificial Intelligence, Abu Dhabi, UAE · New York University Abu Dhabi, Abu Dhabi, UAE
MedVIGIL: Evaluating Trustworthy Medical VLMs Under Broken Visual Evidence
May 8, 2026Hanqi Jiang, Junhao Chen, Mingyu Kang +12VLM Evaluation VLM Robustness
University of Georgia · Chungbuk National University · Chungnam National University Hospital +5
MedHorizon: Towards Long-context Medical Video Understanding in the Wild
May 7, 2026Bodong Du, Bowen Liu, Yang Yu +8Healthcare Medical VQA
The Hong Kong University of Science and Technology · Xidian University · Baidu Inc.
CXR-ContraBench: Benchmarking Negated-Option Attraction in Medical VLMs
May 7, 2026Zhengru Fang, Yanan Ma, Yu Guo +5VLM Evaluation Chest X-Ray Classification
City University of Hong Kong · Tsinghua Shenzhen International Graduate School
DALPHIN: Benchmarking Digital Pathology AI Copilots Against Pathologists on an Open Multicentric Dataset
May 5, 2026Carlijn Lems, Sander Moonemans, Natálie Klubíčková +53Computational Pathology Healthcare
SurgCheck: Do Vision-Language Models Really Look at Images in Surgical VQA?
May 3, 2026Jongmin Shin, Ka Young Kim, Eunki Cho +2VLM Evaluation Medical VQA
Department of Surgery, Samsung Medical Center, Seoul 06351, Republic of Korea · Kyung Hee University, Yongin 17104, Republic of Korea
Auditing Frontier Vision-Language Models for Trustworthy Medical VQA: Grounding Failures, Format Collapse, and Domain Adaptation
Apr 30, 2026Xupeng Chen, Binbin Shi, Chenqian Le +5VLM Evaluation Healthcare
New York University, New York, USA · Tsinghua University, Beijing, China · Columbia University, New York, USA +1
Toward Multimodal Conversational AI for Age-Related Macular Degeneration
Apr 28, 2026Ran Gu, Benjamin Hou, Mélanie Hébert +5Medical Diagnosis Medical VQA
Division of Intramural Research, NaMonal Library of Medicine, NaMonal InsMtutes of Health, Bethesda, Maryland, USA · 2. Division of Epidemiology and Clinical ApplicaMons, NaMonal Eye InsMtute, NaMonal InsMtutes of Health, Bethesda, Maryland, USA · 1. Division of Intramural Research, NaMonal Library of Medicine, NaMonal InsMtutes of Health, Bethesda, Maryland, USA
X-PCR: A Benchmark for Cross-modality Progressive Clinical Reasoning in Ophthalmic Diagnosis
Apr 22, 2026Gui Wang, Zehao Zhong, YongSong Zhou +6Healthcare Medical Diagnosis
School of Computer Science and Software Engineering, Shenzhen University · 2Tsinghua University · 5Wenzhou Medical University +3
Dual Causal Inference: Integrating Backdoor Adjustment and Instrumental Variable Learning for Medical VQA
Apr 22, 2026Zibo Xu, Qiang Li, Ke Lu +3Multimodal Robustness Medical VQA
PBSBench: A Multi-Level Vision-Language Framework and Benchmark for Hematopathology Whole Slide Image Interpretation
Apr 19, 2026Yuanlong Wang, Weichi Chen, Adrian Rajab +4Computational Pathology Medical VQA
The Ohio State University · The Ohio State University Wexner Medical Center
Beyond a Single Frame: Multi-Frame Spatially Grounded Reasoning Across Volumetric MRI
Apr 17, 2026Lama Moukheiber, Caleb M. Yeung, Haotian Xue +33D Spatial Reasoning 3D Medical Imaging
Georgia Institute of Technology · Harvard University · Georgetown University
MetaDent: Labeling Clinical Images for Vision-Language Models in Dentistry
Apr 16, 2026Meng-Xun Li, Wen-Hui Deng, Zhi-Xing Wu +6VLM Evaluation Medical Image Analysis
Department of Prosthodontics, State Key Laboratory of Oral & Maxillofacial Reconstruction and Regeneration, Key Laboratory of Oral Biomedicine, Ministry of Education, Hubei Key Laboratory of Stomatology, School and Hospital of Stomatology, Wuhan University, Wuhan, Hubei, China · School of Artificial Intelligence, Wuhan University, Wuhan, Hubei, China · School of Computer Science, Wuhan University, Wuhan, Hubei, China +2
Overconfidence and Calibration in Medical VQA: Empirical Findings and Hallucination-Aware Mitigation
Apr 2, 2026Ji Young Byun, Young-Jin Park, Jean-Philippe Corbeil +1Vision-Language Models VLM Hallucination
Johns Hopkins University, School of Medicine · Massachusetts Institute of Technology · Microsoft Healthcare & Life Sciences
An Approach to Enriching Surgical Video Datasets for Fine-Grained Spatial-Temporal Understanding of Vision-Language Models
Apr 1, 2026Lennart Maack, Alexander SchlaeferMedical VQA Surgical Video Understanding
Hamburg University of Technology, Germany
SurgTEMP: Temporal-Aware Surgical Video Question Answering with Text-guided Visual Memory for Laparoscopic Cholecystectomy
Mar 31, 2026Shi Li, Vinkle Srivastav, Shih-Min Yin +7Medical VQA Surgical Video Understanding
University of Strasbourg, CNRS, INSERM, ICube, UMR7357, Strasbourg, France · IHU Strasbourg, Strasbourg, France · Department of General Surgery, Kaohsiung Chang Gung Memorial Hospital, Chang Gung University College of Medicine, Kaohsiung, Taiwan +1
Beyond Medical Diagnostics: How Medical Multimodal Large Language Models Think in Space
Mar 14, 2026Quoc-Huy Trinh, Xi Ding, Yang Liu +73D Spatial Reasoning Multimodal Large Language Models
MedAD-R1: Consistency-Reinforced Policy Optimization for Interpretable Medical Anomaly Detection
Feb 1, 2026Haitao Zhang, Yingying Wang, Jiaxiang Wang +5Healthcare Group Relative Policy Optimization
School of Informatics, Xiamen University · Institute of Artificial Intelligence, Xiamen University · Zhejiang Expressway Co., Ltd. +3
Ophiuchus: Incentivizing Tool-augmented "Think with Images" for Joint Medical Segmentation, Understanding and Reasoning
Dec 16, 2025Yankai Jiang, Yujie Zhang, Peng Zhang +5Image Segmentation Tool Use in VLMs
Zhejiang University · Shanghai Artificial Intelligence Laboratory · Shanghai Innovation Institute +5
Echo-CoPilot: A Multiple-Perspective Agentic Framework for Reliable Echocardiography Interpretation
Dec 6, 2025Moein Heidari, Ali Mehrabian, Mohammad Amin Roohi +5Medical VQA Echocardiography
The University of British Columbia, Vancouver, BC, Canada · Rutgers Cancer Institute, New Brunswick, NJ, USA
MultiViewDx: Evidence-Linked Multi-View Clinical Diagnosis
Oct 19, 2024Junda Wang, Zonghai Yao, Yujan Ting +5Healthcare Medical Image Analysis
United Imaging Intelligence, MA, USA · Manning College of Information and Computer Sciences, University of Massachusetts Amherst, MA, USA · Department of Medicine, University of Massachusetts Medical School, Worcester, MA, USA +1
Slot2Text: Object-Centric Visual Tokenization for Efficient and Spatially Traceable Surgical MLLMs
Date pendingGuiqiu Liao, Matjaz Jogan, Daniel A. HashimotoImage Tokenization Healthcare
GRASP Laboratory, University of Pennsylvania · PCASO Laboratory, Department of Surgery, University of Pennsylvania · Department of Computer and Information Science, University of Pennsylvania

May 11, 2026, cs.CVJ/K move · Enter open · S save

RadThinking: A Dataset for Longitudinal Clinical Reasoning in Radiology

Wenxuan Li, Pedro R. A. S. Bassi, Xinze Zhou, Jakob Wasserthal+2

Department of Computer Science, Johns Hopkins University · Clinic of Radiology and Nuclear Medicine, University Hospital Basel · Department of Oncology, Johns Hopkins School of Medicine

Healthcare Medical VQA Clinical Reasoning Oncology Medical Image Benchmarks

Open paper AskPDF arXiv

Cancer screening is a reasoning task. A radiologist observes findings, compares them to prior scans, integrates clinical context, and reaches a diagnostic conclusion confirmed by pathology. We present RadThinking, a Visual Question Answering (VQA) dataset that makes this reasoning explicit and trainable. RadThinking releases VQA pairs at three difficulty tiers. Foundation VQAs are atomic perception questions. Single-step reasoning VQAs apply one clinical rule. Compositional VQAs require multi-step chain-of-thought to reach a guideline category such as LI-RADS-5. For every compositional VQA, we release the chain of foundation VQAs that solves it. The chain follows the rules of the governing clinical reporting standard. The dataset spans 20,362 CT scans from 9,131 patients across 43 cancer groups, plus 2,077 verified healthy controls with >1-year follow-up. To our knowledge, RadThinking is the first cancer-screening VQA corpus that stratifies questions by reasoning depth and grounds compositions in clinical reporting standards. The foundation tier supplies atomic perception supervision. The compositional tier supplies chain-of-thought data and verifiable rewards for reinforcement-learning recipes such as DeepSeek-R1 and OpenAI o1. RadThinking enables systematic training and evaluation of whether AI systems can reason about cancer, not merely detect it.

Momentum

Related topics

Latest papers 115