Knowledge-Based Visual Question Answering

Follow this field Ask about this field

Recent momentum

emerging

0 papers in the last 28 days · 0.0% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Weekly history

Recent digests

What was published in this field, kept on the site without email delivery.

Period ending 2026-09-21

7 new papers

A weekly snapshot of new work published in Knowledge-Based Visual Question Answering.

Period ending 2026-09-14

9 new papers

A weekly snapshot of new work published in Knowledge-Based Visual Question Answering.

Period ending 2026-09-07

12 new papers

A weekly snapshot of new work published in Knowledge-Based Visual Question Answering.

Inside this field

Focused directions

Focused topic

Knowledge-Based Visual Question Answering

Within Knowledge-Based Visual Question Answering

106 papersExplore

Focused topic

Textvqa

Within Knowledge-Based Visual Question Answering

55 papersExplore

Focused topic

Knowledge-Based Visual Question Answering Benchmarks

Within Knowledge-Based Visual Question Answering

24 papersExplore

174 papers

Latest in Knowledge-Based Visual Question Answering

Browse all topics →

MetaRA: Metamorphic Robustness Assessment for Multimodal Large Language Model-based Visual Question Answering Systems
May 19, 2026Quanxing Xu, Yuhao Tian, Ling Zhou +4Knowledge-Based Visual Question Answering Multimodal Artificial Intelligence
UCSF-PDGM-VQA: Visual Question Answering dataset for brain tumor MRI interpretation
May 16, 2026Shiv Ghosh, Junayd Lateef, Chih-Hua Liu +3Brain Tumor Classification Textvqa
Chain-of-Procedure: Hierarchical Visual-Language Reasoning for Procedural QA
May 14, 2026Guanhua Chen, Yutong Yao, Shenghe Sun +5Knowledge-Based Visual Question Answering Large Vision Language Models
Training Long-Context Vision-Language Models Effectively with Generalization Beyond 128K Context
May 13, 2026Zhaowei Wang, Lishu Luo, Haodong Duan +9Efficient Long-Context Inference Large Vision Language Models
CiteVQA: Benchmarking Evidence Attribution for Trustworthy Document Intelligence
May 13, 2026Dongsheng Ma, Jiayu Li, Zhengren Wang +8Citations Multimodal Documents
RadThinking: A Dataset for Longitudinal Clinical Reasoning in Radiology
May 11, 2026Wenxuan Li, Pedro R. A. S. Bassi, Xinze Zhou +3Medical Visual Question Answering Clinical Reasoning
Geospatial-Temporal Sensemaking of Remote Sensing Activity Detections with Multimodal Large Language Model
May 11, 2026David F. Ramirez, Tim Overman, Kristen Jaskie +1Sentinel-2 Multimodal Dataset
MicroWorld: Empowering Multimodal Large Language Models to Bridge the Microscopic Domain Gap with Multimodal Attribute Graph
May 11, 2026Manyu Li, Ruian He, Chenxi Ma +2Textvqa Knowledge Graphs
DeepTumorVQA: A Hierarchical 3D CT Benchmark for Stage-Wise Evaluation of Medical VLMs and Tool-Augmented Agents
May 10, 2026Yixiong Chen, Wenjie Xiao, Pedro R. A. S. Bassi +7Medical Vision-Language Models Textvqa
LiteMedCoT-VL: Parameter-Efficient Adaptation for Medical Visual Question Answering
May 10, 2026Runze Ma, Shunbo Jia, Haonan Lyu +2Medical Visual Question Answering Textvqa
Lost in Volume: The CT-SpatialVQA Benchmark for Evaluating Semantic-Spatial Understanding of 3D Medical Vision-Language Models
May 9, 2026Mashrafi Monon, Umaima Rahman, Asif Hanif +2Medical Vision-Language Models 3D Spatial Reasoning
Beyond Bag-of-Patches: Learning Global Layout via Textual Supervision for Late-Interaction Visual Document Retrieval
May 8, 2026Pascal Tilli, Mohsen MesgarVisual Document Retrieval Knowledge-Based Visual Question Answering
PolarVLM: Bridging the Semantic-Physical Gap in Vision-Language Models
May 8, 2026Yuliang Li, Chu Zhou, Heng Guo +3Large Vision Language Models Polarization
Beyond GSD-as-Token: Continuous Scale Conditioning for Remote Sensing VLMs
May 8, 2026Song Zhang, Yanlong Chen, Yilin Li +4Remote Sensing Large Vision Language Models
A Regime Theory of Controller Class Selection for LLM Action Decisions
May 7, 2026Zhaoyang Jiang, Zhizhong Fu, Yunsoo Kim +4Large Language Model Decision-Making Textvqa
Towards Annotation-Free Validation of MLLMs: A Vision-Language Logical Consistency Metric
May 7, 2026Ying Gu, Mei Chee Leong, Hui Li Tan +3Large Language Model Evaluation Textvqa
Towards Self-Explainable Document Visual Question Answering with Chain-of-Explanation Predictions
May 7, 2026Kjetil Indrehus, Adrian Duric, Changkyu Choi +1Knowledge-Based Visual Question Answering Textvqa
VTAgent: Agentic Keyframe Anchoring for Evidence-Aware Video TextVQA
May 6, 2026Haibin He, Maoyuan Ye, Jing Zhang +2Video Question Answering Textvqa
Enhancing Visual Question Answering with Multimodal LLMs via Chain-of-Question Guided Retrieval-Augmented Generation
May 5, 2026Quanxing Xu, Ling Zhou, Xian Zhong +3Knowledge-Based Visual Question Answering Vision-Language
MHPR: Multidimensional Human Perception and Reasoning Benchmark for Large Vision-Languate Models
May 5, 2026Kangkang Wang, Qinting Jiang, Wanping Zhang +2Multimodal Reasoning Benchmarks Large Vision Language Models
WorldJen: An End-to-End Multi-Dimensional Benchmark for Generative Video Models
May 5, 2026Karthik Inbasekar, Guy Rom, Omer ShlomovitsLarge-Scale Video Generation Models Knowledge-Based Visual Question Answering
Chain of Evidence: Pixel-Level Visual Attribution for Iterative Retrieval-Augmented Generation
May 2, 2026Peiyang Liu, Ziqiang Cui, Xi Wang +2Multi-Source Retrieval-Augmented Generation Knowledge-Based Visual Question Answering
SpecVQA: A Benchmark for Spectral Understanding and Visual Question Answering in Scientific Images
Apr 30, 2026Jialu Shen, Han Lyu, Suyang Zhong +5Textvqa
Auditing Frontier Vision-Language Models for Trustworthy Medical VQA: Grounding Failures, Format Collapse, and Domain Adaptation
Apr 30, 2026Xupeng Chen, Binbin Shi, Chenqian Le +5Medical Visual Question Answering Textvqa
M $^3$ -VQA: A Benchmark for Multimodal, Multi-Entity, Multi-Hop Visual Question Answering
Apr 28, 2026Jiatong Ma, Longteng Guo, Yuchen Liu +4Knowledge-Based Visual Question Answering Multimodal Reasoning
Don't Pause! Every prediction matters in a streaming video
Apr 27, 2026Dibyadip Chatterjee, Zhanzhong Pang, Fadime Sener +2Streaming Video Textvqa
Multimodal QUD: Inquisitive Questions from Scientific Figures
Apr 26, 2026Yating Wu, William Rudman, Venkata S Govindarajan +2Multimodal Query Knowledge-Based Visual Question Answering
HAC: Parameter-Efficient Hyperbolic Adaptation of CLIP for Zero-Shot VQA
Apr 26, 2026Francesco Dibitonto, Cigdem Beyan, Vittorio MurinoFrozen Contrastive Language-Image Pre-Training Visual Encoder Knowledge-Based Visual Question Answering
Revisiting Greedy Decoding for Visual Question Answering: A Calibration Perspective
Apr 25, 2026Boqi Chen, Xudong Liu, Yunke Ao +1Knowledge-Based Visual Question Answering Camera Intrinsics
Lightweight and Production-Ready PDF Visual Element Parsing
Apr 25, 2026Meizhu Liu, Yassi Abbasi, Matthew Rowe +2Visual Document Retrieval Knowledge-Based Visual Question Answering
BERAG: Bayesian Ensemble Retrieval-Augmented Generation for Knowledge-based Visual Question Answering
Apr 24, 2026Jinghong Chen, Jingbiao Mei, Guangyu Yang +1Retrieval-Augmented Generation Systems Knowledge-Based Visual Question Answering
Can Multimodal Large Language Models Truly Understand Small Objects?
Apr 24, 2026Fujun Han, Junan Chen, Xintong Zhu +4Multi-Modal Large Language Models Small Language Models
Grounding Video Reasoning in Physical Signals
Apr 23, 2026Alibay Osmanli, Zixu Cheng, Shaogang GongTextvqa Spatial Grounding
CCTVBench: Contrastive Consistency Traffic VideoQA Benchmark for Multimodal LLMs
Apr 22, 2026Xingcheng Zhou, Hao Guo, Rui Song +5Accidents Textvqa
X-PCR: A Benchmark for Cross-modality Progressive Clinical Reasoning in Ophthalmic Diagnosis
Apr 22, 2026Gui Wang, Zehao Zhong, YongSong Zhou +6Multimodal Clinical Data Ophthalmology
WildFireVQA: A Large-Scale Radiometric Thermal VQA Benchmark for Aerial Wildfire Monitoring
Apr 22, 2026Mobin Habibpour, Niloufar Alipour Talemi, John Spodnik +2Wildfire Detection Wildfire Spread
PLaMo 2.1-VL Technical Report
Apr 21, 2026Tommi Kerola, Yuya Masuda, Takashi Masuko +5Large Vision Language Models Textvqa
Revisiting Change VQA in Remote Sensing with Structured and Native Multimodal Qwen Models
Apr 20, 2026Yakoub Bazi, Mohamad M. Al Rahhal, Mansour Zuair +1Remote Sensing Knowledge-Based Visual Question Answering
AeroRAG: Structured Multimodal Retrieval-Augmented LLM for Fine-Grained Aerial Visual Reasoning
Apr 20, 2026Junxiao Xue, Quan Deng, Tingqi Hu +4Knowledge-Based Visual Question Answering Multi-Source Retrieval-Augmented Generation
AutoVQA-G: Self-Improving Agentic Framework for Automated Visual Question Answering and Grounding Annotation
Apr 19, 2026Rongsheng Hu, Runwei Guan, Yicheng Di +2Knowledge-Based Visual Question Answering Textvqa
CoGR-MoE: Concept-Guided Expert Routing with Consistent Selection and Flexible Reasoning for Visual Question Answering
Apr 18, 2026Xiyin Zeng, Yi Lu, Hao WangKnowledge-Based Visual Question Answering Experts
VEFX-Bench: A Holistic Benchmark for Generic Video Editing and Visual Effects
Apr 17, 2026Xiangbo Gao, Sicong Jiang, Bangya Liu +12Video Editing Knowledge-Based Visual Question Answering
AEGIS: Anchor-Enforced Gradient Isolation for Knowledge-Preserving Vision-Language-Action Fine-Tuning
Apr 17, 2026Guransh SinghPretrained Vision-Language-Action Knowledge-Based Visual Question Answering
AIM: Asymmetric Information Masking for Visual Question Answering Continual Learning
Apr 16, 2026Peifeng Zhang, Zice Qiu, Donghua Yu +4Knowledge-Based Visual Question Answering Catastrophic Forgetting
Learning to Search: A Decision-Based Agent for Knowledge-Based Visual Question Answering
Apr 8, 2026Zhuohong Chen, Zhenxian Wu, Yunyao Yu +6Knowledge-Based Visual Question Answering Agent Decisions
Wiki-R1: Incentivizing Multimodal Reasoning for Knowledge-based VQA via Data and Sampling Curriculum
Mar 5, 2026Shan Ning, Longtian Qiu, Xuming HeKnowledge-Based Visual Question Answering Knowledge-Based Visual Question Answering Benchmarks
An Online Reference-Free Evaluation Framework for Flowchart Image-to-Code Generation
Feb 13, 2026Giang Son Nguyen, Zi Pong Lim, Sarthak Ketanbhai Modi +2Knowledge-Based Visual Question Answering Benchmarks Unified Evaluation
Counterfeit Answers: Adversarial Forgery against OCR-Free Document Visual Question Answering
Dec 4, 2025Marco Pintore, Maura Pintor, Dimosthenis Karatzas +1Knowledge-Based Visual Question Answering
Unexplored flaws in multiple-choice VQA make benchmarking unreliable
Nov 27, 2025Fabio Rosenthal, Sebastian Schmidt, Thorsten Graf +3Multiple-Choice Questions Knowledge-Based Visual Question Answering
From Hindsight to Foresight: Self-Encouraged Hindsight Distillation for Knowledge-based Visual Question Answering
Nov 14, 2025Yu Zhao, Ying Zhang, Xuhui Sui +4Knowledge-Based Visual Question Answering Hindsight
LUQ: Layerwise Ultra-Low Bit Quantization for Multimodal Large Language Models
Sep 28, 2025Shubhang Bhatnagar, Andy Xu, Kar-Han Tan +1Large Language Model Quantization Multi-Modal Large Language Models
PlantExpertVQA: A Visual Question Answering Dataset for Benchmarking Vision-Language Models in Plant Science
Aug 23, 2025Syed Nazmus Sakib, Nafiul Haque, Mohammad Zabed Hossain +1Apple Tree Leaf Disease Segmentation Dataset Knowledge-Based Visual Question Answering Benchmarks
A Study of Commonsense Reasoning over Visual Object Properties
Aug 14, 2025Abhishek Kolari, Mohammadhossein Khojasteh, Yifan Jiang +2Knowledge-Based Visual Question Answering Benchmarks Visual Reasoning
Copy-Move Forgery Detection and Question Answering for Remote Sensing Image
Dec 3, 2024Ze Zhang, Enyuan Zhao, Di Niu +3Remote Sensing Vision Datasets

May 19, 2026 · cs.CVJ/K move · Enter open · S save

MetaRA: Metamorphic Robustness Assessment for Multimodal Large Language Model-based Visual Question Answering Systems

Quanxing Xu, Yuhao Tian, Ling Zhou, Xian Zhong+3

Visual Question Answering (VQA), as the representative multimodal task, serves as a key benchmark for evaluating the reasoning capabilities of Multimodal Large Language Models (MLLMs). However, existing evaluations largely rely on static datasets and accuracy-based metrics, which fail to capture robustness, consistency, and generalization. Inspired by Metamorphic Testing (MT), we propose Metamorphic Robustness Assessment (MetaRA), a testing framework that employs Metamorphic Relations (MRs) to systematically probe vulnerabilities in MLLM-based VQA systems. MetaRA generates controlled variations of image-question inputs based on specific MRs and evaluates models across diverse conditions. Applying MetaRA to multiple MLLM-based VQA models across different tasks reveals nuanced failure patterns, including sensitivity to linguistic perturbations, over-reliance on superficial visual cues, and deeper weaknesses in multimodal reasoning. Experimental results demonstrate that MetaRA provides richer diagnostic insights than conventional accuracy metrics, exposing failure modes that remain hidden under standard benchmarks. Overall, this work highlights the need for systematic robustness evaluation in VQA and positions metamorphic assessment as a scalable, model-agnostic approach toward trustworthy multimodal AI.

Knowledge-Based Visual Question Answering Multimodal Artificial Intelligence Multimodal Learning Time-Resolved Volumetric Metamorphic Relation Imaging Single Images

Open paper Ask about it PDF