Knowledge-Based Visual Question Answering

Follow this topic Ask about this topic

Momentum

11 papers in the last four weeks, up 267% on the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28

Latest papers 63

All topics

Fusing Visual and Textual Representations via Multi-layer Fusing Transformers for Vietnamese Visual Question Answering
Oct 1, 2026Cong Phu Nguyen, Huy Tien Nguyen, Tung LeKnowledge-Based Visual Question Answering Video Dataset
Faculty of Information Technology, University of Science, Ho Chi Minh City, Vietnam · Vietnam National University, Ho Chi Minh City, Vietnam
Exemplar2VQA: A Scalable Exemplar-Driven Visual Question Answering Generation Framework via Multi-Agent Coding
Sep 29, 2026Jiayu Ying, Qijian Tian, Ruijie Xu +4Knowledge-Based Visual Question Answering Multimodal Agents
East China Normal University · Shanghai Jiao Tong University · Fudan University +1
TAEC: Trajectory-Aware Evidence Coordination for Multi-Step Visual RAG
Sep 29, 2026Yalun Wu, Bingzhou Wang, Boyang Wang +5Visual Evidence Multimodal Retrieval Augmented Generation
NExT++ Lab, National University of Singapore
From Text Decisions to Pixels: An Study of Jev-Style Visual Choice Model
Sep 24, 2026Xunlan Zhou, Xianliang Yang, Li ZhaoKnowledge-Based Visual Question Answering Pixels
School of Intelligence Science and Technology, Nanjing University, Suzhou, China · Microsoft Research Asia
When Visual Quality Misleads: Intent Recognition under Rendered Avatar Distortions
Sep 23, 2026Ning-Hsuan Chang, Kai-Siang Ma, Yu-Chih ChenVisual Fidelity Open-Vocabulary Action Recognition
National Chengchi University Taiwan · National Yang Ming Chiao Tung University Taiwan
Hierarchical Floorplan-Guided Vision-Language Exploration for Embodied Question Answering
Sep 22, 2026Albert Gassol Puigjaner, Kostas AlexisVision-Language Navigation Knowledge-Based Visual Question Answering
Autonomous Robots Lab, Norwegian University of Science and Technology (NTNU), Trondheim, Norway
A $^2$ Safe: Counterfactual Evidence-Aligned Adaptive Agent Collaboration for Safe and Effective Visual Question Answering
Sep 21, 2026Quanxing Xu, Ling Zhou, Xian Zhong +4Knowledge-Based Visual Question Answering Multimodal Query
School of Computer Science and Engineering, Macau University of Science and Technology, Macao SAR 999078, China · Hubei Key Laboratory of Transportation Internet of Things, School of Artificial Intelligence, Wuhan University of Technology, Wuhan 430070, China · Oulu School, Nanjing Institute of Technology, Nanjing 210096, China +1
Counterfactual Reasoning for Robust Visual Question Answering
Sep 15, 2026Truong-Binh Duong, Thanh-Ngan Tran, Ngoc-Thao Nguyen +1Knowledge-Based Visual Question Answering Visual Question Answering Benchmarks
Faculty of Information Technology, University of Science, Ho Chi Minh City, Vietnam · 2Vietnam National University, Ho Chi Minh City, Vietnam
Navigating Sparse Evidence: Agentic Visual RAG via Explicit Context Selection and Consolidation
Sep 14, 2026Yucheng Shen, Lingyong Yan, Jiulong Wu +4Visual Evidence Knowledge-Based Visual Question Answering
School of Computer Science and Technology, Soochow University · Baidu Inc.
SparseTalk - Sparsifying 3D Gaussian Language Fields for Efficient 3D Visual Question Answering
Sep 14, 2026Davit Soselia, Joseph JaJa, Amitabh Varshney3D Representation Knowledge-Based Visual Question Answering
University of Maryland, College Park, MD, USA
Eliciting Self-Verification in Multimodal Reasoning Agents with Reinforcement Learning
Sep 7, 2026Vishwas Sathish, Viresh Ranjan, Xinliang Zhu +2Multimodal Agents Agentic Reasoning
University of Washington · Seattle, WA, USA · Amazon +1
ManGo: Manga Active Narrative Grounding Optimization
Aug 30, 2026Hao Qiu, Junyan Wang, Zheyuan Liu +4Knowledge-Based Visual Question Answering Vision-Language Model Grounding
1Communication University of China · 2Australian Institute for Machine Learning, Adelaide University · University of New South Wales +2
CapProbe: Evaluating Detailed Image Captions via Full-Scene Dense Question Answering
Aug 11, 2026Mouxiao Huang, Qiangyu Yan, Borui Jiang +1Visual Question Answering Benchmarks Captions
Huawei Technologies
DistilVDR: A Compact End-to-End Visual Document Retriever via Dual-Student Distillation
Aug 11, 2026Zhuchenyang Liu, Ziyi Wang, Yao Zhang +1Visual Document Retrieval Multimodal Retrieval
Aalto University, Finland · Independent Researcher, Netherlands
Stockmark-Nemotron-3-Nano-Omni-JapanDocReader: Structured Document Parsing via Capability Injection and Forgetting Control
Aug 7, 2026Shi Chen, Hayato Aida, Makoto Morinaga +2Document Parsing Multimodal Documents
Stockmark Inc.
Bayesian Data Reweighting Improves Multimodal Retrieval for Knowledge-Based Visual Question Answering
Aug 3, 2026Jingchen Sun, Shaobo Han, Ruiyi Zhang +5Knowledge-Based Visual Question Answering Multimodal Retrieval
University at Buffalo · NEC Laboratories America · Adobe Research +2
VaRS-Doc: Interpretation-Aware Variant Representations via Latent Self-Probing for Visual Document Retrieval
Aug 2, 2026Haocheng Wang, Tongkun Guan, Wei Shen +1Visual Document Retrieval Multimodal Retrieval
MoE Key Lab of Artificial Intelligence, AI Institute, School of Computer Science, Shanghai Jiao Tong University, China
UniHEAR: Unified Heterogeneous-Source Attentive Retrieval for Knowledge-Based Visual Question Answering
Aug 2, 2026Ganzhong Luo, Yang Ren, Hanyong Wang +2Knowledge-Based Visual Question Answering Reranking
School of Aeronautics and Astronautics, Sichuan University
RAGOCR: Optical Compression of Retrieval-Augmented Text via Visual Representation
Aug 1, 2026Jiayang Yu, Jialun Zhong, Lei ZouKnowledge-Based Visual Question Answering Lingdt-Vl-Ocr
Wangxuan Institute of Computer Technology, Peking University Beijing, China
Thinking Once Is Enough: Intermediate-Layer Evidence Routing for High-Resolution VQA
Jul 30, 2026Zhongkuan Mao, Xianjie Liu, Tianyu Meng +9Knowledge-Based Visual Question Answering High-Resolution
National Key Laboratory of Fundamental Science on Synthetic Vision, Sichuan University
DDVT: Dynamic Dual-level Vision Transformer Fusion Network for Answer Grounding in Visual Question Answering
Jul 27, 2026Yue Zhang, Xiangyu Li, Wanshu Fan +2Knowledge-Based Visual Question Answering Self-Supervised Vision Transformers
National and Local Joint Engineering Laboratory of Computer Aided Design, School of Software Engineering, Dalian University, Dalian, China · School of Computer Science and Technology, Dalian University of Technology, Dalian, China
CRAG-MM-Diagnostics: Enabling Stage-Wise Analysis of Knowledge-Intensive VQA
Jul 23, 2026Hanseok Oh, Parishad BehnamGhader, Benno Krojer +4Knowledge-Based Visual Question Answering Diagnostic Benchmark
New York University, New York NY, USA · Mila - Quebec AI Institute, Montreal, Canada · McGill University, Montreal, Canada +3
SoftReason: A Fully Differentiable Neuro-Soft-Symbolic Deductive Reasoning Architecture over High-Dimensional Perceptual Data
Jul 22, 2026Wael AbdAlmageedNeuro-Symbolic Framework Knowledge-Based Visual Question Answering
Holcombe Department of Electrical and Computer Engineering, Clemson University
VizRAG: Enhancing Retrieval-Augmented Generation with Hypergraph Visualization
Jul 22, 2026Yanbin Wei, Yang Chen, Renling Gan +7Graph-Based Retrieval Augmented Generation Knowledge-Based Visual Question Answering
1Southern University of Science and Technology · 2Hong Kong University of Science and Technology · 3Huawei Research +1
WasteAssistant: Regulation-Guided Visual Question Answering Framework for Intelligent Waste Segregation and Sustainable Managemen
Jul 12, 2026Khush Kataruka, Harshit Maurya, Anuja Vats +3Waste Knowledge-Based Visual Question Answering
Sardar Vallabhbhai National Institute of Technology, Surat, 395007, Gujarat, India · Norwegian University of Science and Technology, Gjøvik, Norway · Kalinga Institute of Industrial Technology, Bhubaneswar, Odisha, India
MMAgent-R $^2$ : Learning to Rerank and Reject for Agentic mRAG
Jul 8, 2026Tao Zhang, Ziqi Zhang, Zongyang Ma +7Knowledge-Based Visual Question Answering Multimodal Retrieval Augmented Generation
State Key Laboratory of Multimodal Artificial Intelligence Systems, CASIA · School of Artificial Intelligence, University of Chinese Academy of Sciences · Beijing Key Laboratory of Super Intelligent Security of Multi-Modal Information +3
Identifying and Resolving Pitfalls of Knowledge-Based VQA Benchmarks: Auditing, Repairing, and Augmenting
Jun 30, 2026Qian Ma, S M Rayeed, Charles V. Stewart +2Visual Question Answering Benchmarks Knowledge-Based Visual Question Answering
Rensselaer Polytechnic Institute, Troy NY 12047, USA · AT&T Chief Data Office, Bedminster NJ 07921, USA
ProMSA:Progressive Multimodal Search Agents for Knowledge-Based Visual Question Answering
Jun 26, 2026ZhengXian Wu, Hangrui Xu, Kai Shi +8Knowledge-Based Visual Question Answering Multimodal Search Agents
OPPO AI Center, OPPO Inc. China · The Shenzhen International Graduate School, Tsinghua University · Nanyang Technological University, Singapore
SurgAtlas: A Large-Scale Surgical Video-Language Dataset with 2,391 Hours of Open and Minimally Invasive Surgery
Jun 24, 2026Filippos Bellos, Andre S. Gala-Garza, Miaowei Wang +8Surgical Videos Surgery
University of Michigan Ann Arbor, Michigan, USA · University of Edinburgh Edinburgh, United Kingdom · Vanderbilt University Medical Center Nashville, Tennessee, USA +3
Invoice Haystack: Benchmarking Document Retrieval and Visual Question Answering Under Strong Visual Homogeneity
Jun 24, 2026Heethanjan Kanagalingam, Thenukan Pathmanathan, Mokeeshan Vathanakumar +3Visual Document Retrieval Knowledge-Based Visual Question Answering
The University of Melbourne, Melbourne, Australia · Lakehead University, Thunder Bay, Canada
Ground Then Rank: Revisiting Knowledge-Based VQA with Training-Free Entity Identification
Jun 22, 2026Qian Ma, Qiong Wu, Zhengyi Zhou +1Knowledge-Based Visual Question Answering Large Language Model Reranking
Rensselaer Polytechnic Institute · AT&T Chief Data Office
LightSTAR: Efficient Visual Document Retrieval via Lightweight Selection with Vision-Adaptive Refinement
Jun 22, 2026Tongkun Guan, Haocheng Wang, Wei Shen +1Visual Document Retrieval Multimodal Retrieval
MoE Key Lab of Artificial Intelligence, AI Institute, School of Computer Science, Shanghai Jiao Tong University
Enhancing Pathological VLMs with Cross-scale Reasoning
Jun 16, 2026Chi Phan, Tianyi Zhang, Qiaochu Xue +5Medical Vision-Language Models Knowledge-Based Visual Question Answering
Department of Electrical and Computer Engineering, National University of Singapore, Singapore · PuzzleLogic Pte Ltd, Singapore · Department of Pathology, Fujian Medical University Cancer Hospital & Fujian Cancer Hospital, Fuzhou, China
Lost at the End: Primacy Bias in Multimodal Retrieval-Augmented Question Answering
Jun 15, 2026Jieyuan Liu, Jianyang Gu, Shijie Chen +2Knowledge-Based Visual Question Answering Question
University of California, San Diego · The Ohio State University
Distilling Answer-Set Programming Rules from LLMs for Neurosymbolic Visual Question Answering
Jun 2, 2026Thomas Eiter, Nelson Higuera Ruiz, Johannes OetschKnowledge-Based Visual Question Answering Neuro-Symbolic Framework
Vienna University of Technology (TU Wien), Favoritenstrasse 9–11, Vienna, 1040, Austria · Jönköping University, Gjuterigatan 5, 551 11 Jönköping, Sweden
Disentanglement-Based Equivariant Learning for Compositional VQA
Jun 1, 2026Zhou Du, Zhaoquan Yuan, Xiao Wu +1Knowledge-Based Visual Question Answering Equivariant Learning
School of Computing and Artificial Intelligence, Southwest Jiaotong University, Chengdu 611730, China, and also with Engineering Research Center of Sustainable Urban Intelligence Transportation, Ministry of Education, China · State Key Laboratory of Multimodal Artificial Intelligence Systems (MAIS), Institute of Automation, Chinese Academy of Sciences, Beijing 100190, China, and with the School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing 101408, China, and also with Peng Cheng Laboratory, ShenZhen 518055, China
Inference-Free Multimodal Learned Sparse Retrieval for Production-Scale Visual Document Search
May 29, 2026Gyu-Hwung Cho, Youngjune Lee, Kiyoon Jeong +5Visual Document Retrieval Multimodal Retrieval
NAVER Corp., Republic of Korea · Seoul National University, Republic of Korea · NAVER Corp. +6
Seeing Before Agreeing: Aligning Multi-Agent Consensus with Visual Evidence
May 29, 2026Yuhan Wang, Shuochen Chang, Yalin Feng +8Knowledge-Based Visual Question Answering Multimodal Agents
Peking University · Shanghai Jiao Tong University · Nanyang Technological University +2
Semantic and Visual Evidence for Efficient Long-Video Reasoning: A Solution for the HD-EPIC VQA Challenge
May 28, 2026Yinsong Xu, Wei Jing, Liuxin Zhang +2Video Understanding Knowledge-Based Visual Question Answering
Lenovo, China
Rethinking VLM Representation for VLA Initialization
May 25, 2026Weifeng Lin, Siyuan Huang, Hao Li +5Vision-Language-Action Framework Scalable Robot Learning
1CUHK · 4ACE Robotics · 3Peking University +1
RoboSurg-VQA: A Multimodal Benchmark for Surgical Segmentation-Aware Visual Question Answering
May 21, 2026Chengyi Zhang, Zi Ye, Ziyang WangTextvqa Knowledge-Based Visual Question Answering
Swansea University, UK · Maynooth University, Ireland · Aston University, UK
HyLoVQA: Dynamic Hypernetwork-Generated Low-Rank Adaptation for Continual Visual Question Answering
May 21, 2026Yiran Wang, Chenyi Xiong, Ziyue Qin +3Knowledge-Based Visual Question Answering Vision-Language Model Adaptation
School of Computer Science, Hubei University, Wuhan 430062, China · Hubei Key Laboratory of Big Data Intelligent Analysis and Application (Hubei University), Wuhan 430062, China · Key Laboratory of Intelligent Sensing System and Security (Hubei University), Ministry of Education, Wuhan 430062, China
MetaRA: Metamorphic Robustness Assessment for Multimodal Large Language Model-based Visual Question Answering Systems
May 19, 2026Quanxing Xu, Yuhao Tian, Ling Zhou +4Knowledge-Based Visual Question Answering Metamorphic Relation Adequacy
School of Computer Science and Engineering, Macau University of Science and Technology, Macao SAR 999078, China · Hubei Key Laboratory of Transportation Internet of Things, School of Computer Science and Artificial Intelligence, Wuhan University of Technology, Wuhan 430070, China · State Key Laboratory of Maritime Technology and Safety, Wuhan University of Technology, Wuhan 430063, China +3
MedFM-Robust: Benchmarking Robustness of Medical Foundation Models
May 18, 2026Xiangxiang Cui, Tianjin Huang, Yifang Wang +2Medical Vision-Language Models Medical Imaging
Beijing Normal University, China · University of Exeter, United Kingdom · University College London, United Kingdom +2
Memory-Augmented Query Intent Understanding for Efficient Chat-based Image Retrieval
May 17, 2026Xianke Chen, Daizong Liu, Yushuo Lou +5Composed Image Retrieval Knowledge-Based Visual Question Answering
School of Computer Science and Technology, and the School of Statistics and Mathematics, Zhejiang Gongshang University, Hangzhou 310035, China · the School of Computer Science and Technology, Zhejiang Gongshang University, and the Zhejiang Key Laboratory of Big Data and Future E-Commerce Technology, Hangzhou 310035, China
Chain-of-Procedure: Hierarchical Visual-Language Reasoning for Procedural QA
May 14, 2026Guanhua Chen, Yutong Yao, Shenghe Sun +5Knowledge-Based Visual Question Answering Multimodal Benchmarks
NLP2CT Lab, Department of Computer and Information Science, University of Macau · Centre for Cognitive and Brain Sciences, University of Macau · Department of Electrical and Computer Engineering, University of Macau
Enhancing Visual Question Answering with Multimodal LLMs via Chain-of-Question Guided Retrieval-Augmented Generation
May 5, 2026Quanxing Xu, Ling Zhou, Xian Zhong +3Knowledge-Based Visual Question Answering Multimodal Large Language Models
School of Computer Science and Engineering, Macau University of Science and Technology, Macao SAR 999078, China · Hubei Key Laboratory of Transportation Internet of Things, School of Computer Science and Artificial Intelligence, Wuhan University of Technology, Wuhan, Hubei 430070, China · State Key Laboratory of Maritime Technology and Safety, Wuhan University of Technology, Wuhan 430063, China +3
Chain of Evidence: Pixel-Level Visual Attribution for Iterative Retrieval-Augmented Generation
May 2, 2026Peiyang Liu, Ziqiang Cui, Xi Wang +2Multimodal Retrieval Augmented Generation Knowledge-Based Visual Question Answering
National Engineering Research Center for Software Engineering, Peking University Beijing, China · City University of Hong Kong Hong Kong SAR, China · Tencent Technology Beijing, China
M $^3$ -VQA: A Benchmark for Multimodal, Multi-Entity, Multi-Hop Visual Question Answering
Apr 28, 2026Jiatong Ma, Longteng Guo, Yuchen Liu +4Knowledge-Based Visual Question Answering Multimodal Reasoning
Institute of Automation, Chinese Academy of Sciences · School of Artificial Intelligence, University of Chinese Academy of Sciences
HAC: Parameter-Efficient Hyperbolic Adaptation of CLIP for Zero-Shot VQA
Apr 26, 2026Francesco Dibitonto, Cigdem Beyan, Vittorio MurinoKnowledge-Based Visual Question Answering Contrastive Language-Image Pre-Training Model
Department of Computer Science, University of Verona, Verona, Italy · EVS - Embedded Vision Systems Srl, Verona, Italy · AI for Good (AIGO), Istituto Italiano di Tecnologia, Genova, Italy
BERAG: Bayesian Ensemble Retrieval-Augmented Generation for Knowledge-based Visual Question Answering
Apr 24, 2026Jinghong Chen, Jingbiao Mei, Guangyu Yang +1Knowledge-Based Visual Question Answering Context Length
Department of Engineering University of Cambridge
AeroRAG: Structured Multimodal Retrieval-Augmented LLM for Fine-Grained Aerial Visual Reasoning
Apr 20, 2026Junxiao Xue, Quan Deng, Tingqi Hu +4Knowledge-Based Visual Question Answering Multimodal Retrieval Augmented Generation
Research Center for Space Computing System, Zhejiang Lab, Hangzhou 311100, China · Hangzhou Institute for Advanced Study, University of Chinese Academy of Sciences, Hangzhou 311000, China · School of Cyber Science and Engineering, Zhengzhou University, Zhengzhou 450002, China +1
AutoVQA-G: Self-Improving Agentic Framework for Automated Visual Question Answering and Grounding Annotation
Apr 19, 2026Rongsheng Hu, Runwei Guan, Yicheng Di +2Knowledge-Based Visual Question Answering Textvqa
School of Artificial Intelligence and Computer Science, Jiangnan University, Wuxi, China · Thrust of Artificial Intelligence, HKUST(GZ), Guangzhou, China
CoGR-MoE: Concept-Guided Expert Routing with Consistent Selection and Flexible Reasoning for Visual Question Answering
Apr 18, 2026Xiyin Zeng, Yi Lu, Hao WangKnowledge-Based Visual Question Answering Experts
Hong Kong University of Science and Technology (Guangzhou)
KIRA: Knowledge-Intensive Image Retrieval and Reasoning Architecture for Specialized Visual Domains
Apr 18, 2026Parthaw Goswami, Jaynto Goswami DeepKnowledge-Based Visual Question Answering Multimodal Retrieval Augmented Generation
University of Missouri · SAP Prague
VEFX-Bench: A Holistic Benchmark for Generic Video Editing and Visual Effects
Apr 17, 2026Xiangbo Gao, Sicong Jiang, Bangya Liu +12Video Editing Multi-Image Editing Benchmarks
1Texas A&M University · 2Visko Platform · 3Abaka AI
AEGIS: Anchor-Enforced Gradient Isolation for Knowledge-Preserving Vision-Language-Action Fine-Tuning
Apr 17, 2026Guransh SinghDiffusion-Based Vision-Language-Actions Knowledge-Based Visual Question Answering
Independent Researcher
AIM: Asymmetric Information Masking for Visual Question Answering Continual Learning
Apr 16, 2026Peifeng Zhang, Zice Qiu, Donghua Yu +4Knowledge-Based Visual Question Answering Multiple-Choice Visual Question Answering
Sun Yat-Sen University · National Supercomputing Center in Shenzhen · Tsinghua University
Learning to Search: A Decision-Based Agent for Knowledge-Based Visual Question Answering
Apr 8, 2026Zhuohong Chen, Zhenxian Wu, Yunyao Yu +6Knowledge-Based Visual Question Answering
Tsinghua University · Hefei University of Technology · University of Arizona
Wiki-R1: Incentivizing Multimodal Reasoning for Knowledge-based VQA via Data and Sampling Curriculum
Mar 5, 2026Shan Ning, Longtian Qiu, Xuming HeKnowledge-Based Visual Question Answering Visual Question Answering Benchmarks
ShanghaiTech University, Shanghai, China · Lingang Laboratory, Shanghai, China · Shanghai Engineering Research Center of Intelligent Vision and Imaging

Oct 1, 2026, cs.CVJ/K move · Enter open · S save

Fusing Visual and Textual Representations via Multi-layer Fusing Transformers for Vietnamese Visual Question Answering

Cong Phu Nguyen, Huy Tien Nguyen, Tung Le

Faculty of Information Technology, University of Science, Ho Chi Minh City, Vietnam · Vietnam National University, Ho Chi Minh City, Vietnam

Knowledge-Based Visual Question Answering Video Dataset

Open paper AskPDF arXiv

In recent decades, artificial intelligence has made significant progress in understanding and interacting with images. One of the important applications of this technology is Visual Question Answering (VQA), a research field that requires computers to understand and answer questions about images in a natural manner. Despite extensive research and development in VQA for English, there have been very few similar efforts made for other languages, especially Vietnamese. This gap presents a significant challenge and opportunity for the advancement of VQA technology in the Vietnamese language context. By bridging this gap, the field of Vietnamese VQA not only enriches the diversity of research in artificial intelligence but also enables practical applications in various domains, such as education, healthcare, and entertainment, catering to Vietnamese-speaking populations worldwide. Thus, the exploration and development of Vietnamese VQA systems hold immense potential for advancing both research and practical applications in the intersection of computer vision and natural language processing. In this paper, we propose a Multi-layer Fusing Transformer model utilizing a cross attention module to combine multiple modality features of images and texts from different layers in an aggregated representation. Our architecture allows us extract information from low level to high level. Through detailed experiments and ablation studies, our model achieves promising results against the competitive baselines in ViVQA dataset for Vietnamese language.

Momentum

Related topics

Latest papers 63