Visual Question Answering

Also known as VQA

Overview

The field asks how machines can connect a question to relevant visual evidence, read text and diagrams, and combine perception with commonsense or specialized knowledge. Approaches range from vision-language encoders and multimodal large language models to region and crop grounding, OCR and scene graphs, retrieval-augmented agents, and fine-tuning or reinforcement learning. Benchmarks cover everyday images and compositional reasoning, knowledge-based and text-rich questions, and document, video, medical, scientific, and multi-view settings. A central challenge is that correct-sounding answers may lack reliable visual grounding: models still miss small details and spatial relations, struggle to combine evidence across views or long documents, and may fail to recognize when they should abstain.

Latest papers

CardsList

253 papers36 papers in the last four weeks, up 13% on the four weeks before. 0.2% of all new papers.

  1. PLaMo 2.1-VL Technical Report

    Apr 21, 2026Tommi Kerola, Yuya Masuda, Takashi Masuko +5Visual Question AnsweringVision-Language Models

  2. DUALVISION: RGB-Infrared Multimodal Large Language Models for Robust Visual Reasoning

    Apr 20, 2026Abrar Majeedi, Zhiyuan Ruan, Ziyi Zhao +3Cross-Modal LearningVisual Question Answering

  3. Revisiting Change VQA in Remote Sensing with Structured and Native Multimodal Qwen Models

    Apr 20, 2026Yakoub Bazi, Mohamad M. Al Rahhal, Mansour Zuair +1VLM EvaluationRemote Sensing Image Understanding

  4. AeroRAG: Structured Multimodal Retrieval-Augmented LLM for Fine-Grained Aerial Visual Reasoning

    Apr 20, 2026Junxiao Xue, Quan Deng, Tingqi Hu +4Multimodal RAGVisual Question Answering

  5. RS-HyRe-R1: A Hybrid Reward Mechanism to Overcome Perceptual Inertia for Remote Sensing Images Understanding

    Apr 19, 2026Gaozhi Zhou, Hu He, Peng Shen +8Vision-Language ModelsVisual Question Answering

  6. AutoVQA-G: Self-Improving Agentic Framework for Automated Visual Question Answering and Grounding Annotation

    Apr 19, 2026Rongsheng Hu, Runwei Guan, Yicheng Di +2Visual Question AnsweringLLM-Assisted Annotation

  7. AIM: Asymmetric Information Masking for Visual Question Answering Continual Learning

    Apr 16, 2026Peifeng Zhang, Zice Qiu, Donghua Yu +4Visual Question AnsweringVision-Language Models

  8. MM-Doc-R1: Training Agents for Long Document Visual Question Answering through Multi-turn Reinforcement Learning

    Apr 15, 2026Jiahang Lin, Kai Hu, Binghai Wang +12Long-Document VQAMulti-Turn RL

  9. From Attenuation to Attention: Variational Information Flow Manipulation for Fine-Grained Visual Perception

    Apr 14, 2026Jilong Zhu, Yang FengVision-Language ModelsFine-Grained Visual Perception

  10. INDOTABVQA: A Benchmark for Cross-Lingual Table Understanding in Bahasa Indonesia Documents

    Apr 13, 2026Somraj Gautam, Anathapindika Dravichi, Gaurav HaritTable QAVisual Question Answering

  11. DiningBench: A Hierarchical Multi-view Benchmark for Perception and Reasoning in the Dietary Domain

    Apr 12, 2026Song Jin, Juntian Zhang, Xun Zhang +6VLM EvaluationFine-Grained Visual Perception

  12. VisionFoundry: Teaching VLMs Visual Perception with Synthetic Images

    Apr 10, 2026Guanyu Zhou, Yida Yin, Wenhao Chai +3Visual Question AnsweringSynthetic Data Augmentation

  13. MARINER: A 3E-Driven Benchmark for Fine-Grained Perception and Complex Reasoning in Open-Water Environments

    Apr 9, 2026Xingming Liao, Ning Chen, Muying Shu +5VLM EvaluationVisual Question Answering

  14. Learning to Search: A Decision-Based Agent for Knowledge-Based Visual Question Answering

    Apr 8, 2026Zhuohong Chen, Zhenxian Wu, Yunyao Yu +6Visual Question AnsweringTool Use in VLMs

  15. ChemVLR: Prioritizing Reasoning in Perception for Chemical Vision-Language Understanding

    Apr 8, 2026Xuanle Zhao, Xinyuan Cai, Xiang Cheng +2Vision-Language ModelsVLM Reasoning

  16. Less Detail, Better Answers: Degradation-Driven Prompting for VQA

    Apr 6, 2026Haoxuan Han, Weijie Wang, Zeyu Zhang +2Visual Question AnsweringVLM Reasoning

  17. Beyond Standard Benchmarks: A Systematic Audit of Vision-Language Model's Robustness to Natural Semantic Variation Across Diverse Tasks

    Apr 6, 2026Jia Chengyu, AprilPyone MaungMaung, Huy H. Nguyen +2VLM RobustnessVLM Evaluation

  18. SGTA: Scene-Graph Based Multi-Modal Traffic Agent for Video Understanding

    Apr 4, 2026Xingcheng Zhou, Mingyu Liu, Walter Zimmer +2Video QAVisual Question Answering

  19. PaveBench: A Versatile Benchmark for Pavement Distress Perception and Interactive Vision-Language Analysis

    Apr 3, 2026Dexiang Li, Zhenning Che, Haijun Zhang +3Visual Question Answering

  20. Jagle: Building a Large-Scale Japanese Multimodal Post-Training Dataset for Vision-Language Models

    Apr 2, 2026Issa Sugiura, Keito Sasagawa, Keisuke Nakao +8Multimodal DatasetVision-Language Models

  21. JAMMEval: A Refined Collection of Japanese Benchmarks for Reliable VLM Evaluation

    Apr 1, 2026Issa Sugiura, Koki Maeda, Shuhei Kurita +3VLM EvaluationBenchmark Construction

  22. JaWildText: A Benchmark for Vision-Language Models on Japanese Scene Text Understanding

    Mar 30, 2026Koki Maeda, Naoaki OkazakiVLM EvaluationScene Text Recognition

  23. Learning to Focus and Precise Cropping: A Reinforcement Learning Framework with Information Gaps and Grounding Loss for MLLMs

    Mar 29, 2026Xuanpu Zhao, Zhentao Tan, Dianmo Sheng +6Visual Question AnsweringRL for VLMs

  24. RailVQA: A Benchmark and Framework for Efficient Interpretable Visual Cognition in Automatic Train Operation

    Mar 28, 2026Sen Zhang, Runmei Li, Shizhuang Deng +7Visual Question AnsweringVLM Interpretability

  25. HandVQA: Diagnosing and Improving Fine-Grained Spatial Reasoning about Hands in Vision-Language Models

    Mar 27, 2026MD Khalequzzaman Chowdhury Sayem, Mubarrat Tajoar Chowdhury, Yihalem Yimolal Tiruneh +4VLM ReasoningSpatial Reasoning

  26. LLaVA-LE: Large Language-and-Vision Assistant for Lunar Exploration

    Mar 25, 2026Gokce Inal, Pouyan Navard, Alper YilmazVision-Language ModelsLarge Vision-Language Models

  27. Revealing Multi-View Hallucination in Large Vision-Language Models

    Mar 25, 2026Wooje Park, Insu Lee, Soohyun Kim +4Visual Question AnsweringHallucination in Language Models

  28. Focus, Don't Prune: Identifying Instruction-Relevant Regions for Information-Rich Image Understanding

    Mar 24, 2026Mincheol Kwon, Minseung Lee, Seonga Choi +7Efficient VLM InferenceLarge Vision-Language Models