Visual Question Answering

Also known as VQA

Overview

The field asks how machines can connect a question to relevant visual evidence, read text and diagrams, and combine perception with commonsense or specialized knowledge. Approaches range from vision-language encoders and multimodal large language models to region and crop grounding, OCR and scene graphs, retrieval-augmented agents, and fine-tuning or reinforcement learning. Benchmarks cover everyday images and compositional reasoning, knowledge-based and text-rich questions, and document, video, medical, scientific, and multi-view settings. A central challenge is that correct-sounding answers may lack reliable visual grounding: models still miss small details and spatial relations, struggle to combine evidence across views or long documents, and may fail to recognize when they should abstain.

Latest papers

CardsList

253 papers36 papers in the last four weeks, up 13% on the four weeks before. 0.2% of all new papers.

  1. HAFI-VLM: A Frequency Perspective for Diagnosing and Enhancing Visual Perception in Vision-Language Models

    Aug 3, 2026Jin Cui, Chuanchang Su, Jiayi Lu +3Visual Question AnsweringVLM Robustness

  2. FAU at ImageCLEF 2026 Task on Multimodal Reasoning Robust Candidate Scoring and Concise Multilingual Visual Answering

    Aug 3, 2026Mohamed Basem, Vincent ChristleinVisual Question AnsweringMultimodal Reasoning

  3. HierDoc: Hierarchical Page-to-Region Evidence Routing for Long-Document Visual Question Answering

    Jul 31, 2026Rongjian Gu, Wengang Zhou, Junyu Xiong +4Visual Question AnsweringLong-Document VQA

  4. Thinking Once Is Enough: Intermediate-Layer Evidence Routing for High-Resolution VQA

    Jul 30, 2026Zhongkuan Mao, Xianjie Liu, Tianyu Meng +9Visual Question AnsweringEfficient VLM Inference

  5. ICDAR 2026 Competition on Information Extraction from Atomic Layer Deposition/Etching (ALD/E) Scientific Figures

    Jul 29, 2026Fahad Ahmed, Sören Auer, Jennifer D'SouzaVisual Question AnsweringDocument Information Extraction

  6. Seen, Said, or Forgotten? A Causal Audit of Visual KV Memory Across Dialog Turns

    Jul 28, 2026Hong Chen, Kang Chen, Yuxuan Fan +4Memory-Augmented VLMsVisual Question Answering

  7. Are Prompt Optimizers Blind? Cross-Modal Visual Feedback for Automatic Prompt Optimization

    Jul 27, 2026Haoyue Liu, Xiaoyu Ma, Ye Chen +2Visual Question AnsweringVLM Adaptation

  8. MarineEVT: Advancing Event-Centric Marine Video Understanding via Visual Tool Reasoning

    Jul 27, 2026Tuan-An To, Yuk-Kwan Wong, Tuan-Anh Vu +2Visual Question AnsweringVideo Understanding

  9. DDVT: Dynamic Dual-level Vision Transformer Fusion Network for Answer Grounding in Visual Question Answering

    Jul 27, 2026Yue Zhang, Xiangyu Li, Wanshu Fan +2Visual Question AnsweringVision Transformer

  10. Constraint-Anchored Reasoning Traces

    Jul 18, 2026Zehua Cheng, Wei Dai, Jiahao SunVisual Question AnsweringLLM Grounding

  11. How Do VLMs Fail? Vision-Operation Misalignment in Compositional VQA

    Jul 17, 2026Navya Gupta, Bingjie Xu, Avinash Anand +2Visual Question AnsweringVLM Interpretability

  12. Ask Twice, Look Twice: Prompt Echoing Resolves the Question-First Paradox in Vision-Language Models

    Jul 17, 2026Rakshanda Hassan Abhinandan, John Galeotti, Deva Ramanan +1Visual Question AnsweringVision-Language Models

  13. Reinforcing Egocentric Spatial Perception in Multimodal Large Language Models via Ego Scene Augmentation

    Jul 16, 2026Chi Kit Wong, Ye Pan, Yuanhuiyi Lyu +6Visual Question AnsweringVisual Spatial Reasoning

  14. DM-KG: A Novel Method for Boosting Spatial Cognition of Vision-Language Models in Street View Imagery

    Jul 14, 2026Xinyue Xu, Zheng Zhang, Kunyang Ma +5Visual Question AnsweringGeospatial QA

  15. WasteAssistant: Regulation-Guided Visual Question Answering Framework for Intelligent Waste Segregation and Sustainable Managemen

    Jul 12, 2026Khush Kataruka, Harshit Maurya, Anuja Vats +3Visual Question AnsweringKnowledge-Based VQA

  16. What Does Your Short-Answer VQA Score Actually Measure? Evaluator-Dependent Instability in Multimodal Short-Answer Benchmarks

    Jul 11, 2026Guanhua Ye, Niu Jingbin, Yan Li +4VLM EvaluationVisual Question Answering

  17. Test-Time Scaling for Small VLMs on Multilingual Visual MCQ

    Jul 10, 2026Spiros Baxevanakis, Peng-Jian YangVisual Question AnsweringTest-Time Scaling for VLMs

  18. OmniMapBench: Benchmarking Visual-Centric Reasoning on Diverse Map Documents

    Jul 10, 2026Yang Chen, Yunwen Li, Yufan Shen +6VLM EvaluationDocument Understanding

  19. Comparative Study of Domain-adapted VLMs for General Document Visual Question Answering

    Jul 8, 2026Miguel Lopez-Duran, Elena Marrero, Julian Fierrez +8VLM EvaluationDocument Understanding

  20. IRIS: An Intelligent Vision-Language System for Ocular Surface Diseases via Topic Tree and Scene-Driven VQA Generation

    Jul 5, 2026Hao Wei, Wenjin Qi, Dasen Dai +2Visual Question AnsweringVision-Language Models

  21. Beyond Scene Priors: Fine-Grained Traffic Scene Reasoning with Benchmarking and Query-Guided Small-Object Focus

    Jul 5, 2026Waikit Xiu, Qiang Lu, Zian Wang +4Visual Question AnsweringVLMs for Autonomous Driving

  22. Identifying and Resolving Pitfalls of Knowledge-Based VQA Benchmarks: Auditing, Repairing, and Augmenting

    Jun 30, 2026Qian Ma, S M Rayeed, Charles V. Stewart +2VLM EvaluationVisual Question Answering

  23. Visual Semantic Entropy: Do Vision Language Models Recognize Visual Ambiguity?

    Jun 30, 2026Ta Duc Huy, Trang Nguyen, Townim Chowdhury +5VLM EvaluationVisual Question Answering

  24. Latent Noise Mask for Reducing Visual Redundancy in Multimodal Large Language Models

    Jun 29, 2026Kai Jiang, Ruishu Zhu, Siqi Huang +2Visual Question AnsweringMultimodal Large Language Models

  25. Multimodal Graph RAG for Long-range Visually Rich Document Understanding

    Jun 27, 2026Yi-Cheng Wang, Chu-Song ChenMultimodal RAGVisual Question Answering

  26. FlameVQA: A Physically-Grounded UAV Wildfire VQA Benchmark with Radiometric Thermal Supervision

    Jun 25, 2026Mobin Habibpour, John Spodnik, Niloufar Alipour Talemi +1VLM EvaluationVisual Question Answering

  27. SSMNBench: Diagnosing Image-based Cross-View Human-Object Understanding via Single-View Sufficiency and Multi-View Necessity

    Jun 24, 2026Tianchen Guo, Chen Liu, Ling Chen +1Visual Question AnsweringMulti-View Consistency

  28. Invoice Haystack: Benchmarking Document Retrieval and Visual Question Answering Under Strong Visual Homogeneity

    Jun 24, 2026Heethanjan Kanagalingam, Thenukan Pathmanathan, Mokeeshan Vathanakumar +3Multimodal RAGVisual Question Answering