Visual Question Answering

Also known as VQA

Overview

The field asks how machines can connect a question to relevant visual evidence, read text and diagrams, and combine perception with commonsense or specialized knowledge. Approaches range from vision-language encoders and multimodal large language models to region and crop grounding, OCR and scene graphs, retrieval-augmented agents, and fine-tuning or reinforcement learning. Benchmarks cover everyday images and compositional reasoning, knowledge-based and text-rich questions, and document, video, medical, scientific, and multi-view settings. A central challenge is that correct-sounding answers may lack reliable visual grounding: models still miss small details and spatial relations, struggle to combine evidence across views or long documents, and may fail to recognize when they should abstain.

Latest papers

CardsList

253 papers36 papers in the last four weeks, up 13% on the four weeks before. 0.2% of all new papers.

  1. RSKD: Grounding Semantic Consistency in Driving VLMs via Distillation

    Oct 26, 2026Chuchu Xie, Yang Zhong, Kangan Qian +3VLM DistillationKnowledge Distillation

  2. The Answer Knows Where to Look: Zooming before MLLMs Answer under Visual-Token Budgets

    Oct 23, 2026Zhensheng Hu, Guanglong Xu, Guanqiang HuLarge Vision-Language ModelsVisual Evidence Sensitivity in VLMs

  3. StateBridge: Phase- and Track-Grounded Reasoning for Synthetic-to-Real Traffic Video Captioning and VQA

    Oct 22, 2026Blessing Agyei Kyem, Richard Dzinyela, Joshua Kofi Asamoah +5Video CaptioningVisual Question Answering

  4. Look Beyond the Question: Preserve-Focus-Fuse for Whole-Slide Image Question Answering

    Oct 21, 2026Xiangyu Li, Jincheng Li, Tianle Du +6Visual Question AnsweringPathology VQA

  5. Query-adaptive Recurrent Tokenization

    Oct 16, 2026Bavesh Balaji, Pranav Gopinath, Pouya Sadeghi +1Visual TokenizationEfficient VLM Inference

  6. Star Light, Star Bright: Can Multimodal Models Parse an Astronomy Visual Question Answering Dataset Right?

    Oct 15, 2026J. P. NaimanVisual Question AnsweringMultimodal Model Evaluation

  7. AdaLoop: Thinking with the Vision Encoder

    Oct 15, 2026Xinran Nicole Han, Yiyang Lu, Katelyn Gan +1VLM ReasoningVisual Reasoning

  8. VELD-QA: A Large-Scale Dataset for Visual Evidence Grounding and Question Answering in Long Documents

    Oct 14, 2026Zhivar Sourati, Marianne Menglin Liu, Rongguang Wang +12Long-Document VQADocument QA

  9. MERIT: Multimodal Evidence Reasoning over Image Tables

    Oct 13, 2026Haoyang Jiang, Zhuotong Fan, Mingyang Yi +3Table QAAutomated Fact-Checking

  10. Lost in Contrast: Instruction-Preserving Decoding for Reliable Visual Question Answering

    Oct 12, 2026Haonan Zhang, Ting Jin, Wenzhong Tang +1Visual Question AnsweringContrastive Decoding

  11. GroundSight at GroundLM 2026 Shared Tasks: GoldenViewVQA

    Oct 8, 2026Kun Wang, Yupeng Hu, Ruping Cao +4Self-Correction in VLMsVisual Question Answering

  12. Harness Compilation: Which Decisions Should a Small Vision-Language Model Keep?

    Oct 8, 2026Minhao Fan, Yinyi Liu, Jiayu Zhao +3Tool Use in VLMsVision-Language Models

  13. Rendering-Free Lookahead for Question-Guided Active Vision

    Oct 8, 2026Koya Sakamoto, Daichi Azuma, Shuhei Kurita +4Vision-Based Robot ControlVLMs for Robotics

  14. TerraAgent: Demonstration-Grounded Multi-Agent Reasoning for Long-Context Remote Sensing Visual Question Answering

    Oct 7, 2026Jingwen Huang, Yiming Fang, Hanxiao Wu +2Remote Sensing VQAVisual Question Answering

  15. Adaptive Visual Token Reduction for Accelerated Image Understanding

    Oct 7, 2026Seyoung Jeong, Jong Pil Yun, Sang Jun LeeEfficient VLM InferenceVisual Token Pruning

  16. Answer with Evidence: Consistency-Aware Grounded Visual Question Answering for Roadside Traffic Scenes

    Oct 4, 2026Runwei Guan, Rongsheng Hu, Shangshu Chen +10Autonomous Driving BenchmarksVisual Question Answering

  17. Trinity: Self-Evolving Vision-Language Models with a Self-Verifier

    Oct 3, 2026Youngwan Lee, Yong-Ju Lee, Sung Ju HwangVision-Language ModelsVLM Reasoning

  18. Evaluating VQA in Vision Language Models using Cooperative Principles

    Oct 2, 2026Monika Shah, Sudarshan Balaji, Somdeb Sarkhel +2VLM EvaluationVisual Question Answering

  19. Fusing Visual and Textual Representations via Multi-layer Fusing Transformers for Vietnamese Visual Question Answering

    Oct 1, 2026Cong Phu Nguyen, Huy Tien Nguyen, Tung LeVisual Question AnsweringVision-Language Models

  20. Hob-VL: A Benchmark for Visually Grounded Boolean Reasoning

    Oct 1, 2026Yuzhou Wang, Emile Anand, Ijay NarangVLM EvaluationVisual Question Answering

  21. Skeleton-and-Strategy Prompting: Training-Free Negation Understanding for Vision-Language Models

    Oct 1, 2026Yuliang Cai, Mohammad Rostami, Jesse ThomasonVisual Question AnsweringIn-Context Learning

  22. Two Clocks in Diffusion MLLMs: When Answers Stabilize Before Rationales Unfold

    Oct 1, 2026Keuntae Kim, Yong Suk ChoiVLM EvaluationVisual Question Answering

  23. Composition, Not Conversation: VLMs Lose the Scene, Not the Thread

    Sep 29, 2026L. D. M. S. Sai Teja, Ufaq Khan, N. Siva Gopala Krishna +5VLM EvaluationVisual Question Answering

  24. RS-OPSD: Reliable Privileged On-Policy-Self-Distillation for Ultra-High-Resolution Remote Sensing VQA

    Sep 29, 2026Chengjie Jiang, Yunqi Zhou, Jiafeng Yan +3Remote Sensing Image UnderstandingVisual Question Answering