Video Question Answering

Also known as VQA

Overview

Video question answering asks models to identify events, people, actions, and relationships in video, including when things happen and why. Approaches include vision-language models, question-aware frame selection and retrieval, temporal memory, scene graphs, and agentic systems that inspect evidence with tools. Benchmarks test settings such as long-form and streaming video, egocentric activity, causal reasoning, and precise temporal grounding. A central challenge is that high answer accuracy can coexist with weak use of visual evidence, poor temporal grounding, and overconfidence when evidence is incomplete.

Latest papers

CardsList

185 papers25 papers in the last four weeks, up 47% on the four weeks before. 0.1% of all new papers.

  1. Bridging VideoQA and Video-Guided Agentic Tasks via Generalized Keyframe Extraction

    Jun 28, 2026Sunqi Fan, Qingle Liu, Runqi Yin +2GUI AgentsVideo Question Answering

  2. Graph it first! Enabling Reasoning on Long-form Egocentric Videos through Scene Graphs

    Jun 24, 2026Agnese Taluzzi, Riccardo Santambrogio, Simone Mentasti +2Egocentric VQAVideo Question Answering

  3. EG-VQA: Benchmarking Verifiable Video Question Answering with Grounded Temporal Evidence

    Jun 23, 2026Linpeng Huang, Weixing Chen, Zexin Chen +2VLM EvaluationTemporal Video Grounding

  4. video-SALMONN-R3^3: Learning to ReWatch, ReAsk, and ReAnswer for Efficient Video Understanding

    Jun 23, 2026Yixuan Li, Guangzhi Sun, Yudong Yang +1Efficient VLM InferenceVideo Question Answering

  5. Chains That See, Answers That Don't: A Multi-Aspect Evaluation Recipe for Forced Chain-of-Thought on Video-MME

    Jun 22, 2026Zhichao Fan, Yanhang Li, Zexin ZhuangVLM EvaluationVideo Question Answering

  6. CogniRoute: Learning to Route Social Evidence in Omni-Modal Models

    Jun 18, 2026Yifan Shen, Pei Tian, Xinzhuo Li +8RL for Language Model ReasoningMixture-of-Experts Inference

  7. VL-MemKnG: Hybrid Memory with a Spatio-Temporal Knowledge Graph for Question Answering over Long Egocentric Navigation Trajectories

    Jun 15, 2026Svetlana Lukina, Mohamad Al Mdfaa, Gloria Haro +2Egocentric VQAVideo Question Answering

  8. MSUE: Multi-Modal Soccer Understanding Expert

    Jun 10, 2026Litao Li, Yibo Yu, Yufeng Hu +4Visual Question AnsweringVideo Question Answering

  9. Counterfactual Reasoning for Fine-Grained Evidence Disentanglement in VideoQA

    Jun 8, 2026Zhou Du, Hamid Krim, Xiao Wu +3Causal Representation LearningVideo Question Answering

  10. See More, Think Deeper: Query-Expanded Visual Evidence and Answer-Clue Guided Reflection for Long Video Understanding

    Jun 8, 2026Shuning Wang, Zhiheng Wu, YiNuo Lu +6Video Question AnsweringVideo-Language Models

  11. When No Answer Is Correct: Diagnosing Absent Answer Detection for MLLMs in Video Understanding

    Jun 6, 2026Yiheng Wang, Yueqian Lin, Lichen Zhu +3Multimodal Large Language ModelsQuestion Answering

  12. StoryVideoQA: Scaling Deep Video Understanding with a Large-Scale, Multi-Genre and Auto-Generated Dataset

    Jun 4, 2026Zhengqian Wu, Zhixian Liu, Aodong Chen +6Video UnderstandingSynthetic Data Generation

  13. MemoryCard: Topic-Aware Multi-Modal Clue Compression for Long-Video Question Answering

    Jun 4, 2026Qing Yang, Pengcheng Huang, Xinze Li +6Video SummarizationVideo Question Answering

  14. VideoKR: Towards Knowledge- and Reasoning-Intensive Video Understanding

    Jun 3, 2026Lin Fu, Zheyuan Yang, Yang Wang +3Video UnderstandingVideo Question Answering

  15. SLU-2K: A Question-Based Benchmark for Semantic Evaluation of Sign Language Translation

    Jun 2, 2026Zeno Testa, Antonino Furnari, Lorenzo Baraldi +1Sign Language TranslationVideo Question Answering

  16. VidMsg: A Benchmark for Implicit Message Inference in Short Videos

    Jun 2, 2026Issar Tzachor, Michael Green, Rami Ben-AriVLM EvaluationVideo Question Answering

  17. Moment-Video: Diagnosing Temporal Fidelity of Video MLLMs on Momentary Visual Events

    Jun 1, 2026Xiaolin Liu, Yilun Zhu, Xiangyu Zhao +9VLM EvaluationVideo Question Answering

  18. Question-Aware Evidence Ledgers for Video Relational Reasoning

    Jun 1, 2026Yilin Ou, Mengshi Qi, Huadong MaVideo ReasoningRelational Reasoning

  19. Temporal Evidence Routing with Structured Visual Evidence for TimeLogicQA

    May 31, 2026Yuyang Sun, Yongliang Wu, Xingyu Zhu +8Temporal Video UnderstandingStructured Reasoning

  20. Adaptive Dense Evidence Refinement for Video Relational Reasoning for VRR-QA Challenge

    May 31, 2026Yuyang Sun, Yongliang Wu, Xingyu Zhu +8Visual Spatial ReasoningInference-Time Optimization

  21. SuperMemory-VQA: An Egocentric Visual Question-Answering Benchmark for Long-Horizon Memory

    May 30, 2026Samiul Alam, Shakhrul Iman Siam, Michael J. Proulx +4Multimodal MemoryEgocentric VQA

  22. CASTLE2026 Team WDL Technical Report

    May 30, 2026Zhengyang Li, Zhenglin Du, Yi Wen +3Multimodal RAGEgocentric VQA