Video Question Answering

Also known as VQA

Overview

Video question answering asks models to identify events, people, actions, and relationships in video, including when things happen and why. Approaches include vision-language models, question-aware frame selection and retrieval, temporal memory, scene graphs, and agentic systems that inspect evidence with tools. Benchmarks test settings such as long-form and streaming video, egocentric activity, causal reasoning, and precise temporal grounding. A central challenge is that high answer accuracy can coexist with weak use of visual evidence, poor temporal grounding, and overconfidence when evidence is incomplete.

Latest papers

CardsList

197 papers17 papers in the last four weeks, down 26% on the four weeks before. 0.1% of all new papers.

  1. VIVID: Beyond Static Multi-Image Reasoning with Localized Visual Differences and Textual Entity Dynamics in Video MLLMs

    Nov 17, 2026Chengqian Ma, Yuanze Zeng, Hongyu Wang +8Video Question AnsweringTemporal Video Understanding

  2. FrameRouter: Frame Budget Routing for Long-Video Understanding on Video-MME-v2 and Beyond

    Nov 17, 2026Bingjun Luo, Jialin Guo, Siqi LiLong-Video QAVideo Question Answering

  3. EndoComparer: Comparative Surgical Video Question Answering with Pseudo-Siamese Visual Adaptation and Perceive-then-Compare Reasoning

    Nov 14, 2026Shi Li, Lalith Sharan, Joël L. Lavanchy +8Surgical VQAVideo Question Answering

  4. RAVEN-Bench: A Paired EO-IR Video QA Benchmark for Aerial Multimodal Understanding

    Nov 13, 2026Yu Hu, Jianyang Gu, Yue Cao +5Video Question AnsweringRemote Sensing Benchmarks

  5. TraCE: Trajectory-Aware Concepts for Explainable Video Understanding

    Nov 4, 2026Wooil Lee, Junpyo Hong, Jongseo Lee +3Video UnderstandingConcept-Based Explanations

  6. EP-LVMQA: Evidence-Preserving Coarse-to-Fine Localization for Low-Quality Long Video Moment Question Answering

    Nov 3, 2026Guoning Chen, Zhexun Hu, Yifan Wei +3Video Question AnsweringLong-Video QA

  7. SurgStream: A Workflow-Anchored Proactive Streaming Framework and Benchmark for Real-Time Surgical Video Understanding

    Nov 1, 2026Ruipeng Ma, Qing Xu, Jie Liang +1Streaming Video UnderstandingSurgical Video Understanding

  8. StreamClarify: Proactive Clarification for Grounded Streaming Video Question Answering

    Oct 31, 2026Zhuchen Shao, Bo Chen, Klara NahrstedtStreaming VQAVideo Question Answering

  9. Selecting or Solving? What Best-of-N Verification Delivers in Video Reasoning

    Oct 31, 2026Martin Q. Ma, Yuxiao Qu, Ruslan Salakhutdinov +3Video ReasoningVideo-Language Model Evaluation

  10. TwinPast: Benchmarking Historical Evidence Use in Streaming Video Understanding with Evidence Contrastive Video Pairs

    Oct 30, 2026Haotian Yang, Yong Chen, Cheng Peng +4Evidence-Grounded VQAStreaming Video Understanding

  11. VideoMemBench: How Well Do MLLMs Remember in Video Conversations?

    Oct 29, 2026Zhengdong Hu, Chao Wang, Kaituo Feng +4MLLM EvaluationVideo Question Answering

  12. AskStream: When and What to Ask Proactively under Uncertainty in Streaming Video Understanding

    Oct 28, 2026Lu Wang, Zhuoran Jin, Longxiang Wang +8Streaming Video UnderstandingVideo Question Answering

  13. MarineLife-16K: An Attribute-Rich Video-Text Dataset for Motion-Aware Marine Video Understanding

    Oct 24, 2026Quang-Trung Truong, Thanh-Nghia Nguyen, Phu-Phong Vo +7Video UnderstandingMultimodal Dataset

  14. Retrieval-Augmented Online Textual Memory for Episodic Memory Video Question Answering

    Oct 22, 2026Raffaele Cali, Giuseppe Lando, Rosario Forte +1Egocentric VQAVideo Question Answering

  15. PACE: Plan, Attend, Check, and Emit for Training-Free Response Timing in Streaming Video Understanding

    Oct 20, 2026Siqi Guo, Yuxia Chen, Wenbo Zhu +4Streaming VQAStreaming Video Understanding

  16. DiffGround: Semantic Difference-Guided Zero-Shot Video Question Grounding

    Oct 18, 2026Cheng-Han Lee, Amir Salimi, Hsiang-Wei Huang +3Temporal Video GroundingVideo Question Answering

  17. StreamAhead: Real-Time Streaming Video Question Answering via Adaptive Precomputation

    Oct 18, 2026Haoyang Fan, Dhruv Parikh, Rajgopal Kannan +1Streaming VQAVideo Question Answering

  18. ProV-Mem: Proactive Memory for Streaming Video Question Answering

    Oct 15, 2026Bingbing Wang, Jing Li, Han Gao +3Streaming VQAVideo Question Answering

  19. VisualTrust: Video Reasoning under On-Screen Claim Framing

    Oct 15, 2026Huachao Zhu, Junjielong Xu, Sicheng Li +5Video-Language Model EvaluationVLM Robustness

  20. DeltaStreamer: Towards Human-Like Agentic Streaming Video Understanding

    Oct 14, 2026Boyuan Sun, Deshui Miao, Wenzhao Gao +8Streaming Video UnderstandingVideo Question Answering

  21. OmniCompass: A Holistic Benchmark for Omni-Modal Video Grounding and Understanding

    Oct 13, 2026Xuyang Liu, Shihao Wang, Xinyu Wei +5Video-Language Model EvaluationMultimodal Grounding

  22. FoveaTree: Information-Density Trees for Query-Guided Visual Token Pruning in Video Large Language Models

    Oct 12, 2026Zihan Meng, Weidong Chen, Dexiang Hong +2Efficient VLM InferenceVisual Token Pruning

  23. VideoSlate: Stateful Commit Control for Temporally Grounded Agentic Video Reasoning

    Oct 12, 2026Shuo Zheng, Yuanjie Dang, Peng Chen +4Temporal Video GroundingVideo Question Answering

  24. VideoEvoHarness: Self Evolving Agent Harness from Unlabeled Videos for Video Understanding

    Oct 11, 2026Weixin Xu, Yifan Liu, Yi Wang +5Agent Harness OptimizationSelf-Evolving Agents

  25. SPARE: Shared Perception and Adaptive Retrieval of Evidence for Streaming Video Understanding

    Oct 10, 2026Senbin Xu, Zijun Zhang, Xinhua Wu +7Streaming VQAStreaming Video Understanding