Egocentric VQA

VQA: Video Question Answering

Overview

Egocentric video question answering asks models to answer questions from first-person footage, supporting applications such as activity understanding and personal assistants. Common approaches combine video-language models with frame or clip retrieval and structured memories such as captions and temporal scene graphs, then reason over spatial, temporal, and procedural evidence. Benchmarks test long-term recall, streaming anticipation, out-of-view object tracking, personalized queries, and performance across multiple viewpoints or domains. Models handle many local visual questions but still lose evidence across long timelines, confuse camera motion with changes in the scene, and answer confidently without support; improving grounding and memory while controlling latency and storage remains an open challenge.

Latest papers

CardsList

52 papers3 papers in the last four weeks, down 40% on the four weeks before. 0.0% of all new papers.

  1. EgoWitness: Benchmarking Instance-Level Spatial Memory and Reasoning in Egocentric Video Streams

    Nov 19, 2026Zhengru Fang, Zehao Liu, Mingyu Tsoi +7Spatial Reasoning BenchmarksEgocentric Video Understanding

  2. EgoPass-Bench: Identifying Objects That May Affect the Wearer's Passage in Egocentric Video

    Nov 18, 2026Hongyu Wang, Chuhan Li, Congjin Xu +2Egocentric Video UnderstandingEgocentric VQA

  3. EgoLink: Egocentric Language-Vision Interactive Network Knowledge Challenge Summary

    Nov 16, 2026Renhe Sun, Yueying Feng, Bohan Yu +12Multimodal Agent EvaluationEgocentric Video Understanding

  4. ReferClaw: Disambiguating User Intent for Egocentric Assistance

    Nov 5, 2026Hangyu Qin, Junbin Xiao, Angela YaoEgocentric VQAClarification Question Generation

  5. Retrieval-Augmented Online Textual Memory for Episodic Memory Video Question Answering

    Oct 22, 2026Raffaele Cali, Giuseppe Lando, Rosario Forte +1Egocentric VQAVideo Question Answering

  6. EgoOmniWorld: Unifying Egocentric Understanding via Ego-Action-World Interactions

    Oct 13, 2026Songruo Chen, Yuqian Fu, Yu Li +7Egocentric Video UnderstandingEgocentric VQA

  7. MemLife: Curating and Reasoning over Long-Term Egocentric Video Memories

    Sep 30, 2026Guangzhi Xiong, Xinyuan Zhang, Xiao Yang +14Multimodal MemoryReinforcement Learning

  8. Does Local Video Understanding Transfer Across Encounters? The EgoGears Benchmark

    Sep 29, 2026Yuedong Tan, Lei Qi, Yu Liu +13Video UnderstandingEgocentric VQA

  9. APM-Bench: Benchmarking Cross-session Persistent Memory for Egocentric Streaming Video Assistants

    Sep 29, 2026Jianguo Huang, Jinming Liu, Qiyao Wang +9Streaming Video UnderstandingEgocentric VQA

  10. Long Time No See: Benchmarking VLMs for Out-of-Sight Spatiotemporal Reasoning in Egocentric Videos

    Sep 28, 2026Fangzhou Ma, Ivo Alexander Ban, Eren Homburg +5Temporal Video GroundingVisual Spatial Reasoning

  11. CapMem: A Benchmark for Caption-Based Episodic Memory in Egocentric Video

    Sep 15, 2026Dingli Liang, Yiqiao Xie, Yukai Huang +6Memory-Augmented VLMsEgocentric VQA

  12. EgoSIS: From Factorized Visual Ego-Transitions to Motion-Canonical Spatial Evidence for UAV Reasoning

    Sep 8, 2026Jingpu Yang, Fengxian Ji, Mingxuan Cui +4Visual Spatial ReasoningEgocentric VQA

  13. Companion-style QA Assistance in Ego-Vision

    Sep 6, 2026Hangyu Qin, Junbin Xiao, Shenglang Zhang +1Egocentric VQAVideo Question Answering

  14. ClearText-Video: A Large-Scale Text-Centric Video Dataset Bridging Video Restoration and Scene-Text Enhancement

    Aug 28, 2026Jinlong Li, Jiaming Ding, Dingfu Lu +8VLM RobustnessEgocentric VQA

  15. EgoErrorVQA: Assess Egocentric Comprehension Capabilities through Procedural Errors for Ego-Agentic AI

    Aug 25, 2026Junlong Li, Junxi Li, Jianjun Gao +3VLM ReasoningEgocentric VQA

  16. EgoMonth: A Month-Level Egocentric Video Benchmark for Long-Term Spatiotemporal Memory

    Aug 13, 2026Weitao Chen, Hu Jiaxin, Xie Tianyidan +15Egocentric VQAVideo-Language Model Evaluation

  17. R4DSG: Relative 4D Scene Graph Memory for Object-Centric Question Answering in Long Egocentric Video

    Aug 11, 2026Ke Ma, Yamin Mao, Weiming Li +5Egocentric VQAVideo Question Answering

  18. EgoProceVQA: A Novel Egocentric Procedural Understanding Task with Self-Skill-Exploration Agent

    Jul 15, 2026Junlong Li, Junxi Li, Yuxiang Yang +3Egocentric VQAVideo Question Answering

  19. Graph it first! Enabling Reasoning on Long-form Egocentric Videos through Scene Graphs

    Jun 24, 2026Agnese Taluzzi, Riccardo Santambrogio, Simone Mentasti +2Egocentric VQAVideo Question Answering

  20. EgoSAT: A Comprehensive Benchmark of Egocentric Streaming Interaction Understanding

    Jun 23, 2026Yijia Lei, Jinzhao Li, Yichi Zhang +3VLM EvaluationStreaming Video Understanding

  21. VL-MemKnG: Hybrid Memory with a Spatio-Temporal Knowledge Graph for Question Answering over Long Egocentric Navigation Trajectories

    Jun 15, 2026Svetlana Lukina, Mohamad Al Mdfaa, Gloria Haro +2Egocentric VQAVideo Question Answering

  22. Keep It in Mind: User Centric Continual Spatial Intelligence Reasoning in Egocentric Video Streams

    Jun 13, 2026Yun Wang, Junbin Xiao, Han Lyu +6Spatial Reasoning BenchmarksStreaming Video Understanding

  23. SuperMemory-VQA: An Egocentric Visual Question-Answering Benchmark for Long-Horizon Memory

    May 30, 2026Samiul Alam, Shakhrul Iman Siam, Michael J. Proulx +4Multimodal MemoryEgocentric VQA

  24. CASTLE2026 Team WDL Technical Report

    May 30, 2026Zhengyang Li, Zhenglin Du, Yi Wen +3Multimodal RAGEgocentric VQA