Egocentric Video QA

QA: Question Answering

Overview

Egocentric video question answering asks models to answer questions from first-person footage, supporting applications such as activity understanding and personal assistants. Common approaches combine video-language models with frame or clip retrieval and structured memories such as captions and temporal scene graphs, then reason over spatial, temporal, and procedural evidence. Benchmarks test long-term recall, streaming anticipation, out-of-view object tracking, personalized queries, and performance across multiple viewpoints or domains. Models handle many local visual questions but still lose evidence across long timelines, confuse camera motion with changes in the scene, and answer confidently without support; improving grounding and memory while controlling latency and storage remains an open challenge.

Latest papers

CardsList

46 papers7 papers in the last four weeks, up 75% on the four weeks before. 0.0% of all new papers.

  1. Retrieval-Augmented Online Textual Memory for Episodic Memory Video Question Answering

    Oct 22, 2026Raffaele Cali, Giuseppe Lando, Rosario Forte +1Egocentric Video QAVideo QA

  2. EgoOmniWorld: Unifying Egocentric Understanding via Ego-Action-World Interactions

    Oct 13, 2026Songruo Chen, Yuqian Fu, Yu Li +7Egocentric Video UnderstandingEgocentric Video QA

  3. MemLife: Curating and Reasoning over Long-Term Egocentric Video Memories

    Sep 30, 2026Guangzhi Xiong, Xinyuan Zhang, Xiao Yang +14Multimodal MemoryReinforcement Learning

  4. Does Local Video Understanding Transfer Across Encounters? The EgoGears Benchmark

    Sep 29, 2026Yuedong Tan, Lei Qi, Yu Liu +13Video UnderstandingEgocentric Video QA

  5. APM-Bench: Benchmarking Cross-session Persistent Memory for Egocentric Streaming Video Assistants

    Sep 29, 2026Jianguo Huang, Jinming Liu, Qiyao Wang +9Streaming Video UnderstandingEgocentric Video QA

  6. Long Time No See: Benchmarking VLMs for Out-of-Sight Spatiotemporal Reasoning in Egocentric Videos

    Sep 28, 2026Fangzhou Ma, Ivo Alexander Ban, Eren Homburg +5Temporal Video GroundingVisual Spatial Reasoning

  7. CapMem: A Benchmark for Caption-Based Episodic Memory in Egocentric Video

    Sep 15, 2026Dingli Liang, Yiqiao Xie, Yukai Huang +6Memory-Augmented VLMsEgocentric Video QA

  8. EgoSIS: From Factorized Visual Ego-Transitions to Motion-Canonical Spatial Evidence for UAV Reasoning

    Sep 8, 2026Jingpu Yang, Fengxian Ji, Mingxuan Cui +4Visual Spatial ReasoningEgocentric Video QA

  9. Companion-style QA Assistance in Ego-Vision

    Sep 6, 2026Hangyu Qin, Junbin Xiao, Shenglang Zhang +1Egocentric Video QAVideo QA

  10. ClearText-Video: A Large-Scale Text-Centric Video Dataset Bridging Video Restoration and Scene-Text Enhancement

    Aug 28, 2026Jinlong Li, Jiaming Ding, Dingfu Lu +8VLM RobustnessEgocentric Video QA

  11. EgoErrorVQA: Assess Egocentric Comprehension Capabilities through Procedural Errors for Ego-Agentic AI

    Aug 25, 2026Junlong Li, Junxi Li, Jianjun Gao +3VLM ReasoningEgocentric Video QA

  12. EgoMonth: A Month-Level Egocentric Video Benchmark for Long-Term Spatiotemporal Memory

    Aug 13, 2026Weitao Chen, Hu Jiaxin, Xie Tianyidan +15Egocentric Video QAVideo-Language Model Evaluation

  13. R4DSG: Relative 4D Scene Graph Memory for Object-Centric Question Answering in Long Egocentric Video

    Aug 11, 2026Ke Ma, Yamin Mao, Weiming Li +5Egocentric Video QAVideo QA

  14. EgoProceVQA: A Novel Egocentric Procedural Understanding Task with Self-Skill-Exploration Agent

    Jul 15, 2026Junlong Li, Junxi Li, Yuxiang Yang +3Egocentric Video QAVideo QA

  15. Graph it first! Enabling Reasoning on Long-form Egocentric Videos through Scene Graphs

    Jun 24, 2026Agnese Taluzzi, Riccardo Santambrogio, Simone Mentasti +2Egocentric Video QAVideo QA

  16. EgoSAT: A Comprehensive Benchmark of Egocentric Streaming Interaction Understanding

    Jun 23, 2026Yijia Lei, Jinzhao Li, Yichi Zhang +3VLM EvaluationStreaming Video Understanding

  17. VL-MemKnG: Hybrid Memory with a Spatio-Temporal Knowledge Graph for Question Answering over Long Egocentric Navigation Trajectories

    Jun 15, 2026Svetlana Lukina, Mohamad Al Mdfaa, Gloria Haro +2Egocentric Video QAVideo QA

  18. Keep It in Mind: User Centric Continual Spatial Intelligence Reasoning in Egocentric Video Streams

    Jun 13, 2026Yun Wang, Junbin Xiao, Han Lyu +6Spatial Reasoning BenchmarksStreaming Video Understanding

  19. SuperMemory-VQA: An Egocentric Visual Question-Answering Benchmark for Long-Horizon Memory

    May 30, 2026Samiul Alam, Shakhrul Iman Siam, Michael J. Proulx +4Multimodal MemoryEgocentric Video QA

  20. CASTLE2026 Team WDL Technical Report

    May 30, 2026Zhengyang Li, Zhenglin Du, Yi Wen +3Multimodal RAGEgocentric Video QA

  21. EgoAdapt: A Multi-Scene Egocentric Adaptation Method for CVPR 2026 HD-EPIC VQA Challenge

    May 23, 2026Zhiwei Chen, Yupeng Hu, Zixu Li +4Test-Time AdaptationVLM Adaptation

  22. OmniEgo-R2^2: A Routed Reasoning Framework for the 1st Cross-Domain EgoCross Challenge at CVPR 2026

    May 23, 2026Zixu Li, Zhiwei Chen, Zhiheng Fu +4Egocentric Video QAEgocentric Video Understanding

  23. EgoCoT-Bench: Benchmarking Grounded and Verifiable Operation-Centric Chain of Thought Reasoning for MLLMs

    May 19, 2026Yang Dai, Dian Jiao, Tianwei Lin +1Egocentric Video QACoT Reasoning

  24. SPATIOROUTE: Dynamic Prompt Routing for Zero-Shot Spatial Reasoning

    May 18, 2026Pawat Chunhachatrachai, Gueter Josmy Faure, Hung-Ting Su +1Geospatial QAVisual Spatial Reasoning