Egocentric Video QA

QA: Question Answering

Overview

Egocentric video question answering asks models to answer questions from first-person footage, supporting applications such as activity understanding and personal assistants. Common approaches combine video-language models with frame or clip retrieval and structured memories such as captions and temporal scene graphs, then reason over spatial, temporal, and procedural evidence. Benchmarks test long-term recall, streaming anticipation, out-of-view object tracking, personalized queries, and performance across multiple viewpoints or domains. Models handle many local visual questions but still lose evidence across long timelines, confuse camera motion with changes in the scene, and answer confidently without support; improving grounding and memory while controlling latency and storage remains an open challenge.

Latest papers

CardsList

46 papers7 papers in the last four weeks, up 75% on the four weeks before. 0.0% of all new papers.

  1. MARS: Technical Report for the CASTLE Challenge at EgoVis 2026

    May 18, 2026Haoyu Zhang, Qiaohui Chu, Yisen Feng +4Egocentric Video QAEgocentric Video Understanding

  2. Interactive Episodic Memory with User Feedback

    Apr 27, 2026Nikesh Subedi, Loris Bazzani, Ziad Al-HalahEgocentric Video QAEpisodic Memory

  3. EgoEsportsQA: An Egocentric Video Benchmark for Perception and Reasoning in Esports

    Apr 14, 2026Jianzhe Ma, Zhonghao Cao, Shangkui Chen +3Egocentric Video QAVideo QA

  4. Ego-Grounding for Personalized Question-Answering in Egocentric Videos

    Apr 2, 2026Junbin Xiao, Shenglang Zhang, Pengxiang Zhu +1Egocentric Video QAQuestion Answering

  5. Unleashing Spatial Reasoning in Multimodal Large Language Models via Textual Representation Guided Reasoning

    Mar 24, 2026Jiacheng Hua, Yishu Yin, Yuhang Wu +33D Spatial ReasoningMultimodal Large Language Models

  6. Do You See What I Am Pointing At? Gesture-Based Egocentric Video Question Answering

    Mar 13, 2026Yura Choi, Roy Miles, Rolandos Alexandros Potamias +3Egocentric Video QAVideo QA

  7. MA-EgoQA: Question Answering over Egocentric Videos from Multiple Embodied Agents

    Mar 10, 2026Kangsan Kim, Yanlai Yang, Suji Kim +4Egocentric Video QAEmbodied QA

  8. FocusGraph: Graph-Structured Frame Selection for Embodied Long Video Question Answering

    Mar 4, 2026Tatiana Zemskova, Solomon Andryushenko, Ilya Obrubov +4Efficient VLM InferenceEgocentric Video QA

  9. Egocentric Co-Pilot: Web-Native Smart-Glasses Agents for Assistive Egocentric AI

    Mar 1, 2026Sicheng Yang, Yukai Huang, Weitong Cai +8Web AgentsTool-Using Vision-Language Agents

  10. ObjChangeVR: Object State Change Reasoning from Continuous Egocentric Views in VR Environments

    Feb 27, 2026Shiyi Ding, Shaoen Wu, Ying ChenVisual ReasoningVideo Reasoning

  11. EgoGraph: Temporal Knowledge Graph for Egocentric Video Understanding

    Feb 27, 2026Shitong Sun, Ke Han, Yukai Huang +2Egocentric Video UnderstandingEgocentric Video QA

  12. SAW-Bench: Learning Situated Awareness in the Real World

    Feb 18, 2026Chuhan Li, Rilyn Han, Joy Hsu +5Spatial Reasoning BenchmarksEgocentric Video Understanding

  13. SpatialMem: Metric-Aligned Long-Horizon Video Memory for Language Grounding and QA

    Jan 21, 2026Xinyi Zheng, Yunze Liu, Chi-Hao Wu +5Memory-Augmented Video UnderstandingRobotic Spatial Memory