Egocentric Video Understanding

Ask about this topic

Momentum

15 papers in the last four weeks, up 150% on the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 140

All topics
CardsList

  1. Hand-4DGS: Feed-Forward 3D Gaussian Splatting for 4D Hand Reconstruction from Egocentric Videos

    Jun 17, 2026Jeongmin Bae, Seoha Kim, Marc Pollefeys +33D Gaussian Splatting4D Reconstruction

    Yonsei University · Electronics and Telecommunications Research Institute · ETH Zurich +2

  2. EgoCS-400K: An Egocentric Gameplay Dataset for World Models

    Jun 16, 2026Rongjin Guo, Dong Liang, Yuhao Liu +4World Model LearningEgocentric Video Understanding

    City University of Hong Kong

  3. Divide, Deliberate, Decide: A Multi-Agent Framework for Fine-Grained Egocentric Action Recognition

    Jun 16, 2026Alessandro Sottovia, Alessandro Torcinovich, Oswald LanzZero-Shot LearningMulti-Agent Debate

    Faculty of Engineering, Free University of Bozen-Bolzano, Bolzano, Italy

  4. From Frames to Temporal Graphs: In-Context Egocentric Action Recognition with Vision-Language Models

    Jun 13, 2026Bessie Dominguez-Dager, Francisco Gomez-Donoso, Miguel Cazorla +3Egocentric Video UnderstandingIn-Context Learning

    University of Alicante · ETH Zürich · Microsoft

  5. Keep It in Mind: User Centric Continual Spatial Intelligence Reasoning in Egocentric Video Streams

    Jun 13, 2026Yun Wang, Junbin Xiao, Han Lyu +6Spatial Reasoning BenchmarksStreaming Video Understanding

    Department of Computer Science, City University of Hong Kong · University of Science and Technology of China · National University of Singapore +4

  6. Rethinking RAG in Long Videos: What to Retrieve and How to Use It?

    Jun 11, 2026Yuho Lee, Jisu Shin, Nicole Hee-Yeon Kim +5Multimodal RAGEgocentric Video Understanding

    KAIST, YH, Seoul, Republic of Korea · Qualcomm AI Research, Qualcomm Korea, YH, Seoul, Republic of Korea

  7. Objects Before Words: Object-First Inductive Biases for Grounding Language in Child-View Video

    Jun 11, 2026Sathira Silva, Abrham Kahsay Gebreselasie, Muhammad Umer Sheikh +3Object-Centric Representation LearningEgocentric Video Understanding

    Mohamed bin Zayed University of Artificial Intelligence, Abu Dhabi, UAE · Weizmann Institute of Science, Rehovot, Israel

  8. Reason, Then Re-reason: Cross-view Revisiting Improves Spatial Reasoning

    Jun 10, 2026Chaofan Ma, Zhenjie Mao, Yuhuan Yang +5Visual Spatial Reasoning3D Spatial Reasoning

    Cooperative Medianet Innovation Center, Shanghai Jiao Tong University · Shanghai Jiao Tong University · Tongji University

  9. Decoding Pedestrian Crossing Intention from Egocentric Vision via Vision Language Models

    Jun 8, 2026Danya Li, Xiang Su, Yan Feng +1Pedestrian Intention PredictionVLM Adaptation

    Department of Technology, Management, and Economics, Technical University of Denmark, Denmark · Department of Computer Science and Department of Agricultural Sciences, University of Helsinki, Finland · Department of Transport and Planning, Delft University of Technology, Netherlands

  10. EgoAERO: Learning Dexterous Manipulation from a Single Egocentric Video without Object Assets

    Jun 6, 2026Yichen Niu, Haoran Lv, Xinrui Zhang +12Contact-Rich Robotic ManipulationEgocentric Video Understanding

    School of Astronautics, Harbin Institute of Technology · 2Lumos Robotic · 3Suzhou Research Institute, Harbin Institute of Technology +5

  11. EgoPressDiff: Multimodal Video Diffusion for Egocentric UV-Domain Hand-Pressure Estimation

    Jun 5, 2026Yuan Zeng, Zilue Gao, Yujia Shi +3Video Diffusion ModelsTactile Sensing

    Shenzhen International Graduate School, Tsinghua University, China · Harbin Institute of Technology, China · Pengcheng Laboratory, China

  12. ActiveMimic: Egocentric Video Pretraining with Active Perception

    Jun 4, 2026Xingyao Lin, Guojin Zhong, Tianyi Lu +4Active PerceptionActive Vision for Robot Manipulation

    Fudan University · Shanghai Innovation Institute · Current Robotics +1

  13. Continual Visual and Verbal Learning Through a Child's Egocentric Input

    Jun 3, 2026Xiaoyang Jiang, Yanlai Yang, Kenneth A. Norman +2Egocentric Video UnderstandingReplay-Based Continual Learning

    Agentic Learning AI Lab, New York University · Department of Psychology, Princeton University

  14. Plan, Watch, Recover: A Benchmark and Architectures for Proactive Procedural Assistance

    Jun 3, 2026Kaustav Kundu, Ritvik Shrivastava, Maxim Arap +13LLM PlanningEgocentric Video Understanding

    1Meta Reality Labs · 2Meta Superintelligence Labs

  15. VLESA: Vision-Language Embodied Safety Agent for Human Activity Monitoring

    Jun 2, 2026Hanjiang Hu, Yiyuan Pan, Jiaxing Li +5Egocentric Video UnderstandingAI Agent Safety

    Carnegie Mellon University · Harvard University · Mitsubishi Electric Research Laboratories

  16. OVO-S-Bench: A Hierarchical Benchmark for Streaming Spatial Intelligence in Multimodal LLMs

    Jun 2, 2026Yifei Li, Pengyiang Liu, Yuhang Zang +4Spatial Reasoning BenchmarksSpatiotemporal Reasoning

    Tsinghua University · Shanghai AI Laboratory · Beihang University

  17. Hand Trajectory Fusion for Egocentric Natural Language Query Grounding

    Jun 1, 2026Enmin Zhong, Carlos R. del-Blanco, Fernando Jaureguizar +1Temporal Video GroundingEgocentric Video Understanding

    Grupo de Tratamiento de Im´agenes (GTI), Information Processing and Telecommunications Center , ETSI Telecomunicaci´on, Universidad Polit´ecnica de Madrid, Spain

  18. Understanding-Enhanced Model Collaboration for Long-Tailed Egocentric Mistake Detection

    Jun 1, 2026Boyu Han, Qianqian Xu, Shilong Bao +3Egocentric Video UnderstandingTemporal Video Understanding

    State Key Laboratory of AI Safety, Institute of Computing Technology, CAS · School of Computer Science and Tech., University of Chinese Academy of Sciences · Beijing Academy of Artificial Intelligence +2

  19. 3rd Place at CVPR 2026 CASTLE Challenge: Agentic Multi-View Long-Context Video Understanding via Hierarchical Knowledge Graph Retrieval

    Jun 1, 2026Raghad Albusayes, Munirah AlyahyaVideo QAEgocentric Video Understanding

    TAHAKOM

  20. The Right Inference Strategy Is All You Need: Nearly Training-Free Domain-Wise Inference for EgoCross Challenge

    May 30, 2026Leyi Wu, Yifan Zhao, Jinjie Zhang +2Egocentric Video QAVideo QA

    HKUST(GZ) · Knowin · HKUST

  21. CASTLE2026 Team WDL Technical Report

    May 30, 2026Zhengyang Li, Zhenglin Du, Yi Wen +3Multimodal RAGEgocentric Video QA

    Key Laboratory of Intelligent Perception and Image Understanding

  22. FROST-STA: Frozen Dense Features for the Ego4D Short-Term Object Interaction Anticipation

    May 30, 2026Chaoyang Wang, Lexuan XuEgocentric Video UnderstandingTemporal Video Understanding

    Beihang University

  23. TAP-JEPA: Frozen Future-Latent Probing and Two-Stage Score Fusion for EPIC-KITCHENS-100 Action Anticipation

    May 30, 2026Chaoyang Wang, Lexuan XuNext-Action PredictionEgocentric Video Understanding

    Beihang University

  24. Ego-METAS: Egocentric online Multimodal Energy-efficient Temporal Action Segmentation benchmark

    May 29, 2026Maria Santos-Villafranca, Jesus Bermudez-cameo, Alejandro Perez-Yus +2Temporal Action SegmentationEnergy-Efficient ML

    University of Zaragoza - I3A · Department of Mathematics and Computer Science, University of Catania

  25. EGOSTREAM: A Diagnostic Benchmark for Streaming Episodic Memory in Egocentric Vision

    May 29, 2026Rosario Forte, Giuseppe Lando, Antonino FurnariVLM EvaluationStreaming Video Understanding

    Department of Mathematics and Computer Science University of Catania

  26. HiERO-StepG @ Ego4D Step Grounding Challenge: hierarchical activity understanding enables zero-shot step grounding

    May 29, 2026Andrea Zenotto, Simone Alberto Peirone, Francesca Pistilli +1Temporal Video GroundingZero-Shot Learning

    Politecnico di Torino

  27. WristCompass: Kinematic Coupling as a Learnable Visual Concept for Ego-Camera Orientation

    May 29, 2026Varun Nair, Vidyut Baradwaj, Jiahang He +3Camera Pose EstimationEgocentric Video Understanding

  28. Semantic and Visual Evidence for Efficient Long-Video Reasoning: A Solution for the HD-EPIC VQA Challenge

    May 28, 2026Yinsong Xu, Wei Jing, Liuxin Zhang +2Egocentric Video QAVideo QA

    Lenovo, China

  29. Reflective Dialogue between Teacher and Solver Agents for Video Question Answering

    May 27, 2026Takuya Murakawa, Toru TamakiVLM AdaptationVideo QA

    Nagoya Institute of Technology, Nagoya, Japan

  30. EgoBench: An Interactive Egocentric Multimodal Benchmark for Tool-Using Agents

    May 27, 2026Yunqi Liu, Tong Niu, Zitong Wang +4AI Agent EvaluationEgocentric Video Understanding

    Ant Group