Egocentric Video Understanding

Ask about this topic

Momentum

15 papers in the last four weeks, up 150% on the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 142

All topics
CardsList

  1. EgoPhys: Estimating Peak Contact Force and Mechanical Work from Egocentric Manipulation Video

    Oct 8, 2026Zhuo Dong, Jianhua Yang, Haohao Li +4Human-Object InteractionEgocentric Video Understanding

    School of Artificial Intelligence, Shandong University, Jinan, China · Institute of Automation, Chinese Academy of Sciences, Beijing, China · School of Mechanical Engineering, Tianjin University, Tianjin, China

  2. FloorSAV: Elucidating Spatial Audio-Visual Context with 2D Floormap for AV-LLMs

    Oct 8, 2026Kyeong-Rae Kim, Sungnyun Kim, Tae-Hyun Oh3D Spatial ReasoningAudio-Visual Understanding

    Korea Advanced Institute of Science and Technology

  3. Never Look Back: Understanding Persistence in 3D Object Memory from Egocentric Videos

    Oct 7, 2026Shravan Chaudhari, William Paul, Suchi Saria +2Memory-Augmented Video UnderstandingEgocentric Video Understanding

    Johns Hopkins University · Johns Hopkins University Applied Physics Laboratory

  4. MacJEPA: Missingness-Robust Audio-Visual Recognition from Untrimmed Egocentric Videos

    Oct 6, 2026Souptik Sen, Zahra AhmadiMissing-Modality LearningAudio-Visual Understanding

    Peter L. Reichertz Institute for Medical Informatics, Hannover Medical School, Germany · Lower Saxony Center for Artificial Intelligence and Causal Methods in Medicine (CAIMed), Hannover, Germany

  5. Have I Scene This Before? Spatially Grounded Conversational Memory for Complex Queries in Egocentric Assistants

    Oct 4, 2026Jiazhou Liang, Liam Gallagher, Kiko Chen +4Conversational MemoryEgocentric Video Understanding

    University of Toronto

  6. NextMe-800: Anticipating Personal Behavior from Months of Egocentric Video

    Oct 1, 2026Zhaoxu Meng, Yiming Sun, Mingyuan Gao +5Next-Action PredictionEgocentric Video Understanding

    The University of Hong Kong · Tongji University

  7. EgoFound3R: End-to-End Egocentric Hand Reconstruction in World Space with Point-Wise Interaction Attributes

    Oct 1, 2026Hongming Fu, Jingcheng Shi, Wenjia Wang +23D Hand Pose Estimation3D Reconstruction

    School of AI, Shanghai Jiao Tong University · Rutgers University · The University of Hong Kong +1

  8. EgoTools: Towards Tool-Centric Reasoning in Real-World Egocentric Videos

    Sep 30, 2026Shulin Tian, Junsu Kim, Shuai Liu +17Tool-Use EvaluationTool Use in VLMs

    S-Lab, Nanyang Technological University · A*STAR · KAIST +4

  9. GazeFlow: From Human Gaze Behavior to Generative Egocentric Gaze Prediction

    Sep 29, 2026Sheng Zhao, Weikai Lin, Yuhao ZhuGaze EstimationEgocentric Video Understanding

    Department of Computer Science University of Rochester

  10. Does Local Video Understanding Transfer Across Encounters? The EgoGears Benchmark

    Sep 29, 2026Yuedong Tan, Lei Qi, Yu Liu +13Video UnderstandingEgocentric Video QA

    INSAIT, Sofia University “St. Kliment Ohridski” · University of Würzburg · Technical University of Munich +2

  11. InfiniHand: Streaming World-Space Hand Motion Estimation from Egocentric Video

    Sep 28, 2026Kerui Ren, Kaiwen Song, Weiguang Zhao +83D Hand Pose EstimationCamera Pose Estimation

    Shanghai Artificial Intelligence Laboratory · Shanghai Jiao Tong University · University of Science and Technology of China +4

  12. ESTHER: Egocentric Stereo Hand Estimation and Reconstruction in the Wild

    Sep 28, 2026Hongyu Ma, Hairong Qu, Shiqi Zhao +2Articulated Object Reconstruction3D Hand Pose Estimation

    City University of Hong Kong

  13. Functional Hand Type Prior for 3D Hand Pose Estimation and Action Recognition from Egocentric View Monocular Videos

    Sep 28, 2026Wonseok Roh, Seung Hyun Lee, Won Jeong Ryoo +53D Hand Pose EstimationEgocentric Video Understanding

    Department of Artificial Intelligence, Korea University, Seoul, Republic of Korea · Electrical and Computer Engineering, Purdue University, West Lafayette, Indiana, USA

  14. CE4^4L: Continual Ego, Exo, and Ego-Exo Learning

    Sep 20, 2026Hongwei Yan, Kanglei Zhou, Yuchen Liu +3Temporal Action SegmentationNext-Action Prediction

    School of Life Sciences, IDG/McGovern Institute for Brain Research, Tsinghua University, Beijing, China · Tsinghua-Peking Center for Life Sciences · Department of Psychological and Cognitive Sciences, Tsinghua University, Beijing, China +2

  15. PROVIA: Procedure State Tracking for Online Mistake Detection in Egocentric Videos

    Sep 17, 2026Di Wen, Kailun Yang, Jimmy Weissert +7Egocentric Video UnderstandingState Tracking

    Karlsruhe Institute of Technology, Karlsruhe 76131, Germany · Hunan University, Changsha 410012, China

  16. HAP: A Hand-Driven Active Perception Framework for Egocentric Head Motion Prediction

    Sep 16, 2026Yunji Feng, Junyi Ma, Guanzhong Sun +2Egocentric Video UnderstandingHuman Motion Prediction

    IRMV Lab, School of Automation and Intelligent Sensing, Shanghai Jiao Tong University, Shanghai 200240, China · Zhongguancun Academy, Beijing 100094, China · School of Information and Control Engineering, China University of Mining and Technology, Xuzhou 221116, China

  17. CapMem: A Benchmark for Caption-Based Episodic Memory in Egocentric Video

    Sep 15, 2026Dingli Liang, Yiqiao Xie, Yukai Huang +6Memory-Augmented VLMsEgocentric Video QA

    University College London · Imperial College London · Durham University +4

  18. From Where to How: Continuous 4D Interaction Forecasting from Egocentric Video

    Sep 8, 2026Qiaohui Chu, Haoyu Zhang, Meng Liu +3Egocentric Video UnderstandingHuman Motion Prediction

    School of Computer Science and Technology, Harbin Institute of Technology (Shenzhen), Shenzhen 518055, China · Pengcheng Laboratory, Shenzhen 518000, China · School of Software, Shandong University, Jinan, 250101, China

  19. GOLF: Global Observation with Local Focus for Calibration-Aware Stereo Interaction Field Estimation

    Sep 8, 2026Minqiang Zou, Riqiang Jin, Zhi Lv +7Egocentric Video Understanding

    JIIOV Technology

  20. MINT: A Unified Model for World-Space Camera and Hand Motion Estimation from Scalable Egocentric Pipeline Supervision

    Sep 4, 2026Zijie Zhu, Weiren Cai, Yizhou Wang +43D Hand Pose EstimationCamera Pose Estimation

    1ShanghaiTech University · 3Wuji Technology · 4The University of Hong Kong +2

  21. Seeing the World and the Self from Egocentric Video

    Sep 1, 2026Kai Guan, Minchao Jiang, Ruichen WangLi +2Markerless Motion Capture3D Reconstruction

    The Hong Kong Polytechnic University · Eastern Institute of Technology, Ningbo

  22. PRISM: Predictive Recomposition via Semantic Latent Decomposition for View-invariant Video Representation Learning

    Aug 31, 2026Youngchae Chee, Hosu Lee, Sungjune Park +2Disentangled Representation LearningEgocentric Video Understanding

    KAIST · University of Illinois Urbana-Champaign

  23. ACE-Ego-Hand: Repurposing Video Diffusion Models for Occlusion-Robust Egocentric 3D Hand Motion Recovery

    Aug 20, 2026Yufei Liu, Xixi Wang, Hao Li +8Video Diffusion Models3D Hand Pose Estimation

    1Shanghai Jiao Tong University · 2Nanyang Technological University · 3The Chinese University of Hong Kong +1

  24. EgoMonth: A Month-Level Egocentric Video Benchmark for Long-Term Spatiotemporal Memory

    Aug 13, 2026Weitao Chen, Hu Jiaxin, Xie Tianyidan +15Egocentric Video QAVideo-Language Model Evaluation

    Nanjing University, China · Huawei Technologies Co., Ltd., China · Tianjin University, China

  25. R4DSG: Relative 4D Scene Graph Memory for Object-Centric Question Answering in Long Egocentric Video

    Aug 11, 2026Ke Ma, Yamin Mao, Weiming Li +5Egocentric Video QAVideo QA

    College of Design and Innovation Tongji University Shanghai, China · Samsung R&D Institute China - Beijing Beijing, China · Shanghai Jiao Tong University Shanghai, China +2

  26. EgoTrack3D: A Modular Framework for Egocentric 3D Object Tracking

    Aug 8, 2026Jan Kulik, Bjarni Dagur Thor Karason, Yung-Hsu Yang +3Visual Object TrackingDynamic Scene Reconstruction

    ETH Zürich · ETH Zürich & Microsoft Research · ETH Zürich & TUM & MCML

  27. SCOUT: Self-Checking and Recovery-Aware Tool-Thought Agents for Ultra-Long Egocentric Video Reasoning

    Aug 8, 2026Keyang Zhong, Kuo Wang, Peng Liu +5Temporal Video GroundingGroup Relative Policy Optimization

    Sun Yat-sen University · Shenzhen Loop Area Institute · Guangdong OPPO Mobile Telecommunications Corp., Ltd. +2

  28. GST-Bench: Can VLMs Develop Global Spatial Awareness from Video?

    Aug 6, 2026Qifeng Zhang, Kaixiang Huang, Heng Dong +6VLM EvaluationSpatial Reasoning Benchmarks

    ByteDance Seed · Zhejiang University · National University of Singapore +1

  29. Cooking beyond Frames: A Stereo Event Camera Dataset in the Kitchen

    Aug 5, 2026Chengming Feng, Hesam Araghi, Liming Zheng +4Event-Based VisionHuman Activity Recognition

    Delft University of Technology, The Netherlands · STMicroelectronics, France

  30. The First EgoCross Challenge at EgoVis 2026: Cross-Domain Egocentric Video Question Answering

    Aug 5, 2026Yuqian Fu, Tianwen Qian, Yanjun Li +30Egocentric Video QAVideo QA