Egocentric Video Understanding

Ask about this topic

Momentum

15 papers in the last four weeks, up 150% on the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 140

All topics
CardsList

  1. Never Look Back: Understanding Persistence in 3D Object Memory from Egocentric Videos

    Oct 7, 2026Shravan Chaudhari, William Paul, Suchi Saria +2Memory-Augmented Video UnderstandingEgocentric Video Understanding

    Johns Hopkins University · Johns Hopkins University Applied Physics Laboratory

  2. MacJEPA: Missingness-Robust Audio-Visual Recognition from Untrimmed Egocentric Videos

    Oct 6, 2026Souptik Sen, Zahra AhmadiMissing-Modality LearningAudio-Visual Understanding

    Peter L. Reichertz Institute for Medical Informatics, Hannover Medical School, Germany · Lower Saxony Center for Artificial Intelligence and Causal Methods in Medicine (CAIMed), Hannover, Germany

  3. Have I Scene This Before? Spatially Grounded Conversational Memory for Complex Queries in Egocentric Assistants

    Oct 4, 2026Jiazhou Liang, Liam Gallagher, Kiko Chen +4Conversational MemoryEgocentric Video Understanding

    University of Toronto

  4. NextMe-800: Anticipating Personal Behavior from Months of Egocentric Video

    Oct 1, 2026Zhaoxu Meng, Yiming Sun, Mingyuan Gao +5Next-Action PredictionEgocentric Video Understanding

    The University of Hong Kong · Tongji University

  5. EgoFound3R: End-to-End Egocentric Hand Reconstruction in World Space with Point-Wise Interaction Attributes

    Oct 1, 2026Hongming Fu, Jingcheng Shi, Wenjia Wang +23D Hand Pose Estimation3D Reconstruction

    School of AI, Shanghai Jiao Tong University · Rutgers University · The University of Hong Kong +1

  6. EgoTools: Towards Tool-Centric Reasoning in Real-World Egocentric Videos

    Sep 30, 2026Shulin Tian, Junsu Kim, Shuai Liu +17Tool-Use EvaluationTool Use in VLMs

    S-Lab, Nanyang Technological University · A*STAR · KAIST +4

  7. GazeFlow: From Human Gaze Behavior to Generative Egocentric Gaze Prediction

    Sep 29, 2026Sheng Zhao, Weikai Lin, Yuhao ZhuGaze EstimationEgocentric Video Understanding

    Department of Computer Science University of Rochester

  8. Does Local Video Understanding Transfer Across Encounters? The EgoGears Benchmark

    Sep 29, 2026Yuedong Tan, Lei Qi, Yu Liu +13Video UnderstandingEgocentric Video QA

    INSAIT, Sofia University “St. Kliment Ohridski” · University of Würzburg · Technical University of Munich +2

  9. InfiniHand: Streaming World-Space Hand Motion Estimation from Egocentric Video

    Sep 28, 2026Kerui Ren, Kaiwen Song, Weiguang Zhao +83D Hand Pose EstimationCamera Pose Estimation

    Shanghai Artificial Intelligence Laboratory · Shanghai Jiao Tong University · University of Science and Technology of China +4

  10. ESTHER: Egocentric Stereo Hand Estimation and Reconstruction in the Wild

    Sep 28, 2026Hongyu Ma, Hairong Qu, Shiqi Zhao +2Articulated Object Reconstruction3D Hand Pose Estimation

    City University of Hong Kong

  11. Functional Hand Type Prior for 3D Hand Pose Estimation and Action Recognition from Egocentric View Monocular Videos

    Sep 28, 2026Wonseok Roh, Seung Hyun Lee, Won Jeong Ryoo +53D Hand Pose EstimationEgocentric Video Understanding

    Department of Artificial Intelligence, Korea University, Seoul, Republic of Korea · Electrical and Computer Engineering, Purdue University, West Lafayette, Indiana, USA

  12. CE4^4L: Continual Ego, Exo, and Ego-Exo Learning

    Sep 20, 2026Hongwei Yan, Kanglei Zhou, Yuchen Liu +3Temporal Action SegmentationNext-Action Prediction

    School of Life Sciences, IDG/McGovern Institute for Brain Research, Tsinghua University, Beijing, China · Tsinghua-Peking Center for Life Sciences · Department of Psychological and Cognitive Sciences, Tsinghua University, Beijing, China +2

  13. PROVIA: Procedure State Tracking for Online Mistake Detection in Egocentric Videos

    Sep 17, 2026Di Wen, Kailun Yang, Jimmy Weissert +7Egocentric Video UnderstandingState Tracking

    Karlsruhe Institute of Technology, Karlsruhe 76131, Germany · Hunan University, Changsha 410012, China

  14. HAP: A Hand-Driven Active Perception Framework for Egocentric Head Motion Prediction

    Sep 16, 2026Yunji Feng, Junyi Ma, Guanzhong Sun +2Egocentric Video UnderstandingHuman Motion Prediction

    IRMV Lab, School of Automation and Intelligent Sensing, Shanghai Jiao Tong University, Shanghai 200240, China · Zhongguancun Academy, Beijing 100094, China · School of Information and Control Engineering, China University of Mining and Technology, Xuzhou 221116, China

  15. CapMem: A Benchmark for Caption-Based Episodic Memory in Egocentric Video

    Sep 15, 2026Dingli Liang, Yiqiao Xie, Yukai Huang +6Memory-Augmented VLMsEgocentric Video QA

    University College London · Imperial College London · Durham University +4

  16. From Where to How: Continuous 4D Interaction Forecasting from Egocentric Video

    Sep 8, 2026Qiaohui Chu, Haoyu Zhang, Meng Liu +3Egocentric Video UnderstandingHuman Motion Prediction

    School of Computer Science and Technology, Harbin Institute of Technology (Shenzhen), Shenzhen 518055, China · Pengcheng Laboratory, Shenzhen 518000, China · School of Software, Shandong University, Jinan, 250101, China

  17. GOLF: Global Observation with Local Focus for Calibration-Aware Stereo Interaction Field Estimation

    Sep 8, 2026Minqiang Zou, Riqiang Jin, Zhi Lv +7Egocentric Video Understanding

    JIIOV Technology

  18. MINT: A Unified Model for World-Space Camera and Hand Motion Estimation from Scalable Egocentric Pipeline Supervision

    Sep 4, 2026Zijie Zhu, Weiren Cai, Yizhou Wang +43D Hand Pose EstimationCamera Pose Estimation

    1ShanghaiTech University · 3Wuji Technology · 4The University of Hong Kong +2

  19. Seeing the World and the Self from Egocentric Video

    Sep 1, 2026Kai Guan, Minchao Jiang, Ruichen WangLi +2Markerless Motion Capture3D Reconstruction

    The Hong Kong Polytechnic University · Eastern Institute of Technology, Ningbo

  20. PRISM: Predictive Recomposition via Semantic Latent Decomposition for View-invariant Video Representation Learning

    Aug 31, 2026Youngchae Chee, Hosu Lee, Sungjune Park +2Disentangled Representation LearningEgocentric Video Understanding

    KAIST · University of Illinois Urbana-Champaign

  21. ACE-Ego-Hand: Repurposing Video Diffusion Models for Occlusion-Robust Egocentric 3D Hand Motion Recovery

    Aug 20, 2026Yufei Liu, Xixi Wang, Hao Li +8Video Diffusion Models3D Hand Pose Estimation

    1Shanghai Jiao Tong University · 2Nanyang Technological University · 3The Chinese University of Hong Kong +1

  22. EgoMonth: A Month-Level Egocentric Video Benchmark for Long-Term Spatiotemporal Memory

    Aug 13, 2026Weitao Chen, Hu Jiaxin, Xie Tianyidan +15Egocentric Video QAVideo-Language Model Evaluation

    Nanjing University, China · Huawei Technologies Co., Ltd., China · Tianjin University, China

  23. R4DSG: Relative 4D Scene Graph Memory for Object-Centric Question Answering in Long Egocentric Video

    Aug 11, 2026Ke Ma, Yamin Mao, Weiming Li +5Egocentric Video QAVideo QA

    College of Design and Innovation Tongji University Shanghai, China · Samsung R&D Institute China - Beijing Beijing, China · Shanghai Jiao Tong University Shanghai, China +2

  24. EgoTrack3D: A Modular Framework for Egocentric 3D Object Tracking

    Aug 8, 2026Jan Kulik, Bjarni Dagur Thor Karason, Yung-Hsu Yang +3Visual Object TrackingDynamic Scene Reconstruction

    ETH Zürich · ETH Zürich & Microsoft Research · ETH Zürich & TUM & MCML

  25. SCOUT: Self-Checking and Recovery-Aware Tool-Thought Agents for Ultra-Long Egocentric Video Reasoning

    Aug 8, 2026Keyang Zhong, Kuo Wang, Peng Liu +5Temporal Video GroundingGroup Relative Policy Optimization

    Sun Yat-sen University · Shenzhen Loop Area Institute · Guangdong OPPO Mobile Telecommunications Corp., Ltd. +2

  26. GST-Bench: Can VLMs Develop Global Spatial Awareness from Video?

    Aug 6, 2026Qifeng Zhang, Kaixiang Huang, Heng Dong +6VLM EvaluationSpatial Reasoning Benchmarks

    ByteDance Seed · Zhejiang University · National University of Singapore +1

  27. Cooking beyond Frames: A Stereo Event Camera Dataset in the Kitchen

    Aug 5, 2026Chengming Feng, Hesam Araghi, Liming Zheng +4Event-Based VisionHuman Activity Recognition

    Delft University of Technology, The Netherlands · STMicroelectronics, France

  28. The First EgoCross Challenge at EgoVis 2026: Cross-Domain Egocentric Video Question Answering

    Aug 5, 2026Yuqian Fu, Tianwen Qian, Yanjun Li +30Egocentric Video QAVideo QA

  29. GROVE: Growing and Reasoning over Temporally Stratified Memory from Streaming Video Experience

    Aug 3, 2026Sitong Gong, Caixin Kang, Tianyu Yan +7Streaming Video UnderstandingVideo QA

    1Dalian University of Technology · 2Alaya Lab · 3The University of Tokyo +1

  30. SERUM: State Extraction and Refinement for User Modeling

    Jul 31, 2026Andy J. Phu, James Mooney, Karin de Langis +2Human Activity RecognitionEgocentric Video Understanding

    Minnesota NLP Lab · University of Minnesota · Minneapolis, MN 55455, USA

  31. EgoSafe: A First-Person Mobile-Captured Benchmark for Visual Safety Understanding

    Jul 29, 2026Yuyun Chen, Tianao Li, TianQuan Feng +4Egocentric Video UnderstandingVideo Reasoning

    South China University of Technology · Beihang University

  32. EgoPlay: Event-Triggered Video Editing for Egocentric Streams

    Jul 27, 2026Jinjie Mai, Gordon Guocheng Qian, Willi Menapace +8Video Diffusion ModelsStreaming Video Generation

    Snap Inc., USA · King Abdullah University of Science and Technology (KAUST), Saudi Arabia

  33. Sidewalk Moments: Are Richer Representations Always More Human-Aligned? Evidence from City-Walk Videos

    Jul 23, 2026Liu Liu, Freya Huying Tan, Fábio DuarteEgocentric Video UnderstandingVideo Representation Learning

    Massachusetts Institute of Technology, 77 Massachusetts Avenue, Cambridge, MA 02139, USA · City Form Lab, MIT · Senseable City Lab, MIT

  34. ReViV: Reconstructing the Viewer and the View in 4D from Monocular Egocentric Video

    Jul 20, 2026Xiaozhong Lyu, Gen Li, Zhiyin Qian +3Gaze Estimation4D Reconstruction

    ETH Zurich, Switzerland · Delft University of Technology, Netherlands · Microsoft, Switzerland

  35. Understanding From Human Perspective: A Multi-agent System for Interactive Egocentric Medical Image Segmentation

    Jul 19, 2026Rongjun Ge, Dongyang Wang, Heng Zhu +3Interactive Medical Image SegmentationReferring Video Object Segmentation

    School of Instrument Science and Engineering, Southeast University, Nanjing 210096, China · School of Computer Science and Engineering, Southeast University, Nanjing 210096, China · Sichuan University-Pittsburgh Institute, Sichuan University, Chengdu 610065, China +1

  36. Exo2EgoPose: Leveraging Exocentric Demonstrations for Vision-Language guided Egocentric 3D Hand Pose Forecasting

    Jul 17, 2026Zhaofeng Shi, Heqian Qiu, Lanxiao Wang +23D Hand Pose EstimationCross-Embodiment Robot Learning

    University of Electronic Science and Technology of China Chengdu, Sichuan, China

  37. Open-AoE: An Open Egocentric Manipulation Dataset and Toolchain for Embodied Learning

    Jul 15, 2026Zishuo Li, Bowen Yang, Changtao Miao +29Robotic Data CollectionEgocentric Video Understanding

    AoE Team, Ant Group

  38. EgoProceVQA: A Novel Egocentric Procedural Understanding Task with Self-Skill-Exploration Agent

    Jul 15, 2026Junlong Li, Junxi Li, Yuxiang Yang +3Egocentric Video QAVideo QA

    The Hong Kong Polytechnic University Hong Kong, China

  39. Vinci2: Providing Proactive Assistance in Continuous Egocentric Videos

    Jul 13, 2026Gong Sitong, Tianyu Yan, Caixin Kang +6Egocentric Video UnderstandingProactive Assistance

    Dalian University of Technology · Alaya Lab · The University of Tokyo

  40. AgenticFocus: Object-Preserving Mixed Reality Synthesis from Human FPV Video for Dexterous Humanoid Learning

    Jul 9, 2026Iaroslav Kolomiets, Miguel Altamirano Cabrera, Artem Lykov +6Humanoid Robot ControlCross-Embodiment Robot Learning

    Intelligent Space Robotics Lab, Skolkovo Institute of Science and Technology, Moscow, Russian Federation · R&D Center, MWS, Moscow, Russian Federation

  41. Whareformer: Learning to Track What is Where in Long Egocentric Videos

    Jul 9, 2026Jacob Chalk, Saptarshi Sinha, Dima Damen +2Visual Object TrackingEgocentric Video Understanding

    University of Bristol, UK · NAVER LABS Europe, France

  42. Do Egocentric Video-Language Models Capture Both Hand- and Object-Centric Cues?

    Jul 9, 2026Masatoshi Tateno, Alexandros Stergiou, Risa Shinoda +2Human Activity RecognitionObject-Centric Representation Learning

    1The University of Tokyo · University of Twente · University of Bristol

  43. Ego-Human Motion Prediction with 3D-Aware LLM

    Jul 8, 2026Yujin Bae, Jaewoo Jeong, Hyeonseong Kim +1Egocentric Video UnderstandingHuman Motion Prediction

    Visual Intelligence Lab., KAIST, Korea

  44. CoMind: Understanding Collaborative Human Activity from Multiple Minds and Views

    Jul 7, 2026Alexey Gavryushin, Dingxi Zhang, Zhao Huang +8Human Activity RecognitionTheory of Mind

    1ETH Zurich, Switzerland · 2MPI for Informatics, Germany · 3Microsoft Switzerland +2

  45. EgoPolice: A Benchmark for Egocentric Video Understanding in High-Stakes Police Body-Worn Camera Footage

    Jul 7, 2026Max Gonzalez Saez-Diez, Jihoon Chung, Adam D. Wolsky +5Video QAEgocentric Video Understanding

    Princeton University · University of Pennsylvania

  46. EgoInertia-MI: A Multimodal Egocentric Vision and IMU Benchmark for Motor Impairment Assessment

    Jul 4, 2026Fatemah Alhamdoosh, Pietro Pala, Abduallah Mohamed +1Human Activity RecognitionWearable Sensing

    University of Florence, Italy · Meta Reality Labs, USA · University of Edinburgh, UK

  47. Responsibility Distribution Estimation in Ego-View Accident Videos with Multimodal Large Language Models

    Jul 3, 2026Ryosei Tamura, Andrew ShinMultimodal Large Language ModelsEgocentric Video Understanding

    Keio University

  48. R3D: Quantitative 3D Spatial Reasoning for Egocentric Wearables

    Jul 3, 2026Maxwell Horton, Wei Lu, Quan Tran +6Spatial Reasoning Benchmarks3D Spatial Reasoning

    Meta Reality Labs

  49. S-EMBER: A Large-Scale Benchmark for Streaming Egocentric Memory Retrieval

    Jul 2, 2026Xiaodong Wang, Xuanyi Zhao, Pedro Rodriguez +7Temporal Video GroundingEpisodic Memory

    1FAIR, Meta · 2Reality Labs, Meta

  50. Learning to Evolve Scenes: Reasoning about Human Activities with Scene Graphs

    Jul 2, 2026Francesca Pistilli, Simone Alberto Peirone, Giuseppe AvertaScene Graph GenerationEgocentric Video Understanding

    Politecnico di Torino · Torino, Italy

  51. LongEgoRefer: A Benchmark for Long-Form Egocentric Video Referring Expression Comprehension

    Jul 2, 2026Shunya Kato, Taiki Miyanishi, Shuhei Kurita +3Temporal Video GroundingVideo Understanding

    Woven by Toyota, Japan · The University of Tokyo, Japan · National Institute of Informatics, Japan +3

  52. EgoGapBench: Benchmarking Egocentric Action Selection in Multi-Agent Scenes

    Jul 1, 2026Jihyeok Jung, Jeewu Lee, Sanghyeop Kim +2Egocentric Video UnderstandingAI Agent Benchmarks

    KAIST AI · Sogang University · Ministry of Science and ICT

  53. EgoSafetyBench: A Diagnostic Egocentric Video Benchmark for Evaluating Embodied VLMs as Runtime Safety Guards

    Jun 30, 2026Siddhant Panpatil, Arth Singh, Mijin Koo +3VLM RobustnessEgocentric Video Understanding

    AIM Intelligence · Seoul National University

  54. SkillSpotter: Pose-Aware Multi-View Skilled Action Detection and Grading in Ego-Exo Videos

    Jun 30, 2026Björn Braun, Christian HolzEgocentric Video UnderstandingTemporal Action Detection

    Department of Computer Science, ETH Zürich, Switzerland

  55. Graph it first! Enabling Reasoning on Long-form Egocentric Videos through Scene Graphs

    Jun 24, 2026Agnese Taluzzi, Riccardo Santambrogio, Simone Mentasti +2Egocentric Video QAVideo QA

    Politecnico di Milano, Milan, Italy · Bocconi University, Milan, Italy

  56. EgoSAT: A Comprehensive Benchmark of Egocentric Streaming Interaction Understanding

    Jun 23, 2026Yijia Lei, Jinzhao Li, Yichi Zhang +3VLM EvaluationStreaming Video Understanding

    College of AI, Tsinghua University · University of Wisconsin–Madison

  57. P-JEPA: Procedural Video Representation Learning via Joint Embedding Predictive Architecture

    Jun 22, 2026Felix Tristram, Stefano Gasperini, Benjamin Killeen +4Temporal Action SegmentationVideo Understanding

    Technical University of Munich Munich Center for Machine Learning · Carl Zeiss AG · Carl Zeiss AG[cs.CV]

  58. The Unreasonable Effectiveness of VLMs for Zero-shot Procedural Mistake Detection

    Jun 19, 2026Serdar Ozsoy, Lars Doorenbos, Federico Spurio +2Temporal Action SegmentationVision-Language Models

    University of Bonn · Lamarr Institute for Machine Learning and Artificial Intelligence · Toyota Motor Europe

  59. UNIEGO: Proxies as Mediators for Unified Egocentric Video Representation Learning

    Jun 18, 2026Wenhao Chi, Arkaprava Sinha, Dominick Reilly +2Cross-Modal Knowledge DistillationMulti-View Learning

    University of North Carolina at Charlotte

  60. HumanScale: Egocentric Human Video Can Outperform Real-Robot Data for Embodied Pretraining

    Jun 18, 2026Juncheng Ma, Jianxin Bi, Yufan Deng +19Robot Foundation ModelsCross-Embodiment Robot Learning

    PKU · NUS · MIT +2