Egocentric Vision

Ask about this topic

Overview

Egocentric vision studies what a person sees and does through a wearable, first-person camera, including recognizing activities, tracking hands and body motion, locating objects, and predicting what happens next. Methods combine video models with temporal reasoning, 3D geometry, stereo or event cameras, and signals such as gaze, inertial measurements, and muscle activity; datasets and low-cost capture systems provide real-world training and evaluation. Recent work also uses generative models and world models to simulate interactions and transfer human demonstrations to robots. A central challenge is reliability under occlusion, rapid camera motion, poor lighting, and changing environments, while preserving physical and scene state over long tasks.

Latest papers

CardsList

42 papers6 papers in the last four weeks, against 2 the four weeks before. 0.0% of all new papers.

  1. EgoRayFormer: Ray-Space Stereo Refinement for Egocentric 3D Human Pose Estimation

    Oct 19, 2026Haozhe Wang, Songyuan Wu, Jihai Xu +13D Human Pose EstimationEgocentric Vision

    Boden AI

  2. EgoWholeView: Camera-Only Head-Mounted Capture of Body and Bimanual Hand Motion for Embodied Demonstrations

    Oct 12, 2026Yaoqing Hu, Xuguo He, Daohan Cui +2Markerless Motion Capture3D Human Pose Estimation

    Zhongguancun Academy · DeepCybo · Beijing University of Chemical Technology +1

  3. EVFormer: An Egocentric Vision-EMG Bidirectional Attention Model for Bimanual Hand Pose Estimation

    Oct 3, 2026JiaCheng Ge, SiYu Zhang, ShengJie Li +13D Hand Pose EstimationMultimodal Sensor Fusion

  4. NextMe-800: Anticipating Personal Behavior from Months of Egocentric Video

    Oct 1, 2026Zhaoxu Meng, Yiming Sun, Mingyuan Gao +5Next-Action PredictionEgocentric Video Understanding

    The University of Hong Kong · Tongji University

  5. Ego2Act: Evaluating Goal-Directed Manipulation in Egocentric Video Generation

    Oct 1, 2026Patrick Amadeus Irawan, Iskandar Muda Rizky Parlambang, Rava Maulana +10Physical Consistency in Video GenerationRobot Manipulation Benchmarks

    Mohamed bin Zayed University of Artificial Intelligence · Independent Researcher · Nanyang Technological University +1

  6. Exo2EgoHOI: Hand-Object-Interaction Aware Exocentric-to-Egocentric Video Generation

    Sep 29, 2026Hongjia Zhai, Xiyu Zhang, Haoran Zhang +5HOI GenerationExocentric-to-Egocentric Video Generation

    MBZUAI · Zhejiang University · InSpatio

  7. BinoGen: Scaling egocentric binocular data for embodied visual perception and learning

    Sep 17, 2026Chunpeng Li, Ya-tang LiSynthetic Data GenerationStereo Vision

    College of Biological Sciences, China Agricultural University, Beijing, China · Beijing Institute for Brain Research, Chinese Academy of Medical Sciences & Peking Union Medical College, Beijing, China · Chinese Institute for Brain Research, Beijing (CIBR), Beijing, China

  8. EventEgoHands++: Event-based Egocentric 3D Hand Mesh Reconstruction with Real Dataset

    Sep 15, 2026Ryosei Hara, Wataru Ikeda, Masashi Hatano +1Event-Based Vision3D Hand Pose Estimation

    Graduate School of Science and Technology, Keio University, Yokohama, Kanagawa 223-8522, Japan · JST Presto

  9. Results of the 1st Asynchronous CASTLE Challenge at the Joint Egocentric Vision Workshop in Conjunction with CVPR 2026

    Aug 24, 2026Luca Rossetto, Werner Bailer, Cathal Gurrin +5Egocentric Video UnderstandingEgocentric Vision

    Dublin City University Dublin, Ireland · JOANNEUM RESEARCH Graz, Austria · IT University of Copenhagen Copenhagen, Denmark +2

  10. Towards Context-Aware Clinical Motion Understanding in Daily Living at Home: Freezing of Gait Detection with Egocentric Vision

    Aug 13, 2026Vayalet Stefanova, Diwas Lamsal, Margot Genbrugge +5Gait AnalysisParkinson's Disease

    Department of Electrical Engineering (ESAT), KU Leuven, Leuven, Belgium · Neurorehabilitation Research Group (eNRGy), Department of Rehabilitation Sciences, KU Leuven, Leuven, Belgium · Institute of Interdisciplinary Exercise Science and Sports Medicine, Medical School Hamburg, Hamburg, Germany +2

  11. EgoPHI: Estimating 3D Hand-Object Contact and Force from Egocentric Vision

    Aug 13, 2026Andela Ilic, Rachel Schuchert, Yijing Jiang +1Hand-Object Interaction DetectionEgocentric Vision

    Department of Computer Science, ETH Zürich, Zürich, Switzerland

  12. EgoHieraLoc: A Cortically Inspired Hierarchical Segmentation-Guided Framework for Egocentric Visual Query Localization

    Aug 10, 2026Yifei Cao, Guolong Wang, Mingliang Hou +3Egocentric Vision3D Visual Grounding

    Dalian University of Technology, Dalian, China · University of International Business and Economics, Beijing, China · Jinan University, Guangzhou, China

  13. Ego-OSCAR: Egocentric Open source Stereo CAptuRe System

    Aug 8, 2026Gunjan Paul, Senthil Palanisamy, Satpal Singh Rathore +3Egocentric Vision

    FPV Labs

  14. EgoGenesis: Egocentric World-Action Modeling with Online Anchored Projective Memory and Action-3D RoPE

    Jul 30, 2026Zexuan Yan, Yuzhou Wu, Yue Ma +9Action-Conditioned Video GenerationMemory-Augmented Video Generation

    1Shanghai Jiao Tong University · 2Alibaba Group · 3Tianji KernalMind Co., Ltd. +4

  15. TSR-Ego: Temporally Guided Stereo Refinement Framework for Egocentric 3D Human Pose Estimation

    Jul 10, 2026Md Mushfiqur Azam, John Quarles, Kevin Desai3D Human Pose EstimationEgocentric Vision

    The University of Texas at San Antonio

  16. EgoWAM: World Action Models Beyond Pixels with In-the-Wild Egocentric Human Data

    Jul 8, 2026Baoyu Li, Xinchen Yin, Mengying Lin +2World Models for RoboticsBimanual Robotic Manipulation

    Georgia Institute of Technology

  17. How Much Future Helps? A Controlled Study of Future-Privileged Supervision for Causal Egocentric Gaze Estimation

    Jul 1, 2026Jia Li, Wenjie Zhao, Fnu Atisri +5Gaze EstimationEgocentric Vision

    The University of Texas at Dallas · University of Washington · University of Wisconsin–Madison

  18. Toward Low-Latency Vision-Language Models with Doubly-Correct Predictions in Egocentric Visual Understanding

    Jun 23, 2026Qitong Wang, Fan Du, Pranav Maneriker +2Efficient VLM InferenceEgocentric Vision

    Dolby Laboratories, Inc., 1275 Market St, San Francisco, California, 94103, USA · Department of Computer and Information Sciences at the University of Delaware, Newark, DE 19711, USA · Dolby Laboratories, Inc.

  19. PROSE: Training-Free Egocentric Scene Registration with Vision-Language Models

    Jun 15, 2026Zhiang Chen, Nahyuk Lee, Boyang Sun +4Egocentric Vision3D Scene Understanding

    ETH Zurich · 1ETH Zurich · VGG, University of Oxford +1

  20. WristCompass: Kinematic Coupling as a Learnable Visual Concept for Ego-Camera Orientation

    May 29, 2026Varun Nair, Vidyut Baradwaj, Jiahang He +3Camera Pose EstimationEgocentric Video Understanding

  21. E3^3C: Video Generation with 3D Environmental Memory and Ego-Exo Human Pose Control

    May 25, 2026Qiao Gu, Lingni Ma, Adam W Harley +3Video Diffusion ModelsEgocentric Vision

    Meta Reality Labs, Redmond, WA 98052, USA · University of Toronto, Toronto, ON M5S 1A1, Canada

  22. TempRet: Temporal Enhancement and Two-Stage Reranking for CVPR 2026 EPIC-KITCHENS-100 Multi-Instance Retrieval Challenge

    May 23, 2026Zixu Li, Yupeng Hu, Zhiwei Chen +4Learning to RankCross-Modal Retrieval

    Shandong University · Harbin Institute of Technology (Shenzhen)

  23. Map-Mono-Ego: Map-Grounded Global Human Pose Estimation from Monocular Egocentric Video

    May 20, 2026Hiroyuki Deguchi, Ryosuke Hori, Kotaro Amaya +33D Human Pose EstimationHuman Pose Estimation

    1Keio University · 2National Institute of Advanced Industrial Science and Technology

  24. EgoTraj: Real-World Egocentric Human Trajectory Dataset for Multimodal Prediction

    May 18, 2026Ahmad Yehia, Abduallah Mohamed, Tianyi Wang +4Trajectory InferenceEgocentric Vision

    Department of Civil, Architectural, and Environmental Engineering, The University of Texas at Austin, Austin, TX 78712, USA · Meta Reality Labs · Department of Civil, Architectural,and Environmental Engineering, The University of Texas at Austin, Austin, TX 78712, USA +1

  25. EgoKit: Towards Unified Low-Cost Egocentric Data Collection with Heterogeneous Devices

    May 16, 2026Liuchuan Yu, Erdem Murat, Beichen Wang +10Robotic Data CollectionEgocentric Vision

    George Mason University, Computer Science, Fairfax, Virginia 22030, USA.

  26. Behavior Cloning for Active Perception with Low-Resolution Egocentric Vision

    May 13, 2026Anthony Bilic, Chen Chen, Ladislau BölöniActive Vision for Robot ManipulationActive Sensing

    Department of Computer Science, University of Central Florida, Orlando, FL, USA

  27. EgoForce: Robust Online Egocentric Motion Reconstruction via Diffusion Forcing

    May 13, 2026Inwoo Hwang, Donggeun Lim, Hojun Jang +1Markerless Motion CaptureEgocentric Video Understanding

    Seoul National University

  28. EgoEV-HandPose: Egocentric 3D Hand Pose Estimation and Gesture Recognition with Stereo Event Cameras

    May 12, 2026Luming Wang, Hao Shi, Jiajun Zhai +2Event-Based Vision3D Hand Pose Estimation

    National Research Center for Optical Instrumentation, Zhejiang University, Hangzhou 310027, China · Ant Group Company Ltd., Hangzhou 310013, China · School of Artificial Intelligence and Robotics and the National Engineering Research Center of Robot Visual Perception and Control Technology, Hunan University, Changsha 410082, China +1

  29. VISTA: A Generative Egocentric Video Framework for Daily Assistance

    May 11, 2026Yu-Hsiang Liu, Yu-Chien Tang, An-Zi YenSynthetic Data GenerationAI Agent Benchmarks

    Department of Computer Science, National Yang Ming Chiao Tung University, Taiwan

  30. MobileEgo Anywhere: Open Infrastructure for long horizon egocentric data on commodity hardware

    May 7, 2026Senthil Palanisamy, Abhishek Anand, Satpal Singh Rathore +3Egocentric VisionVLMs for Robotics

    FPV Labs