Egocentric Video Understanding

Latest papers 140

All topics
CardsList
  1. EgoSafe: A First-Person Mobile-Captured Benchmark for Visual Safety Understanding

    Jul 29, 2026Yuyun Chen, Tianao Li, TianQuan Feng +4Egocentric Video UnderstandingVideo Reasoning

  2. EgoPlay: Event-Triggered Video Editing for Egocentric Streams

    Jul 27, 2026Jinjie Mai, Gordon Guocheng Qian, Willi Menapace +8Video Diffusion ModelsStreaming Video Generation

  3. Sidewalk Moments: Are Richer Representations Always More Human-Aligned? Evidence from City-Walk Videos

    Jul 23, 2026Liu Liu, Freya Huying Tan, Fábio DuarteEgocentric Video UnderstandingVideo Representation Learning

  4. ReViV: Reconstructing the Viewer and the View in 4D from Monocular Egocentric Video

    Jul 20, 2026Xiaozhong Lyu, Gen Li, Zhiyin Qian +3Gaze Estimation4D Reconstruction

  5. Understanding From Human Perspective: A Multi-agent System for Interactive Egocentric Medical Image Segmentation

    Jul 19, 2026Rongjun Ge, Dongyang Wang, Heng Zhu +3Interactive Medical Image SegmentationReferring Video Object Segmentation

  6. Exo2EgoPose: Leveraging Exocentric Demonstrations for Vision-Language guided Egocentric 3D Hand Pose Forecasting

    Jul 17, 2026Zhaofeng Shi, Heqian Qiu, Lanxiao Wang +23D Hand Pose EstimationCross-Embodiment Robot Learning

  7. EgoProceVQA: A Novel Egocentric Procedural Understanding Task with Self-Skill-Exploration Agent

    Jul 15, 2026Junlong Li, Junxi Li, Yuxiang Yang +3Egocentric Video QAVideo QA

  8. Vinci2: Providing Proactive Assistance in Continuous Egocentric Videos

    Jul 13, 2026Gong Sitong, Tianyu Yan, Caixin Kang +6Egocentric Video UnderstandingProactive Assistance

  9. AgenticFocus: Object-Preserving Mixed Reality Synthesis from Human FPV Video for Dexterous Humanoid Learning

    Jul 9, 2026Iaroslav Kolomiets, Miguel Altamirano Cabrera, Artem Lykov +6Humanoid Robot ControlCross-Embodiment Robot Learning

  10. Whareformer: Learning to Track What is Where in Long Egocentric Videos

    Jul 9, 2026Jacob Chalk, Saptarshi Sinha, Dima Damen +2Visual Object TrackingEgocentric Video Understanding

  11. Do Egocentric Video-Language Models Capture Both Hand- and Object-Centric Cues?

    Jul 9, 2026Masatoshi Tateno, Alexandros Stergiou, Risa Shinoda +2Human Activity RecognitionObject-Centric Representation Learning

  12. Ego-Human Motion Prediction with 3D-Aware LLM

    Jul 8, 2026Yujin Bae, Jaewoo Jeong, Hyeonseong Kim +1Egocentric Video UnderstandingHuman Motion Prediction

  13. CoMind: Understanding Collaborative Human Activity from Multiple Minds and Views

    Jul 7, 2026Alexey Gavryushin, Dingxi Zhang, Zhao Huang +8Human Activity RecognitionTheory of Mind

  14. EgoPolice: A Benchmark for Egocentric Video Understanding in High-Stakes Police Body-Worn Camera Footage

    Jul 7, 2026Max Gonzalez Saez-Diez, Jihoon Chung, Adam D. Wolsky +5Video QAEgocentric Video Understanding

  15. EgoInertia-MI: A Multimodal Egocentric Vision and IMU Benchmark for Motor Impairment Assessment

    Jul 4, 2026Fatemah Alhamdoosh, Pietro Pala, Abduallah Mohamed +1Human Activity RecognitionWearable Sensing

  16. S-EMBER: A Large-Scale Benchmark for Streaming Egocentric Memory Retrieval

    Jul 2, 2026Xiaodong Wang, Xuanyi Zhao, Pedro Rodriguez +7Temporal Video GroundingEpisodic Memory

  17. Learning to Evolve Scenes: Reasoning about Human Activities with Scene Graphs

    Jul 2, 2026Francesca Pistilli, Simone Alberto Peirone, Giuseppe AvertaScene Graph GenerationEgocentric Video Understanding

  18. LongEgoRefer: A Benchmark for Long-Form Egocentric Video Referring Expression Comprehension

    Jul 2, 2026Shunya Kato, Taiki Miyanishi, Shuhei Kurita +3Temporal Video GroundingVideo Understanding

  19. EgoGapBench: Benchmarking Egocentric Action Selection in Multi-Agent Scenes

    Jul 1, 2026Jihyeok Jung, Jeewu Lee, Sanghyeop Kim +2Egocentric Video UnderstandingAI Agent Benchmarks

  20. EgoSafetyBench: A Diagnostic Egocentric Video Benchmark for Evaluating Embodied VLMs as Runtime Safety Guards

    Jun 30, 2026Siddhant Panpatil, Arth Singh, Mijin Koo +3VLM RobustnessEgocentric Video Understanding

  21. SkillSpotter: Pose-Aware Multi-View Skilled Action Detection and Grading in Ego-Exo Videos

    Jun 30, 2026Björn Braun, Christian HolzEgocentric Video UnderstandingTemporal Action Detection

  22. Graph it first! Enabling Reasoning on Long-form Egocentric Videos through Scene Graphs

    Jun 24, 2026Agnese Taluzzi, Riccardo Santambrogio, Simone Mentasti +2Egocentric Video QAVideo QA

  23. EgoSAT: A Comprehensive Benchmark of Egocentric Streaming Interaction Understanding

    Jun 23, 2026Yijia Lei, Jinzhao Li, Yichi Zhang +3VLM EvaluationStreaming Video Understanding

  24. P-JEPA: Procedural Video Representation Learning via Joint Embedding Predictive Architecture

    Jun 22, 2026Felix Tristram, Stefano Gasperini, Benjamin Killeen +4Temporal Action SegmentationVideo Understanding

  25. The Unreasonable Effectiveness of VLMs for Zero-shot Procedural Mistake Detection

    Jun 19, 2026Serdar Ozsoy, Lars Doorenbos, Federico Spurio +2Temporal Action SegmentationVision-Language Models

  26. UNIEGO: Proxies as Mediators for Unified Egocentric Video Representation Learning

    Jun 18, 2026Wenhao Chi, Arkaprava Sinha, Dominick Reilly +2Cross-Modal Knowledge DistillationMulti-View Learning