cs.CVNov 10, 2026

EgoHMP: Achieving Precise Human Motion Prediction in 3D Scenes via Egocentric Cues

Authors: Xin Zhao, Pengzhan Zhou, Ziyi Li, Riheng Jia, Zhida Qin, Yu Liu

Organizations: College Of Computer Science, Chongqing University · School of Computer Science and Technology, Zhejiang Normal University · School of Computer Science and Technology, Beijing Institute of Technology · Department of Computing, Hong Kong Polytechnic University

Abstract

The complex interactive dependencies between human behavior and 3D scenes make accurately predicting human intent a major challenge for human motion prediction (HMP). While recent studies use human gaze to infer intent, gaze signals suffer from ambiguity, drift, and a reliance on eye-tracking hardware. Research in cognitive science indicates that egocentric views inherently encode potential interactions, while head motion serves as a crucial precursor in motion planning. Motivated by this, we propose EgoHMP, a novel framework that uses egocentric views and head motions as robust carriers of interaction intent. By translating this intent into an envisioning of future interactions, EgoHMP achieves precise HMP in 3D scenes. EgoHMP first employs a vision-motion alignment encoder to align the visual and motion feature spaces. Based on these aligned features, an egocentric intent predictor with a modality-aware modulation mechanism adaptively suppresses invalid interaction cues to predict an accurate interaction probability map. Furthermore, to enhance the stability and realism of the generated motions, we propose a contact-aware motion decoder. Specifically, inspired by the human cognitive process of planning trajectories prior to action execution, we first predict a global trajectory to serve as a self-prompt, effectively mitigating the optimization conflict in diffusion models. Subsequently, we introduce a multi-stage denoiser, which relieves motion artifacts by incorporating human contact modeling through a multi-stage optimization strategy. Finally, a GCN-based motion decoder is employed to synthesize physically plausible and semantically consistent motions. Extensive experiments demonstrate that EgoHMP achieves state-of-the-art performance.

Figures & tables

Appendix figures & tables6 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Ego-Human Motion Prediction with 3D-Aware LLM

    Jul 8, 2026Yujin Bae, Jaewoo Jeong, Hyeonseong Kim +1Egocentric Video UnderstandingHuman Motion Prediction

  2. HAP: A Hand-Driven Active Perception Framework for Egocentric Head Motion Prediction

    Sep 16, 2026Yunji Feng, Junyi Ma, Guanzhong Sun +2Egocentric Video UnderstandingHuman Motion Prediction