cs.CVNov 22, 2025

EgoControl: Controllable Egocentric Video Generation via 3D Full-Body Poses

Authors: Enrico Pallotta, Sina Mokhtarzadeh Azar, Lars Doorenbos, Serdar Ozsoy, Umar Iqbal, Juergen Gall

Organizations: University of Bonn · Lamarr Institute for Machine Learning and Artificial Intelligence · NVIDIA

Abstract

Egocentric video generation with fine-grained control through body motion is a key requirement towards embodied AI agents that can simulate, predict, and plan actions. In this work, we propose EgoControl, a pose-controllable video diffusion model trained on egocentric data. We train a video prediction model to condition future frame generation on explicit 3D body pose sequences. To achieve precise motion control, we introduce a novel pose representation that captures both global camera dynamics and articulated body movements, and integrate it through a dedicated control mechanism within the diffusion process. Given a short sequence of observed frames and a sequence of target poses, EgoControl generates temporally coherent and visually realistic future frames that align with the provided pose control. Experimental results demonstrate that EgoControl produces high-quality, pose-consistent egocentric videos, paving the way toward controllable embodied video simulation and understanding.

Figures & tables

Explore similar work

CardsList
  1. E3^3C: Video Generation with 3D Environmental Memory and Ego-Exo Human Pose Control

    May 25, 2026Qiao Gu, Lingni Ma, Adam W Harley +3Video Diffusion ModelsEgocentric Vision

  2. EgoGenesis: Egocentric World-Action Modeling with Online Anchored Projective Memory and Action-3D RoPE

    Jul 30, 2026Zexuan Yan, Yuzhou Wu, Yue Ma +9Action-Conditioned Video GenerationMemory-Augmented Video Generation