Pose-Conditioned Video Generation

Overview

Pose-conditioned video generation studies how to turn motion instructions into videos of people while keeping their appearance and movement coherent. Systems commonly use 2D skeletons, 3D body models, keypoints, or masks to guide diffusion models, often alongside a reference image and temporal adapters; some also control camera motion or multiple characters. The methods are evaluated in settings such as human animation, dance, sign language, and avatars, with attention to pose accuracy, identity preservation, and frame-to-frame consistency. A central challenge is balancing precise motion and interaction control with realistic appearance, stable long-term generation, and reliable separation of body motion from camera movement.

Latest papers

CardsList

27 papers2 papers in the last four weeks, against 2 the four weeks before. 0.0% of all new papers.

  1. BodyBridge: Grounded Body Layers for Sim-to-Real Translation of Vulnerable Road Users

    Oct 17, 2026Mark Azer, Fabian B. FlohrSim-to-Real TransferVideo Diffusion Models

  2. MegaAvatar: Controllable Talking Avatar Generation

    Sep 30, 2026Junyao Gao, Sibo Liu, Weidong Zhang +2Talking Head Generation3D Avatar Generation

  3. SignRefine: Adapting Foundational Video Models for Sign Language Generation

    Sep 8, 2026Anton Pelykh, Edward Fish, Ozge Mercanoglu Sincan +1Video Diffusion ModelsPose-Conditioned Video Generation

  4. FlowDance: Music-Driven Dance Video Generation with Parallel Pose and RGB Streams

    Aug 16, 2026Genying Li, Boda Lin, Jiachen Li +5Audio-Video GenerationHuman Motion Generation

  5. LiveAnimate: Stable Long-Form Streaming Human Animation in Real-Time

    Aug 12, 2026Yuxuan Zhang, Haozhong Xiong, Yubo Huang +6Diffusion TransformerReal-Time Interactive Video Generation

  6. UniMoCa: Unifying Motion and Camera Controls as Visual Proxies for Faithful Human Video Generation

    Aug 3, 2026Liming Tan, Ye Chen, Hao Zhang +3Camera-Controlled Video GenerationPose-Conditioned Video Generation

  7. ViDS: Video Diffusion Shader using 3D Face Tracking

    Jul 27, 2026Wenbo Ji, Davide Davoli, Zhe Chen +3Identity-Preserving Video GenerationVideo Generation

  8. MultiAnimate: A Unified Framework for Controllable Multi-Character Animation

    Jul 15, 2026Zhongyi Zhang, Guangyuan Wang, Li Hu +6Identity-Preserving Video GenerationHuman Motion Generation

  9. EMOSH: Expressive Motion and Shape Disentanglement for Human Animation

    Jun 26, 2026Dongbin Zhang, Hao Liu, Binquan Dai +5Disentangled Representation LearningHuman Motion Generation

  10. Directing the World: Fast Autoregressive Video Generation with Compositional Human-Camera Control

    Jun 26, 2026Haoyuan Wang, Yabo Chen, Haibin Huang +2Camera-Controlled Video GenerationLong-Horizon Video Generation

  11. InteractiveAvatar: Real-Time Streaming Video Generation for Consistent and Intent-Aware Avatars

    Jun 22, 2026Quanyue Song, Yishan He, Yanfei Zhang +6Real-Time Interactive Video GenerationMemory-Augmented Video Generation

  12. Go-with-the-Track: Video Compositing and Motion Control with Point Tracking

    Jun 18, 2026Koichi Namekata, Yash Kant, Zhizheng Liu +9Point TrackingCamera-Controlled Video Generation

  13. SCAIL-2: Unifying Controlled Character Animation with End-to-end In-Context Conditioning

    Jun 9, 2026Wenhao Yan, Fengjia Guo, Zhuoyi Yang +1Pose-Conditioned Video GenerationControllable Video Generation

  14. Streaming Video Generation with Streaming Force Control

    Jun 5, 2026Hanhui Wang, Yiming Xie, Haiwen Feng +3Streaming Video GenerationAutoregressive Video Generation

  15. E3^3C: Video Generation with 3D Environmental Memory and Ego-Exo Human Pose Control

    May 25, 2026Qiao Gu, Lingni Ma, Adam W Harley +3Video Diffusion ModelsEgocentric Vision

  16. CoMoGen: COntrollable MOtion Dynamics and Interactions with Mask-Guided Video GENeration

    May 21, 2026Adil Meric, Lin Geng Foo, Mert Kiray +3HOI GenerationImage-to-Video Generation

  17. ActCam: Zero-Shot Joint Camera and 3D Motion Control for Video Generation

    May 7, 2026Omar El Khalifi, Thomas Rossi, Oscar Fossey +6Diffusion Model GuidanceCamera-Controlled Video Generation

  18. ReImagine: Rethinking Controllable High-Quality Human Video Generation via Image-First Synthesis

    Apr 21, 2026Zhengwentai Sun, Keru Zheng, Chenghong Li +7Camera-Controlled Video GenerationVideo Generation

  19. PAM: A Pose-Appearance-Motion Engine for Sim-to-Real HOI Video Generation

    Mar 23, 2026Mingju Gao, Kaisen Yang, Huan-ang Gao +13HOI GenerationControllable Video Generation

  20. AnyCrowd: Instance-Isolated Identity-Pose Binding for Arbitrary Multi-Character Animation

    Mar 16, 2026Zhenyu Xie, Ji Xia, Michael Kampffmeyer +9Identity-Preserving Video GenerationHuman Motion Generation

  21. Controllable Complex Human Motion Video Generation via Text-to-Skeleton Cascades

    Mar 9, 2026Ashkan Taghipour, Morteza Ghahremani, Zinuo Li +3Controllable Video GenerationPose-Conditioned Video Generation

  22. MultiAnimate: Pose-Guided Image Animation Made Extensible

    Feb 25, 2026Yingcheng Hu, Haowen Gong, Chuanguang Yang +3Pose-Conditioned Video GenerationHuman Avatar Animation

  23. Human Video Generation from a Single Image with 3D Pose and View Control

    Feb 24, 2026Tiantian Wang, Chun-Han Yao, Tao Hu +3Image-to-Video GenerationVideo Generation