Diffusion Models for Motion Generation

Overview

This field studies how to generate, edit, and forecast movement, from human gestures and dance to robot actions, crowds, and interactions with objects or scenes. Common approaches use conditional denoising in motion or latent spaces, with transformers, variational autoencoders, autoregressive or streaming generation, and flow matching; conditions can include language, music, poses, paths, images, and physical constraints. These methods can turn flexible instructions into motion for animation, simulation, and embodied control, and are commonly evaluated on benchmarks such as HumanML3D, KIT-ML, and AIST++. A central challenge is balancing text or task control, natural and physically executable motion, long-horizon coherence, and fast inference, while ensuring benchmarks reflect real-world performance.

Latest papers

CardsList

105 papers7 papers in the last four weeks, down 67% on the four weeks before. 0.1% of all new papers.

  1. EgoHMP: Achieving Precise Human Motion Prediction in 3D Scenes via Egocentric Cues

    Nov 10, 2026Xin Zhao, Pengzhan Zhou, Ziyi Li +3Human Motion PredictionHuman Motion Generation

  2. Improving the Diffusability of Motion Tokenizer

    Nov 6, 2026Guanhe Huang, Songqiao Han, Tangzheng Lian +1Text-to-Motion GenerationDiffusion Models for Motion Generation

  3. GenStrain: Multi-Conditional Generative Diffusion Model To Synthesize High-quality Motion and Strain Maps From Cardiac Magnetic Resonance Images

    Nov 5, 2026Rishov Paul, Sona Ghadimi, Cristiane C. Singulane +3Medical Image SynthesisCardiac MRI

  4. Rel2Traj: Inter-Source Relation-Aware Trajectory Generation for Text-To-Spatial-Audio

    Oct 31, 2026Yihang Bao, Lingfeng Yao, Shengyao Wang +3Spatial AudioTrajectory Generation

  5. OneSteer: Unlocking Steerable General Humanoid Motion Tracking via One-Step Diffusion Whole-Body Control

    Oct 30, 2026Yifei Huang, Yazhao Yang, Li Weijia +10Humanoid Motion TrackingWhole-Body Control

  6. StepControl: Long-Horizon Human Motion Generation from Foot-Contact Schedules

    Oct 28, 2026Hojun Jang, Jinseok Bae, Donggeun Lim +5Autoregressive Motion GenerationHuman Motion Generation

  7. ViT-H: Generative Video-To-Humanoid Control with Motion Tracking Feedback

    Oct 23, 2026Zimo He, Tianyi Bian, Zizhong Yang +7Robot Learning from VideoHuman-to-Robot Motion Imitation

  8. MOMO: Human Motion from Moving Sounds

    Oct 17, 2026Deli Cai, Shuyang Xu, Zhiyang Dou +4Human Motion GenerationSpatial Audio

  9. BLANC: Adaptive Temporal Scheduling for Sign Language Production

    Oct 16, 2026Youngmin Kim, Seoyeong Hwang, Sujung Hong +1Sign Language GenerationDiffusion Models for Motion Generation

  10. TRACE: Typed Reference-Aware Conversational Editing for Humanoid Motion Diffusion

    Oct 15, 2026Zejian Kang, Yifu Luo, Boyang Shen +9Robot Motion GenerationDiffusion Models for Motion Generation

  11. Walk Like This: Stylized Locomotion for Physics-Based Characters through Example-Driven Diffusion

    Oct 13, 2026Joshua Aurand, Agon Serifi, Sammy Christen +4Style-Conditioned Motion GenerationRobot Locomotion

  12. DiTSG: Context-Aware Air Traffic Scene Generation with Multi-Agent Diffusion Transformers

    Oct 12, 2026Seokbin Yoon, Kyungmin Kim, Taejung Kwon +2Air Traffic ManagementDiffusion Models for Motion Generation

  13. ProMoDD: Dataset Distillation for 3D Human Motion via Prototype-Conditioned Diffusion Models

    Oct 12, 2026Yijin Wei, Yawen Zou, Wenqi Cai +5Dataset DistillationSkeleton-Based Action Recognition

  14. Image Diffusion Models Are Good 3D Human Motion Generators

    Oct 9, 2026Siyuan Yang, Chong Wang, Hao Cheng +4Text-to-Motion GenerationDiffusion Models for Motion Generation

  15. PartiGen: Part-Aware Representations for Language-Conditioned Humanoid Motion Generation

    Oct 9, 2026Chuxuan Huang, Zhanxiang Cao, Tianyue Zhan +14Text-to-Motion GenerationHuman Motion Generation

  16. From Digital Human Interactions to Physics-Based Humanoid Skills: Physics-Grounded Post-Training of Interaction Generators

    Oct 7, 2026Kerui Chen, Jianrong Zhang, Kai Lv +1Physics-Informed Generative ModelingDiffusion Models for Motion Generation

  17. Parasitic Co-Denoising: Unlocking 3D Human Motion Generation in a Frozen Video Diffusion Model

    Oct 2, 2026Yunjiao Zhou, Junlang Qian, Lihua Xie +1Human Motion GenerationText-to-Motion Generation

  18. Rethinking Fixed Temporal Grids: Frequency-Disentangled Motion Generation

    Oct 2, 2026Yunjiao Zhou, Junlang Qian, Gen Li +3Human Motion GenerationMotion Representation Learning

  19. TACD: Distilling Efficient Text-to-Motion Models via Terminal Amplification Control

    Oct 2, 2026Wei-Jin Huang, Yuan-Ming Li, Kun-Yu Lin +8Diffusion Model DistillationDiffusion Models for Motion Generation

  20. Proprioceptive Sketches as Long-Horizon Intent for Generative Action Policies

    Oct 2, 2026Fangyuan Wang, Songhao Huang, Haoxiang Sun +5Robot Policy LearningLong-Horizon Robotic Manipulation

  21. World2Motion: Turning Video World Models into 3D Human Motion Generators

    Sep 29, 2026Fangyuan Tu, Xiangyue Zhang, Yiyi Cai +8Human Motion GenerationDiffusion Models for Motion Generation

  22. BiMoGen: Bidirectional Motion-Text Generation via Unified Masked Discrete Diffusion

    Sep 28, 2026Wanjiang Weng, Yongliang Wu, Xiaofeng Tan +3Masked Diffusion ModelsText-to-Motion Generation

  23. Triangular Resampling for Long-Horizon Motion Generation

    Sep 28, 2026Kunhang Li, Yiyi Cai, Xiangyue Zhang +5Motion Diffusion ModelsHuman Motion Generation

  24. FloodDiffusion 2: Efficient and Path Controllable Streaming Motion Generation

    Sep 27, 2026Yiyi Cai, Yuhan Wu, Kunhang Li +6Motion Diffusion ModelsHuman Motion Generation

  25. Motion Style Slider: Endpoint-Supervised Continuous Style Control for Human Motion Diffusion

    Sep 25, 2026Chen-Chieh Liao, Yichen Peng, Yiyi Cai +5Human Motion GenerationDiffusion Models for Motion Generation

  26. VISTA: Video-Injected Stylized Text-to-Animation

    Sep 20, 2026Monseej Purkayastha, Anindita Ghosh, Philipp SlusallekText-to-Motion GenerationHuman Motion Generation