Diffusion Models for Motion Generation

Overview

This field studies how to generate, edit, and forecast movement, from human gestures and dance to robot actions, crowds, and interactions with objects or scenes. Common approaches use conditional denoising in motion or latent spaces, with transformers, variational autoencoders, autoregressive or streaming generation, and flow matching; conditions can include language, music, poses, paths, images, and physical constraints. These methods can turn flexible instructions into motion for animation, simulation, and embodied control, and are commonly evaluated on benchmarks such as HumanML3D, KIT-ML, and AIST++. A central challenge is balancing text or task control, natural and physically executable motion, long-horizon coherence, and fast inference, while ensuring benchmarks reflect real-world performance.

Latest papers

CardsList

98 papers20 papers in the last four weeks, up 150% on the four weeks before. 0.1% of all new papers.

  1. GenTac: Generative Modeling and Forecasting of Soccer Tactics

    Apr 13, 2026Jiayuan Rao, Tianlin Gui, Haoning Wu +2Soccer AnalyticsMulti-Agent Trajectory Prediction

  2. BiTDiff: Fine-Grained 3D Conducting Motion Generation via BiMamba-Transformer Diffusion

    Apr 6, 2026Tianzhi Jia, Kaixing Yang, Xiaole Yang +4Human Motion GenerationDiffusion Models for Motion Generation

  3. InsTraj: Instructing Diffusion Models with Travel Intentions to Generate Real-world Trajectories

    Apr 5, 2026Yuanshao Zhu, Yuxuan Liang, Xiangyu Zhao +5Trajectory GenerationDiffusion Models for Motion Generation

  4. Forecasting Motion in the Wild

    Apr 1, 2026Neerja Thakkar, Shiry Ginosar, Jacob Walker +3Trajectory PredictionMotion Representation Learning

  5. Diffusion Path Alignment for Long-Range Motion Generation and Domain Transitions

    Mar 31, 2026Haichao Wang, Alexander Okupnik, Yuxing Han +3Human Motion GenerationDiffusion Models for Motion Generation

  6. HandX: Scaling Bimanual Motion and Interaction Generation

    Mar 30, 2026Zimu Zhang, Yucheng Zhang, Xiyan Xu +8Human Motion GenerationDiffusion Models for Motion Generation

  7. Unleashing Guidance Without Classifiers for Human-Object Interaction Animation

    Mar 26, 2026Ziyin Wang, Sirui Xu, Chuan Guo +5HOI GenerationDiffusion Guidance

  8. Temporally Decoupled Diffusion Planning for Autonomous Driving

    Mar 26, 2026Xiang Li, Bikun Wang, John Zhang +1Autonomous Driving PlanningDiffusion-Based Planning

  9. Bilingual Text-to-Motion Generation: A New Benchmark and Baselines

    Mar 26, 2026Wanjiang Weng, Xiaofeng Tan, Xiangbo Shu +3Text-to-Motion GenerationHuman Motion Generation

  10. FODMP: Fast One-Step Diffusion of Movement Primitives Generation for Time-Dependent Robot Actions

    Mar 25, 2026Xirui Shi, Arya Ebrahimi, Yi Hu +1Robot Motion GenerationDiffusion Models for Motion Generation

  11. Teacher-Student Diffusion Model for Text-Driven 3D Hand Motion Generation

    Mar 25, 2026Ching-Lam Cheng, Bin Zhu, Shengfeng HeText-to-Motion GenerationHuman Motion Generation

  12. ViHOI: Human-Object Interaction Synthesis with Visual Priors

    Mar 25, 2026Songjin Cai, Linjie Zhong, Ling Guo +1HOI GenerationHuman Motion Generation

  13. EnvSocial-Diff: A Diffusion-Based Crowd Simulation Model with Environmental Conditioning and Individual-Group Interaction

    Mar 25, 2026Bingxue Zhao, Qi Zhang, Hui HuangPedestrian Behavior ModelingDiffusion Models for Motion Generation

  14. ST-GDance++: A Scalable Spatial-Temporal Diffusion for Long-Duration Group Choreography

    Mar 20, 2026Jing Xu, Weiqiang Wang, Cunjian Chen +2Human Motion GenerationDiffusion Models for Motion Generation

  15. Bridging Semantic and Kinematic Conditions with Diffusion-based Discrete Motion Tokenizer

    Mar 19, 2026Chenyang Gu, Mingyuan Zhang, Haozhe Xie +3Human Motion GenerationDiffusion Models for Motion Generation

  16. RoboForge: Physically Optimized Text-guided Whole-Body Locomotion for Humanoids

    Mar 18, 2026Xichen Yuan, Zhe Li, Bofan Lyu +4Humanoid Robot LocomotionHuman Motion Generation

  17. SHIFT: Motion Alignment in Video Diffusion Models with Adversarial Hybrid Fine-Tuning

    Mar 18, 2026Xi Ye, Wenjia Yang, Yangyang Xu +4Diffusion Model AlignmentVideo Diffusion Models

  18. ECHO: Edge-Cloud Humanoid Orchestration for Language-to-Motion Control

    Mar 17, 2026Haozhe Jia, Jianfei Song, Yuan Zhang +5Language-Conditioned Robot ControlRobot Motion Generation

  19. ActionPlan: Future-Aware Streaming Motion Synthesis via Frame-Level Action Planning

    Mar 13, 2026Eric Nazarenus, Chuqiao Li, Yannan He +3Diffusion Models for Motion GenerationText-to-Motion Generation

  20. PhysMoDPO: Physically-Plausible Humanoid Motion with Preference Optimization

    Mar 13, 2026Yangsong Zhang, Anujith Muraleedharan, Rikhat Akizhanov +5Human Motion GenerationRobot Motion Generation

  21. KnowDiffuser: A Knowledge-Guided Diffusion Planner with LLM Reasoning

    Mar 11, 2026Fan Ding, Xuewen Luo, Fengze Yang +4Autonomous Driving PlanningDiffusion-Based Planning

  22. InfiniteDance: Scalable 3D Dance Generation Towards in-the-wild Generalization

    Mar 10, 2026Ronghui Li, Zhongyuan Hu, Li Siyao +6Human Motion GenerationDiffusion Models for Motion Generation

  23. Not Like Transformers: Drop the Beat Representation for Dance Generation with Mamba-Based Diffusion Model

    Mar 9, 2026Sangjune Park, Inhyeok Choi, Donghyeon Soon +2Human Motion GenerationDiffusion Models for Motion Generation

  24. AnchorDrive: LLM Scenario Rollout with Anchor-Guided Diffusion Regeneration for Safety-Critical Scenario Generation

    Mar 3, 2026Zhulin Jiang, Zetao Li, Cheng Wang +2Autonomous Driving Scenario GenerationAutonomous Driving Simulation

  25. Sketch2Colab: Sketch-Conditioned Multi-Human Animation via Controllable Flow Distillation

    Mar 2, 2026Divyanshu Daiya, Aniket BeraMarkov ChainsStyle-Conditioned Motion Generation