Text-to-Motion Generation

Ask about this topic

Overview

Text-to-motion generation studies how to turn language such as action descriptions into animated, articulated movement, with uses in animation, robotics, and interactive characters. Common approaches use diffusion or flow matching, autoregressive or masked motion-token models, and continuous or discrete motion representations; many add part-aware structure, hierarchical planning, or text-motion alignment. On benchmarks such as HumanML3D and KIT-ML, models have improved in prompt alignment and motion quality, while newer work extends generation to editing, streaming, styles, and human-object interactions. A central challenge is balancing faithful, compositional responses to text with realistic, physically plausible motion over long sequences, especially when data and evaluation metrics are limited.

Latest papers

CardsList

97 papers7 papers in the last four weeks, down 53% on the four weeks before. 0.0% of all new papers.

  1. Möbius: A Unified Motion-Language Model Bridging Understanding and Generation

    Nov 3, 2026Jiazhi Shu, Chengfeng Zhao, Jinyi Wang +7Human Motion GenerationText-to-Motion Generation

    The Hong Kong University of Science and Technology · Tencent Games Motus · Massachusetts Institute of Technology

  2. TopX: Text-to-Motion for Unseen Skeletons from the Skeleton File Alone

    Oct 25, 2026Tengjiao Sun, Pengcheng Fang, Xiaoyu Zhan +3Text-to-Motion GenerationHuman Motion Generation

    University of Southampton · MOGO AI · Nanjing University

  3. AgentDreamer: Agentic 3D Motion Reasoning for Text-Controllable Physics Simulation

    Oct 22, 2026Mijeong Kim, Suho Park, Junha Park +1Text-to-Motion GenerationPhysics-Based Simulation

  4. Learn to Modify: Self-evolving Multi-agent Refinement Framework for Conversational Text-to-Motion Generation

    Oct 20, 2026Jianan Li, Jiawei Zhao, Yangtao Zhou +6Text-to-Motion GenerationHuman Motion Generation

    School of Computer Science and Technology, Xidian University, Xi’an, China · School of Artificial Intelligence, Xidian University, Xi’an, China · School of Computer Science and Technology, Tongji University, Shanghai, China

  5. Image Diffusion Models Are Good 3D Human Motion Generators

    Oct 9, 2026Siyuan Yang, Chong Wang, Hao Cheng +4Text-to-Motion GenerationDiffusion Models for Motion Generation

    Division of Robotics, Perception and Learning, KTH Royal Institute of Technology, Sweden · School of Electrical and Electronic Engineering, Nanyang Technological University, Singapore · School of Artificial Intelligence, Hebei University of Technology, China +3

  6. ELMA: Benchmarking Anaphoric Compositions for Long-Term Text-to-Motion Generation

    Oct 9, 2026Shun Kato, Dixin Yang, Kotaro Amaya +5Human Motion GenerationText-to-Motion Generation

    Keio University · Keio AI Center · Sony Group Corporation

  7. PartiGen: Part-Aware Representations for Language-Conditioned Humanoid Motion Generation

    Oct 9, 2026Chuxuan Huang, Zhanxiang Cao, Tianyue Zhan +14Text-to-Motion GenerationHuman Motion Generation

    Fudan University · Shanghai Innovation Institute · Shanghai Jiaotong University +5

  8. Controllable Exaggeration for Generative Motion Models via Training-Time Adaptation and Inference-Time Guidance

    Oct 8, 2026Amirhossein Zamani, Arianna Rampini, Bruno RoyHuman Motion GenerationText-to-Motion Generation

    Autodesk Research · Mila – Quebec AI Institute · Concordia University

  9. Parasitic Co-Denoising: Unlocking 3D Human Motion Generation in a Frozen Video Diffusion Model

    Oct 2, 2026Yunjiao Zhou, Junlang Qian, Lihua Xie +1Human Motion GenerationText-to-Motion Generation

    Nanyang Technological University, Singapore

  10. ECHO-G: Embodied Co-speech Humanoid mOtion Generation

    Sep 30, 2026Yizhao Li, Pusen Gao, Ming Wang +3Text-to-Motion GenerationHuman Motion Generation

    Beihang University · Mondo Robotics · The Hong Kong University of Science and Technology +1

  11. PAMI: Part Anchored Motion for Text to Human-Object Interaction Generation

    Sep 29, 2026Chuqiao Li, Xianghui Xie, Yong Cao +2HOI GenerationText-to-Motion Generation

    Tübingen AI Center, University of Tübingen, Germany · Max Planck Institute for Informatics, Saarland Informatics Campus, Germany

  12. BiMoGen: Bidirectional Motion-Text Generation via Unified Masked Discrete Diffusion

    Sep 28, 2026Wanjiang Weng, Yongliang Wu, Xiaofeng Tan +3Masked Diffusion ModelsText-to-Motion Generation

    Department of Computer Science and Engineering, Southeast University, Nanjing, China · Key Laboratory of New Generation Artificial Intelligence Technology and Its Interdisciplinary Applications (Southeast University), Ministry of Education, Nanjing, China · National University of Singapore +1

  13. MotionSpaceFlow: Representation-Aware Flow Matching in Direct Motion Space

    Sep 28, 2026Qing Yu, Kent FujiwaraFlow MatchingText-to-Motion Generation

    LY Corporation, Tokyo, Japan

  14. MotionMaestro: Masked Tokenization for Unified Motion Generation

    Sep 26, 2026Yun Chen, Munchurl Kim, Jeonghyeok DoHuman Motion GenerationConditional Generative Modeling

    Korea Advanced Institute of Science and Technology (KAIST)

  15. Timo: Taming Multimodal Diffusion Transformers for Human Motion Generation

    Sep 25, 2026Zhao Wang, Jiangtao Hu, Jack Yu +1Text-to-Motion GenerationHuman Motion Generation

    LimX Dynamics

  16. VISTA: Video-Injected Stylized Text-to-Animation

    Sep 20, 2026Monseej Purkayastha, Anindita Ghosh, Philipp SlusallekText-to-Motion GenerationHuman Motion Generation

    Saarland Informatics Campus & German Research Centre for Artificial Intelligence (DFKI), Saarbrücken, Germany · Max Planck Institute for Informatics (MPII), Saarbrücken, Germany

  17. MoSAT: Human Motion Generation from Spatial Audio and Textual Description

    Sep 20, 2026Shuyang Xu, Zhiyang Dou, Yiduo Hao +8Text-to-Motion GenerationHuman Motion Generation

    The University of Hong Kong · Massachusetts Institute of Technology · University of Pennsylvania +5

  18. MixiMotion: One-Step Text-to-Motion Generation via Asymmetric Set Distillation

    Sep 19, 2026Hung Dinh, Binh Mai, Tran Quoc Bao Le +2Text-to-Motion GenerationHuman Motion Generation

    Posts and Telecommunications Institute of Technology, Hanoi, Vietnam

  19. MoVT: Video-Augmented Motion Tokenizer for Text-to-Motion Generation

    Sep 14, 2026Beibei Jing, Tianle Guo, Youjia Zhang +5Text-to-Motion GenerationHuman Motion Generation

    Huazhong University of Science and Technology School of Computer Science and Technology Wuhan, Hubei, China · Zhejiang University School of Software Technology Ningbo, China

  20. Open-UniMo: Towards Unified Motion-Language Understanding and Generation in the Open World

    Sep 13, 2026Guocun Wang, Kenkun Liu, Guorui Song +7Text-to-Motion Generation

    Tsinghua University, Beijing 100190, China · SSE, The Chinese University of Hong Kong, Shenzhen 518172, China · MMLab, Nanyang Technological University, Singapore 639798

  21. UniMo: Unifying Human and Animal Motion Generation

    Sep 11, 2026Zeyu Zhang, Zhiyuan Zhang, Siheng Wang +4Text-to-Motion GenerationHuman Motion Generation

    Westlake University, China · The Australian National University, Australia

  22. ReMoMask-2: Latent Retrieval-Augmented Masked Motion Generation

    Sep 8, 2026Yiran Wang, Zeyu Zhang, Ling Shao +1Text-to-Motion GenerationHuman Motion Generation

    University of Sydney, Camperdown 2006, Australia · School of Computer Science, Peking University, Beijing 100871, China · UCAS-Terminus AI Lab, University of Chinese Academy of Sciences, Beijing 101408, China

  23. Flexible Motion Generation from Language and Style References

    Sep 7, 2026Kai Weixian Lan, Bodie Criswell, Briana Fedkiw +3Text-to-Motion GenerationMotion Diffusion Models

    University of California, Davis, USA · University of Utah, USA · Epic Games, USA +1

  24. SeRV: Semantic-Aligned Residual Vector Quantization for American Sign Language Generation

    Sep 4, 2026Hongyu Wu, Xu Wu, Tianhao Wu +4Sign Language GenerationText-to-Motion Generation

    University of Oklahoma · University of Georgia · University of Massachusetts Amherst

  25. UniMate: One Unified Model to Animate Diverse Skeletons

    Sep 4, 2026Linzhan Mou, Jiahui Lei, Zhiyang Dou +4Text-to-Motion GenerationMotion Diffusion Models

    Princeton University, USA · University of California, Berkeley, USA · Massachusetts Institute of Technology, USA +1

  26. Kirin: Animal Motion Generation from In-the-Wild Video

    Sep 1, 2026Brian Nlong Zhao, Zhuoyang Pan, James M. Rehg +2Markerless Motion CaptureText-to-Motion Generation

    University of Illinois Urbana-Champaign · University of Pennsylvania · Stanford University +1

  27. SeMoCo: A Semantic-First Motion Codec for Motion Language Modeling

    Aug 25, 2026Tianlv Huang, Hetian Guo, Ziyi Cai +6Text-to-Motion GenerationHuman Motion Generation

    Jilin University · Frontier Robotics · Harbin Institute of Technology, Shenzhen

  28. Spatiotemporally Decoupled Autoregressive Diffusion Model for Human Motion Generation

    Aug 24, 2026Chengqun Yang, Liang Xu, Yanping Li +4Text-to-Motion GenerationHuman Motion Generation

    MoE Key Lab of Artificial Intelligence, AI Institute, Shanghai Jiao Tong University

  29. Progressively Learning Heterogeneous Skills in a Unified Latent Space

    Aug 24, 2026Yue-Yi Zhang, Ming Gong, Linpu He +2Human Motion GenerationText-to-Motion Generation

    Sun Yat-sen University, China

  30. UniMoFlow: Grounding Instruction-Driven 3D Human Motion Editing in Generation

    Aug 10, 2026Yilei Hua, Beibei Jing, Ce Zheng +3Flow MatchingText-to-Motion Generation

    School of Computer Science, Huazhong University of Science and Technology · School of Software Technology, Zhejiang University