Co-Speech Gesture Generation

Ask about this topic

Momentum

6 papers in the last four weeks, against 2 the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 30

All topics
CardsList

  1. ECHO-G: Embodied Co-speech Humanoid mOtion Generation

    Sep 30, 2026Yizhao Li, Pusen Gao, Ming Wang +3Co-Speech Gesture GenerationHuman Motion Generation

    Beihang University · Mondo Robotics · The Hong Kong University of Science and Technology +1

  2. GestAdapt: Workspace-Conditioned Co-Speech Gesture Generation for Humanoid Robots

    Sep 29, 2026Bosong Ding, Xianglin Zhang, Miao Xin +2Co-Speech Gesture GenerationWorkspaces

    Department of Intelligent Systems, Tilburg University, The Netherlands. · TU-Dresden, Dresden, Germany. · School of Artificial Intelligence, China University of Mining and Technology-Beijing (CUMTB), Beijing, China.

  3. When Semantics Matter: Reliability-Aware Semantic-Rhythm Control for Co-Speech Gesture Generation

    Sep 29, 2026Zhirui Xing, Long Ye, Kaige Li +2Co-Speech Gesture GenerationAcoustic Latent Space

    Hainan International College, Communication University of China, Lingshui, China · School of Data Science and Intelligent Media, Communication University of China, Beijing, China · School of Cyber Science and Technology, Shenzhen Campus of Sun Yat-sen University, Shenzhen, China

  4. DualTrack: Synchronized speech-gesture generation via symmetric coupling of pretrained priors

    Sep 29, 2026Yuanzhuo Hu, Zehan Liu, Xiaoyi Qin +1Co-Speech Gesture GenerationSpeech-To-Text Alignment

    The Chinese University of Hong Kong, Shenzhen, China · X Square Robot

  5. EmoPose: Vision-Language Model Guided Emotion-Aware Gesture Generation for Humanoid Robots

    Sep 20, 2026Daojie Peng, Bingtao Wang, Fulong Ma +3Co-Speech Gesture Generation

    The Hong Kong University of Science and Technology (Guangzhou) · The Shandong University · RoboScience

  6. Towards Reliable Underwater Diver-Robot Interaction: Gesture Design, Interaction Logic, and Real-World Evaluation

    Sep 20, 2026Yingqi Liu, Kanzhong Yao, Zimeng Peng +4Underwater RobotsUnderwater

    University of Science and Technology of China, Hefei, China. · Institute of Artificial Intelligence (TeleAI), China Telecom, Shanghai 200232, China.

  7. Puppeteer: Object-Grounded Posture-Aware Co-Speech Gesture Generation

    Aug 31, 2026Vida Adeli, Soroush Mehraban, Jacob Rommann +3Co-Speech Gesture GenerationHuman Motion Generation

    Pickford AI · University of Toronto · Vector Institute

  8. The GENEA Challenge 2026: A Large-Scale Disentangled Evaluation of Speech-Driven Gesture Generation on the Seamless Interaction Dataset

    Aug 11, 2026Rajmund Nagy, Silvia Arellano García, Hendric Voss +4Co-Speech Gesture GenerationSpeech-To-Text Alignment

    KTH Royal Institute of Technology · Bielefeld University · Independent researcher +3

  9. StreamTalk: Streaming Co-Speech Gesture Generation with Key-Pose Anchoring

    Aug 3, 2026Xiangyue Zhang, Jianfang Li, Jiaxu Zhang +2Co-Speech Gesture GenerationAudio-Video Generation

    The University of Tokyo · Alibaba Group · Nanyang Technological University +1

  10. Speech2Grasp: Data-Efficient Transfer of Text-Conditioned Grasp Detection to Speech in Humanoid Robots

    Jul 29, 2026Hung Nguyen, Kim Nhat Minh Nguyen, Van Duc Vu +6Co-Speech Gesture GenerationRobotic Grasping

    University of California San Diego · VinMotion · Hanoi University of Science and Technology +2

  11. Gaze-to-text Generation: Beyond Categorical Decoding of Human Attention

    Jul 27, 2026Sounak Mondal, Dimitris Samaras, Gregory Zelinsky +1Co-Speech Gesture GenerationTranscript

    Stony Brook University, Stony Brook, New York, USA · Australian Institute for Machine Learning, Adelaide University, Australia

  12. SICAGE: Speaker-Independent Culture-Aware Gesture Generation using TED4C-L Dataset

    Jun 29, 2026Ariel Gjaci, Antonio Sgorbissa, Vittorio MurinoCo-Speech Gesture GenerationMultimodal Generation

    Italian Institute of Technology, Genoa, Italy · University of Genoa, Genoa, Italy

  13. Context-Aware Autoregressive Diffusion for Gloss-Wise Sign Language Production

    Jun 19, 2026JungHoon Sung, Boeun Kim, Chu Xin +4Sign Language TranslationCo-Speech Gesture Generation

    Dankook University · University of Birmingham

  14. Generating Natural and Expressive Robot Gestures through Iterative Reinforcement Learning with Human Feedback using LLMs

    Jun 17, 2026Chris Lee, Flora Salim, Benjamin Tag +1Co-Speech Gesture GenerationHumanoid Robotics

    School of Computer Science and Engineering, University of New South Wales, Sydney, Australia · Universidad Central de Chile, Santiago, Chile

  15. WaveSync: Constrained Wavefront Optimization for Synchronized Co-Speech Gestures in Humanoid Robots

    Jun 15, 2026Thang Tran Viet, Thanh Nguyen Canh, Gia Huy Uong +4Co-Speech Gesture GenerationImportance

    University of Engineering and Technology, Vietnam National University, 10000, Hanoi, Vietnam. · School of Information Science, Japan Advanced Institute of Science and Technology, Nomi, 923-1211, Ishikawa, Japan. · School of Electronics and Computer Science, University of Southampton, SO17 1BJ Southampton, United Kingdom. +1

  16. SiGnature: Explicit Motion Diffusion for Stylized Semantic Gesture

    Jun 14, 2026Adi Rosenthal, Tomer Koren, Nadav Shaked +2Co-Speech Gesture GenerationHuman Motion Generation

    Reichman University, Israel

  17. EmoZone-Talker: Regional Semantic Control of Audio-Driven 3DGS Talking Heads via Facial Action Units

    Jun 14, 2026Tingting Chen, Shaojun Wang, Huaye Zhang +2Facial Expression RecognitionCo-Speech Gesture Generation

    China University of Petroleum (East China)

  18. ReFree: Towards Realistic Co-Speech Video Generation via Reward-Free RL and Multilevel Speech Guidance

    Jun 11, 2026Salaheldin Mohamed, M. Hamza Mughal, Rishabh Dabral +1Precise Lip SynchronizationCo-Speech Gesture Generation

    Télécom Paris, Institut Polytechnique de Paris · Max Planck Institute for Informatics

  19. Recognizing Co-Speech Gestures in-the-Wild

    May 29, 2026Sindhu B Hegde, K R Prajwal, Andrew ZissermanCo-Speech Gesture Generation

    Visual Geometry Group, Dept. of Engineering Science, University of Oxford

  20. Semantic Motion Anchors: Bridging Motion and Meaning in Co-Speech Gestures

    May 28, 2026Varsha Suresh, Mohammad Mahdi Abootorabi, Mohamed Salman +5Co-Speech Gesture GenerationSemantic Anchor

    1Saarland University · University of British Columbia · 4Vector Institute +2

  21. DuoGesture: Motion-Grounded Semantic Conditioning and Biomechanical Beat Priors for Co-Speech Gesture Generation

    May 25, 2026Ferdinand Paar, Lanmiao Liu, Aslı Özyürek +2Co-Speech Gesture GenerationBiomechanics

    Radboud University, Nijmegen · Max Planck Institute for Psycholinguistics · Utrecht University

  22. PoseRefer: Pathway-Local Parameters for Semantically Grounded Reference Resolution

    May 23, 2026Anna DeichlerContextual Grounding3D Visual Grounding

    KTH Royal Institute of Technology, Stockholm, Sweden

  23. UMo: Unified Sparse Motion Modeling for Real-Time Co-Speech Avatars

    May 14, 2026Xiaoyu Zhan, Xinyu Fu, Chenghao Yang +9Co-Speech Gesture GenerationSpeech-To-Text Alignment

    Nanjing University · Mogo AI Ltd. · University of Southampton

  24. PersonaGest: Personalized Co-Speech Gesture Generation with Semantic-Guided Hierarchical Motion Representation

    May 8, 2026Junchuan Zhao, Qifan Liang, Ye WangCo-Speech Gesture GenerationHand Gesture Recognition

    School of Computing, National University of Singapore

  25. PersonaGesture: Single-Reference Co-Speech Gesture Personalization for Unseen Speakers

    May 7, 2026Xiangyue Zhang, Yiyi Cai, Kunhang Li +6Co-Speech Gesture GenerationText-To-Motion Generation

    The University of Tokyo · Shanda AI Research Tokyo · Renmin University +1

  26. MG-Former: A Transformer-Based Framework for Music-Driven 3D Conducting Gesture Generation

    May 2, 2026Ke Qiu, Yawen Qin, Tianzhi Jia +3Co-Speech Gesture GenerationTransformer Architectures

    Malou Tech Inc · South-Central Minzu University · Beijing Jiaotong University +2

  27. Learning Spatial-Temporal Coherent Correlations for Speech-Preserving Facial Expression Manipulation

    Apr 22, 2026Tianshui Chen, Jianman Lin, Zhijing Yang +3Facial Expression RecognitionCo-Speech Gesture Generation

    Guangdong University of Technology · South China University of Technology · Sun Yat-sen University

  28. Prompt-to-Gesture: Measuring the Capabilities of Image-to-Video Deictic Gesture Generation

    Apr 16, 2026Hassan Ali, Doreen Jirak, Luca Müller +1Co-Speech Gesture GenerationHand Gesture Recognition

    Knowledge Technology Group, Department of Informatics, University of Hamburg, Germany · Behavioral Lab, Department of Product Development, University of Antwerp, Belgium

  29. SemConFlow: Semantic Grounding of Holistic Co-Speech Gesture Generation with Contrastive Flow-Matching

    Mar 27, 2026Lanmiao Liu, Esam Ghaleb, Aslı Özyürek +1Co-Speech Gesture GenerationContrastive Flow Matching

    Max Planck Institute for Psycholinguistics · Donders Institute for Brain Cognition and Behaviour · Utrecht University

  30. SIGNER: Temporally Grounded Sign Language Generation via Time-Resolved Conditioning

    Jun 9, 2025Taeryung Lee, Hyeongjin Nam, Gyeongsik Moon +1Sign Language TranslationOnline Signature Verification

    IPAI · Dept. of ECE & ASRI, Seoul National University · Dept. of CSE, Korea University