Audio-Driven Facial Animation

Ask about this topic

Momentum

5 papers in the last four weeks, against 2 the four weeks before. 0.0% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 46

All topics
CardsList

  1. No Distillation Needed: Single-Pass Real-Time Talking Heads via Acausal Noise Shaping

    Oct 8, 2026Yu Han, Dejan Markovic, Alexander Richard +4Talking Head GenerationAudio-Driven Facial Animation

    Meta Reality Labs

  2. Talk Like You: Imitating How You Speak in Real-Time Talking Head Generation

    Oct 5, 2026Baiqin Wang, Zhixing Ding, Jijie Li +3Talking Head GenerationAudio-Driven Facial Animation

    MAIS, Institute of Automation, Chinese Academy of Sciences · School of Artificial Intelligence, University of Chinese Academy of Sciences · CAIR, HKISI, Chinese Academy of Sciences +1

  3. MegaAvatar: Controllable Talking Avatar Generation

    Sep 30, 2026Junyao Gao, Sibo Liu, Weidong Zhang +2Talking Head Generation3D Avatar Generation

    Tencent · Tongji University

  4. Beyond Lip Sync: Reference-Grounded Oral Refinement for Audio-Driven Portrait Animation

    Sep 29, 2026Bangxun TangAudio-Visual SynchronizationAudio-Driven Facial Animation

    University of California, Irvine

  5. EvolvingAvatar: Interactive 3D Head Generation That Adapts as Conversations Unfold

    Sep 28, 2026Junjie Chen, Fei Wang, Kun Li +5Talking Head Generation3D Avatar Generation

    Hefei University of Technology · EPIC Lab, Shanghai Jiao Tong University · Institute of Artificial Intelligence, Hefei Comprehensive National Science Center +4

  6. ComplexSync: High-Fidelity and Real-Time Lip Sync in Complex Scenarios

    Sep 24, 2026Jiaran Cai, Xingpei Ma, Shenneng HuangVideo Diffusion ModelsAudio-Visual Synchronization

    Guangzhou Quwan Network Technology

  7. KoUniTalk: A Lightweight Articulation-Centered Korean-English 3D Talking Face Benchmark

    Sep 17, 2026Hyunjung Chung, Unsang ParkHuman Avatar AnimationAudio-Driven Facial Animation

    Sogang University, Seoul, Republic of Korea

  8. Audio-Driven Adversarial Defense for 3D Talking Face Generation with totally Visual Fidelity Preservation

    Aug 31, 2026Rui-Qing Sun, Chen-Hao Cui, Hui-Yang Zhao +3Audio-Driven Facial AnimationAdversarial Examples

    Beijing Institute of Technology Haidian Qu, Beijing Shi, China

  9. Avatar-Forever: Decoupled Parallel Training for High-Quality Real-Time Infinite Avatars

    Aug 12, 2026Ruibin Li, Tao Yang, Zhiyuan Ma +3Audio-Video GenerationReal-Time Interactive Video Generation

    The Hong Kong Polytechnic University · ByteDance · AMD

  10. PD-GS: Phoneme-Driven 3DGS for Audio-Driven Talking Heads

    Aug 5, 2026Ao Fu, Yi Zhou3D Gaussian SplattingAudio-Visual Synchronization

    School of Computer Science and Engineering, Southeast University, Nanjing, China, Key Laboratory of New Generation Artificial Intelligence Technology and Its Interdisciplinary Applications and Ministry of Education, Nanjing, China

  11. SubtleTalk: Generating Controllable Weakly-correlated Facial Dynamics for 3D Talking Heads via Residual Flow Matching

    Aug 3, 2026Chenyang Ding, Shuai Tan, Qunfen Lin +3Audio-Driven Facial Animation

    Shanghai Jiao Tong University Shanghai, China · Tencent Games Shenzhen, China

  12. Proxy Avatar Meets Low-Rank Caching: Real-Time One-Shot Emotion-Controllable Portrait Animation

    Aug 3, 2026Haijie Yang, Jindi Bao, Yixuan Dong +6Video Diffusion ModelsIdentity-Preserving Video Generation

    Nanjing University of Science and Technology · Tsientang Institute for Advanced Study · Peking University +1

  13. Geometry-guided Emotion Modulation for Controllable and Photorealistic Emotional Talking Face Generation

    Aug 1, 2026Chenggong Hu, Shaoyin Ma, Yi Wang +3Audio-Driven Facial AnimationVideo Generation

  14. Let Me Look at You: Advanced Facial Expression Modeling for Conversational Speech Synthesis

    Jul 27, 2026Yifan Hu, Shuwei He, Rui Liu +1TTS SynthesisAudio-Driven Facial Animation

    Inner Mongolia University Hohhot, China · SRIBD, School of Artificial Intelligence The Chinese University of Hong Kong Shenzhen, China

  15. AptAvatar: Fast and Vivid Long-Form Audio-Driven Video Generation for Production-Ready Avatars

    Jul 27, 2026Hengyuan Zhang, Jingna Sun, Meiguang Jin +1Video Diffusion ModelsLong-Horizon Video Generation

    Alibaba Group, Taobao and Tmall Group

  16. STEER: Steerable Dyadic Head Avatars

    Jul 26, 2026Kartik Teotia, Helge Rhodin, Hyeongwoo Kim +2Human Motion Generation3D Avatar Generation

    Max Planck Institute for Informatics and Saarland Informatics Campus, Germany · Max Planck Institute for Informatics, Germany

  17. Automated Synthesis of Facial Mechanisms for Conversational Animatronic Robots

    Jul 13, 2026Zongzheng Zhang, Zi Lin, Jiawen Yang +6RoboticsAudio-Driven Facial Animation

    Institute for AI Industry Research (AIR), Tsinghua University · Beijing Academy of Artificial Intelligence (BAAI) · Beihang University +1

  18. GaussianEmoTalker: Real-Time Emotional Talking Head Synthesis with Audio-Driven and Blendshape-Based 3D Gaussian Splatting

    Jul 1, 2026Haijie Yang, Zhenyu Zhang, Yixuan Dong +23D Gaussian SplattingTalking Head Generation

    PCA Lab, Key Lab of Intelligent Perception and Systems for High-Dimensional Information of Ministry of Education, School of Computer Science and Engineering, Nanjing University of Science and Technology, Nanjing 210094, China · School of Intelligence Science and Technology, Nanjing University, Suzhou, 215000, China · Tsientang Institute for Advanced Study, Hangzhou, 310000, China

  19. Towards Flexible, Natural, Efficient Interaction for Conversational Talking Face Generation

    Jun 30, 2026Baiqin Wang, Sen Chen, Jiankuo Zhao +3Audio-Video GenerationTalking Head Generation

    MAIS, Institute of Automation, Chinese Academy of Sciences · School of Artificial Intelligence, University of Chinese Academy of Sciences · CAIR, HKISI, Chinese Academy of Sciences +1

  20. SyncCache: Exploiting Asymmetric Dynamics for Fast Audio-Driven Portrait Animation

    Jun 29, 2026Juncheng Ma, Yuxuan Du, Yanan Sun +8Diffusion TransformerAudio-Driven Facial Animation

    Shenzhen Graduate School, Peking University, China · Shanghai AI Laboratory, China · Tencent Hunyuan, China +1

  21. FacePlex: Toward Natural Full-Duplex Conversational Avatars

    Jun 29, 2026Habin Lim, Hah Min Lew, Jae-Ho Lee +4Audio-Video GenerationTalking Head Generation

    Korea University · Klleon

  22. KM-Speaker: Keypoint-Based Style Control for High-Quality Speech-Driven 3D Facial Animation and Dialogue Localization

    Jun 26, 2026Arthur Josi, Emeline Got, Abdallah Dib +2Audio-Driven Facial AnimationConditional Generative Modeling

    Ecole de Technologie Sup´erieure · Ubisoft LaForge

  23. MindFlow: Harmonizing Cognitive Semantics and Acoustic Dynamics for Facial Animation Generation in Dyadic Conversations

    Jun 26, 2026Hejia Chen, Haoxian Zhang, Xu He +4Audio-Driven Facial AnimationConditional Generative Modeling

    Beihang University · Kling Team, Kuaishou Technology · Zhongguancun Laboratory

  24. Integrating Facial Generation into Full-Duplex Spoken Dialogue Systems

    Jun 20, 2026Jingjing Jiang, Atsumoto Ohashi, Ryuichiro HigashinakaAudio-Driven Facial AnimationMultimodal Generation

    Graduate School of Informatics, Nagoya University, Japan

  25. EmoZone-Talker: Regional Semantic Control of Audio-Driven 3DGS Talking Heads via Facial Action Units

    Jun 14, 2026Tingting Chen, Shaojun Wang, Huaye Zhang +23D Gaussian SplattingAudio-Driven Facial Animation

    China University of Petroleum (East China)

  26. From Tokens to Faces: Investigating Discrete Speech Representations for 3D Facial Animation

    Jun 11, 2026Pedro Correa, Olivier Perrotin, Samir Sadok +2Audio Representation LearningNeural Audio Codecs

    Univ. Estadual de Campinas (UNICAMP), Brazil · Univ. Grenoble Alpes, CNRS, Grenoble INP, GIPSA-lab, France · Inria at Univ. Grenoble Alpes, CNRS, LJK, France

  27. ReFree: Towards Realistic Co-Speech Video Generation via Reward-Free RL and Multilevel Speech Guidance

    Jun 11, 2026Salaheldin Mohamed, M. Hamza Mughal, Rishabh Dabral +1Audio-Video GenerationRL for Video Generation

    Télécom Paris, Institut Polytechnique de Paris · Max Planck Institute for Informatics

  28. Mamba-Enhanced Implicit Motion Learning for Audio-Driven Portrait Animation

    Jun 2, 2026Xuan Wei, Jiahui Chen, Kaiheng Li +2Video Diffusion ModelsHuman Motion Generation

    Department of Digital Media Technology, School of Film, Xiamen University, Xiamen, China · 2National Institute for Data Science in Health and Medicine, Xiamen University, Xiamen, China · Institute of Artificial Intelligence, Xiamen University, Xiamen, China

  29. Temporally-Aligned Evaluation for Audio-Driven Talking Head Generation

    May 31, 2026Zhicheng Zhang, Lei Wang, Yu Zhang +1Talking Head GenerationAudio-Driven Facial Animation

    School of Business, University of New South Wales (UNSW), Australia. · School of Engineering and Built Environment, Griffith University, Australia. · Data61/CSIRO, Australia.

  30. TokTalk: Expressive Real-time Facial Animation from Audio-LLM Tokens

    May 29, 2026Qingcheng Zhao, Yifang Pan, Karan SinghTalking Head GenerationHuman Avatar Animation

    University of Toronto · Toronto, Canada