Overview

Talking head generation studies how to animate a person’s face or avatar so speech, lip movements, identity, and expressions remain coordinated. Approaches range from audio-conditioned diffusion and flow-matching models to autoregressive streaming systems and 3D methods using facial meshes or Gaussian splatting. Recent work adds controls for emotion, speaking style, and conversational reactions, while aiming to make generation interactive and efficient. A central challenge is balancing natural, temporally consistent motion and identity preservation with low latency, flexible control, and evaluation that reflects perceived quality.

Latest papers

CardsList

42 papers1 paper in the last four weeks, down 80% on the four weeks before. 0.0% of all new papers.

  1. MUTE: Multi-Level Alignment Uncoupling Against Talking-Head Exploitation for Voice Protection

    Nov 9, 2026Donghyun Kim, Jin Hong, Seungmin Kim +3Privacy-Preserving Speech ProcessingAdversarial Perturbations

  2. Talk Like You: Imitating How You Speak in Real-Time Talking Head Generation

    Oct 5, 2026Baiqin Wang, Zhixing Ding, Jijie Li +3Talking Head GenerationAudio-Driven Facial Animation

  3. GLARE: Generating Listening Heads with Appropriate Reactions

    Sep 30, 2026Zikai Liao, Yumin Suh, Yi Ouyang +3Talking Head Generation

  4. MegaAvatar: Controllable Talking Avatar Generation

    Sep 30, 2026Junyao Gao, Sibo Liu, Weidong Zhang +2Talking Head Generation3D Avatar Generation

  5. EvolvingAvatar: Interactive 3D Head Generation That Adapts as Conversations Unfold

    Sep 28, 2026Junjie Chen, Fei Wang, Kun Li +5Talking Head Generation3D Avatar Generation

  6. Decoupled Self-Forcing Distillation for Streaming Talking Head Generation

    Sep 9, 2026Yanru An, Ruiyan Wang, Wenwu Wei +7Audio-Video GenerationDiffusion Model Distillation

  7. CETalk: Continuous Valence-Arousal Control for Audio-Driven 3D Talking Head Generation

    Aug 15, 2026Peng Jia, Li Dai, Zhen Xiao +2Talking Head GenerationAudio-Driven Facial Animation

  8. LeapTalk: Breaking the Latency-Quality Trade-off in Talking Head Generation

    Jul 29, 2026Rongxiang Zhang, Songhua LiuAudio-Video GenerationDiffusion Model Distillation

  9. Conversational Human Audio-visual Talking Dialogue Generation

    Jul 2, 2026Junhao Song, Lluis Guasch, Xilin He +8Audio-Video GenerationSpoken Dialogue Systems

  10. GaussianEmoTalker: Real-Time Emotional Talking Head Synthesis with Audio-Driven and Blendshape-Based 3D Gaussian Splatting

    Jul 1, 2026Haijie Yang, Zhenyu Zhang, Yixuan Dong +23D Gaussian SplattingTalking Head Generation

  11. Towards Flexible, Natural, Efficient Interaction for Conversational Talking Face Generation

    Jun 30, 2026Baiqin Wang, Sen Chen, Jiankuo Zhao +3Audio-Video GenerationTalking Head Generation

  12. FacePlex: Toward Natural Full-Duplex Conversational Avatars

    Jun 29, 2026Habin Lim, Hah Min Lew, Jae-Ho Lee +4Audio-Video GenerationTalking Head Generation

  13. ReFree: Towards Realistic Co-Speech Video Generation via Reward-Free RL and Multilevel Speech Guidance

    Jun 11, 2026Salaheldin Mohamed, M. Hamza Mughal, Rishabh Dabral +1Audio-Video GenerationRL for Video Generation

  14. Temporally-Aligned Evaluation for Audio-Driven Talking Head Generation

    May 31, 2026Zhicheng Zhang, Lei Wang, Yu Zhang +1Talking Head GenerationAudio-Driven Facial Animation

  15. TokTalk: Expressive Real-time Facial Animation from Audio-LLM Tokens

    May 29, 2026Qingcheng Zhao, Yifang Pan, Karan SinghTalking Head GenerationHuman Avatar Animation

  16. IP-Adapter Is All You Need: Towards Fine-Tuning-Free Diffusion-Based Talking Face Generation

    May 28, 2026Hao Wu, Xiangyang Luo, Hao Wang +3Talking Head GenerationAudio-Driven Facial Animation

  17. CapTalk: Text-Guided Stylization and Speech-Driven 3D Head Animation

    May 28, 2026Xuangeng Chu, Yuan Gan, Ziteng Cui +4Audio-Video GenerationTalking Head Generation

  18. Test-Time Self-Adaptive Conditioning for Stable Audio-Driven Talking-Head Generation

    May 25, 2026Zhicheng Zhang, Lei Wang, Yu Zhang +1Test-Time AdaptationTalking Head Generation

  19. SDTalk: Structured Facial Priors and Dual-Branch Motion Fields for Generalizable Gaussian Talking Head Synthesis

    May 11, 2026Peng Jia, Zhen Xiao, Jia Li +33D Gaussian SplattingTalking Head Generation

  20. AsymTalker: Identity-Consistent Long-Term Talking Head Generation via Asymmetric Distillation

    May 1, 2026Yuxin Lu, Jiayang Sun, Guibo Zhu +1Video Diffusion ModelsLong Video Generation

  21. Generate Your Talking Avatar from Video Reference

    Apr 30, 2026Zujin Guo, Zhenhui Ye, Yi Ren +4Video-Reference Video GenerationAudio-Video Generation

  22. Talking Slide Avatars: Open-Source Multimodal Communication Approach for Teaching

    Apr 26, 2026Xinxing WuAudio-Video GenerationEducational Technology

  23. Talker-T2AV: Joint Talking Audio-Video Generation with Autoregressive Diffusion Modeling

    Apr 26, 2026Zhen Ye, Xu Tan, Aoxiong Yin +8Talking Head GenerationAudio-Video Generation

  24. EmbodiedHead: Real-Time Listening and Speaking Avatar for Conversational Agents

    Apr 19, 2026Yu Zhang, Kaiyuan Shen, Yang LiStreaming Video GenerationTalking Head Generation

  25. TurboTalk: Progressive Distillation for One-Step Audio-Driven Talking Avatar Generation

    Apr 16, 2026Xiangyu Liu, Feng Gao, Xiaomei Zhang +4Audio-Video GenerationVideo Diffusion Models

  26. SEDTalker: Emotion-Aware 3D Facial Animation Using Frame-Level Speech Emotion Diarization

    Apr 14, 2026Farzaneh Jafari, Stefano Berretti, Anup BasuAudio-Driven Facial AnimationTalking Head Generation

  27. Beyond Monologue: Interactive Talking-Listening Avatar Generation with Conversational Audio Context-Aware Kernels

    Apr 11, 2026Yuzhe Weng, Haotian Wang, Xinyi Yu +4Audio-Video GenerationTalking Head Generation