Lip Synchronization

Ask about this topic

Latest papers

CardsList

19 papers6 papers in the last four weeks, with none the four weeks before. 0.0% of all new papers.

  1. LiveSync: Iterative Self-Training for Lip-Sync Generation

    Oct 16, 2026Huaishao Luo, Huan Zhang, Guanbo Bao +3Lip SynchronizationAudio-Driven Facial Animation

    JD Technology

  2. PVSync: A Unified Lip-Sync Expert for Timing and Articulation

    Oct 6, 2026Kevin Stephen, Varun Menon, Timo Mertens +1Lip SynchronizationAudio-Visual Synchronization

    University of Southern California · Cantina Inc.

  3. Align Then Reason: A Multimodal Lip-Sync Judge for Dubbing

    Sep 30, 2026Rui Liu, Bhavin Jawade, Haoqi Li +4Audio-Visual SynchronizationAudio-Visual Alignment

    University of Maryland, College Park · Netflix

  4. Beyond Lip Sync: Reference-Grounded Oral Refinement for Audio-Driven Portrait Animation

    Sep 29, 2026Bangxun TangAudio-Visual SynchronizationAudio-Driven Facial Animation

    University of California, Irvine

  5. ComplexSync: High-Fidelity and Real-Time Lip Sync in Complex Scenarios

    Sep 24, 2026Jiaran Cai, Xingpei Ma, Shenneng HuangVideo Diffusion ModelsLip Synchronization

    Guangzhou Quwan Network Technology

  6. Not Quite My Tempo: Voice Activity-aware Speech Synthesis for Lip-Synchronous Dubbing

    Sep 22, 2026Alejandro Pérez-González-de-Martos, Florian Lux, Angelina Elizarova +3TTS SynthesisAudio-Visual Synchronization

    AppTek GmbH, Germany

  7. EfficientSync: Real-Time Lip Synchronization via Deformation-Based Reference Texture Mixing

    Aug 19, 2026Fa-Ting Hong, Runzhen Liu, Luchuan Song +2Lip SynchronizationAudio-Visual Synchronization

    Department of Computer Science and Engineering, The Hong Kong University of Science and Technology, Hong Kong SAR · South China University of Technology

  8. PD-GS: Phoneme-Driven 3DGS for Audio-Driven Talking Heads

    Aug 5, 2026Ao Fu, Yi Zhou3D Gaussian SplattingLip Synchronization

    School of Computer Science and Engineering, Southeast University, Nanjing, China, Key Laboratory of New Generation Artificial Intelligence Technology and Its Interdisciplinary Applications and Ministry of Education, Nanjing, China

  9. Lip Forcing: Few-Step Autoregressive Diffusion for Real-time Lip Synchronization

    Jun 9, 2026Paul Hyunbin Cho, Jinhyuk Jang, SeokYoung Lee +7Diffusion Model DistillationLip Synchronization

    KAIST AI · 1KAIST AI · AIPARK +1

  10. HighSync: High-Quality Lip Synchronization via Latent Diffusion Models

    May 16, 2026Saeid Firouzi Daghigh, Majid Iranpour Mobarakeh, Mostafa Alavi +1Lip SynchronizationAudio-Visual Synchronization

    Department of Computer Engineering and Information Technology, Payam Noor University, Tehran, Iran · independent researcher

  11. EAD-Net: Emotion-Aware Talking Head Generation with Spatial Refinement and Temporal Coherence

    Apr 25, 2026Yahui Li, Yinfeng Yu, Liejun Wang +1Video Diffusion ModelsLip Synchronization

    School of Computer Science and Technology, Xinjiang University Urumqi, China

  12. Multimodal Large Language Model-Enabled Video Translation: A Role-Oriented Survey

    Apr 13, 2026Bingzheng Qu, Kehai Chen, Xuefeng Bai +1Lip SynchronizationMachine Translation

    School of Computer Science and Technology, Harbin Institute of Technology (Shenzhen), Shenzhen 518055, Guangdong, China.

  13. PS-TTS: Phonetic Synchronization in Text-to-Speech for Achieving Natural Automated Dubbing

    Apr 10, 2026Changi Hong, Yoonah Song, Hwayoung Park +4Lip SynchronizationAudio-Visual Synchronization

    Dept. of AI Convergence, Gwangju Institute of Science and Technology, Gwangju 61005, Republic of Korea · Dept of Electrical Engineering and Computer Science, Gwangju Institute of Science and Technology, Gwangju 61005, Republic of Korea · AunionAI Co., Ltd., Gwangju 61005, Republic of Korea

  14. Realistic Lip Motion Generation Based on 3D Dynamic Viseme and Coarticulation Modeling for Human-Robot Interaction

    Apr 2, 2026Sheng Li, Jingcheng Huang, Min LiLip SynchronizationAudio-Driven Facial Animation

    The authors are with The State Key Laboratory of Intelligent Manufacturing Equipment and Technology, Huazhong University of Science and Technology, Wuhan 430074, China.

  15. SyncEdit: Rethinking Lip Synchronization as Editing with Audio-Driven Diffusion Models

    Mar 10, 2026Lixiang Lin, Siyuan Jin, Jinshan ZhangLip SynchronizationVideo Editing

    HiThink Research · University of Science and Technology of China · Zhejiang University

  16. EmbedTalk: Talking Head Synthesis using Gaussian Embeddings

    Mar 8, 2026Arpita Saggar, Jonathan C. Darling, Duygu Sarikaya +13D Gaussian SplattingLip Synchronization

    School of Computer Science, University of Leeds · Leeds Institute of Medical Education, School of Medicine, University of Leeds

  17. UniSync: Towards Generalizable and High-Fidelity Lip Synchronization for Challenging Scenarios

    Mar 4, 2026Ruidi Fan, Yang Zhou, Siyuan Wang +3Lip SynchronizationAudio-Visual Synchronization

    Mango TV

  18. UniTalking: A Unified Audio-Video Framework for Talking Portrait Generation

    Mar 2, 2026Hebeizi Li, Zihao Liang, Benyuan Sun +4Lip SynchronizationAudio-Video Generation

    Central Media Technology Institute, Huawei · School of Computer Science and Engineering, Beihang University

  19. 3DXTalker: Unifying Identity, Lip Sync, Emotion, and Spatial Dynamics in Expressive 3D Talking Avatars

    Feb 11, 2026Zhongju Wang, Zhenhong Sun, Beier Wang +4Lip Synchronization3D Avatar Generation

    University of New South Wales · Australian National University · Vertex Lab +1