Audio-Visual Synchronization

Ask about this topic

Momentum

10 papers in the last four weeks, against 2 the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 42

All topics
CardsList

  1. PVSync: A Unified Lip-Sync Expert for Timing and Articulation

    Oct 6, 2026Kevin Stephen, Varun Menon, Timo Mertens +1Audio-Visual SynchronizationAudio-Visual Representation Learning

    University of Southern California · Cantina Inc.

  2. Kandinsky 6.0 Video: Foundation Models for Synchronized Video and Audio Generation

    Oct 4, 2026Team Kandinsky, Julia Agafonova, Bulat Akhmatov +85Audio-Video GenerationVideo Diffusion Models

  3. Align Then Reason: A Multimodal Lip-Sync Judge for Dubbing

    Sep 30, 2026Rui Liu, Bhavin Jawade, Haoqi Li +4Audio-Visual SynchronizationAudio-Visual Alignment

    University of Maryland, College Park · Netflix

  4. Soundwich: Video Generation with Layered and Controllable Audio

    Sep 30, 2026Zhuo Ning, AmirHossein Naghi Razlighi, Sagi Polaczek +2Audio-Video GenerationAudio-Visual Synchronization

    Simon Fraser University · University of Cyprus · CYENS Centre of Excellence +1

  5. HelixWorld: A Real-time Interactive Audio-Visual World Model

    Sep 29, 2026Lei Ke, Jiahao Pan, Zeyue Tian +13World Model LearningReal-Time Interactive Video Generation

    The Hong Kong University of Science and Technology · Noiz AI

  6. Beyond Lip Sync: Reference-Grounded Oral Refinement for Audio-Driven Portrait Animation

    Sep 29, 2026Bangxun TangAudio-Visual SynchronizationAudio-Driven Facial Animation

    University of California, Irvine

  7. BeatDance: Generating Beat-Consistent 3D Dance with Hierarchical Spatial-Temporal Modeling

    Sep 29, 2026Xiaojian Shen, Dahu Shi, Jianrong Zhang +7Human Motion GenerationAudio-Visual Synchronization

    College of Software, Jilin University, Changchun, 130012, China · College of Computer Science and Technology, Zhejiang University, Hangzhou, 310007, China · ReLER, AAII, University of Technology Sydney, Sydney, Australia +5

  8. SyncRA: Learning Temporal Correspondence in Omni-Modal Models

    Sep 28, 2026Zelong Xu, Yan Li, Wenhe Hu +1Audio-Visual Representation LearningAudio-Visual Synchronization

    University of Wisconsin–Madison · University of Alberta · Arizona State University

  9. ComplexSync: High-Fidelity and Real-Time Lip Sync in Complex Scenarios

    Sep 24, 2026Jiaran Cai, Xingpei Ma, Shenneng HuangVideo Diffusion ModelsAudio-Visual Synchronization

    Guangzhou Quwan Network Technology

  10. Not Quite My Tempo: Voice Activity-aware Speech Synthesis for Lip-Synchronous Dubbing

    Sep 22, 2026Alejandro Pérez-González-de-Martos, Florian Lux, Angelina Elizarova +3TTS SynthesisAudio-Visual Synchronization

    AppTek GmbH, Germany

  11. AVTrace: Diagnosing Audio-Visual Temporal Reasoning in Omni Models

    Sep 17, 2026Longyin Zhang, Parth Sakhare Mahendra, Chengwei Wei +4Temporal Video GroundingAudio-Visual Understanding

    Institute of Advanced Intelligence and Computing (IAIC), A*STAR, Singapore · Centre for Frontier AI Research (CFAR), A*STAR, Singapore

  12. HarmoniDPO: Video-guided Audio Generation via Preference-Optimized Diffusion

    Aug 12, 2026Wenshuo Peng, Kaipeng ZhangAudio-Video GenerationAudio Diffusion Models

    Electornic Engineering Department, Tsinghua University, Haidian District, Beijing, 100084 China. · OpenGVlab, Shanghai AI Laboratory, Xuhui District, Shanghai, 200030, China.

  13. UniSwap: Streaming Audio-Visual Identity Swapping for Talking Videos

    Aug 12, 2026Yuxuan Zhang, Haozhong Xiong, Jiayi Song +5Audio-Video GenerationVideo Diffusion Models

    The Chinese University of Hong Kong · Qwen Applications Business Group of Alibaba

  14. Vorch-Streamer: Extending Human Audio-Visual Generation to Real-Time Long-Form Streaming

    Aug 6, 2026Menglin Han, Yang Ding, Yulei Lu +6Text-to-Video GenerationLong-Horizon Video Generation

    Vorch Team · Tongji University · Harbin Institute of Technology, Shenzhen +1

  15. PD-GS: Phoneme-Driven 3DGS for Audio-Driven Talking Heads

    Aug 5, 2026Ao Fu, Yi Zhou3D Gaussian SplattingAudio-Visual Synchronization

    School of Computer Science and Engineering, Southeast University, Nanjing, China, Key Laboratory of New Generation Artificial Intelligence Technology and Its Interdisciplinary Applications and Ministry of Education, Nanjing, China

  16. OmniVR: Audio-Video Conditional Generation for Archival Footage Restoration

    Aug 4, 2026Xin Lu, Zihao Fan, Jie Huang +4Audio-Visual SynchronizationVideo Restoration

    University of Science and Technology of China · JD Explore Academy

  17. OmniVAE: An Audio-Video VAE with Cross-Modal Alignment for Joint Generation

    Jul 26, 2026Jun Zhan, Chen Yang, Yitian Gong +23Variational AutoencodersAudio-Video Generation

    1Fudan University · 2Shanghai Innovation Institute · 3MOSI Intelligence +1

  18. Wan-Dancer: A Hierarchical Framework for Minute-scale Coherent Music-to-Dance Generation

    Jul 10, 2026Mingyang Huang, Peng Zhang, Li Hu +2Video Diffusion ModelsLong Video Generation

    Tongyi Lab, Alibaba Group

  19. Beyond Time Shifts: Adapting Omni-LLM as a Reference-Free Evaluator for Generative Audio-Visual Models

    Jul 10, 2026Yijie Qian, Juncheng Wang, Chao Xu +6Audio-Video GenerationGroup Relative Policy Optimization

    Zhejiang University, Hangzhou, China · IROOTECH TECHNOLOGY, China · The Hong Kong Polytechnic University, Hong Kong, China +1

  20. Precise Video-to-Audio Generation with Cross-Modal Alignment in Latent Space

    Jul 7, 2026Thanh V. T. Tran, Ngoc-Son Nguyen, Luong Tran +4Audio-Video GenerationAudio-Visual Synchronization

    FPT Software AI Center, Vietnam · NVIDIA Corporation, USA

  21. AV-SyncBench: Decoupled Benchmarking of Temporal and Semantic Audio-Visual Synchronization

    Jul 1, 2026Tianhong Zhou, Mingyang Han, Boyu Li +8Audio-Visual SynchronizationAudio-Visual Alignment

    Tsinghua University, Beijing, China · Alibaba Group, China · Fudan University, Shanghai, China

  22. WaveSync: Constrained Wavefront Optimization for Synchronized Co-Speech Gestures in Humanoid Robots

    Jun 15, 2026Thang Tran Viet, Thanh Nguyen Canh, Gia Huy Uong +4Human Motion GenerationAudio-Visual Synchronization

    University of Engineering and Technology, Vietnam National University, 10000, Hanoi, Vietnam. · School of Information Science, Japan Advanced Institute of Science and Technology, Nomi, 923-1211, Ishikawa, Japan. · School of Electronics and Computer Science, University of Southampton, SO17 1BJ Southampton, United Kingdom. +1

  23. FoleyGenEx: Unified Video-to-Audio Generation with Multi-Modal Control, Temporal Alignment, and Semantic Precision

    Jun 12, 2026Shiyao Wang, Xijuan Zeng, Hui Wang +4Audio-Video GenerationAudio-Visual Synchronization

    Academy for Advanced Interdisciplinary Studies, Nankai University, Tianjin, China · Kling Team, Kuaishou Technology, Beijing, China

  24. Lip Forcing: Few-Step Autoregressive Diffusion for Real-time Lip Synchronization

    Jun 9, 2026Paul Hyunbin Cho, Jinhyuk Jang, SeokYoung Lee +7Diffusion Model DistillationAudio-Visual Synchronization

    KAIST AI · 1KAIST AI · AIPARK +1

  25. Inference-Time Scaling for Joint Audio-Video Generation

    Jun 2, 2026Jaemin Jung, Kyeongha Rho, Inkyu Shin +1Audio-Video GenerationInference-Time Scaling

    Korea Advanced Institute of Science and Technology · Luma AI

  26. Native Audio-Visual Alignment for Generation

    May 28, 2026Longbin Ji, Guan Wang, Xuan Wei +6Audio-Video GenerationAudio-Visual Synchronization

    ERNIE Team, Baidu Inc.

  27. LongAV-Compass: Towards Unified Evaluation of Minute-Scale Audio-Visual Generation Across T2AV, I2AV, and V2AV

    May 25, 2026Tengfei Liu, Yang Shi, Xuanyu Zhu +17Audio-Video GenerationLong-Horizon Video Generation

    Peking University · Kling Team · Nanjing University +6

  28. StreamChar: Long-Horizon Streaming Character Audio-Video Generation with Decoupled Orchestration

    May 25, 2026Linrui Tian, Qi Wang, Bang ZhangAudio-Video GenerationLong-Horizon Video Generation

    Tongyi Lab, Alibaba Group

  29. SpongeBob: Sync-Aware Harmonious Audio-Visual Generative Editing

    May 24, 2026Sen Liang, Cong Wang, Fengbin Guan +6Video EditingAudio-Visual Synchronization

    University of Science and Technology of China · 2Tencent Hunyuan

  30. Omni-Customizer: End-to-End MultiModal Customization for Joint Audio-Video Generation

    May 17, 2026Yuheng Chen, Qingdong He, Teng Hu +4Audio-Video GenerationAudio-Visual Synchronization

    Shanghai Jiao Tong University · University of Electronic Science and Technology of China · Zhejiang University