Joint Audio-Video Generation

Ask about this field

Recent momentum

emerging

0 papers in the last 28 days · 0.0% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Weekly history

Recent digests

What was published in this field, kept on the site without email delivery.

Period ending 2026-09-21

3 new papers

A weekly snapshot of new work published in Joint Audio-Video Generation.

Period ending 2026-09-14

2 new papers

A weekly snapshot of new work published in Joint Audio-Video Generation.

Period ending 2026-09-07

4 new papers

A weekly snapshot of new work published in Joint Audio-Video Generation.

Inside this field

Focused directions

175 papers

Latest in Joint Audio-Video Generation

Browse all topics →
CardsList

  1. DFD-Lab: A Modular Audio-Visual Deepfake Detection Pipeline

    Sep 20, 2026Jan Rybarczyk, Mateusz Roszkowski, Jacek KomorowskiExplainable Deepfake DetectionDetection Framework

  2. MoSAT: Human Motion Generation from Spatial Audio and Textual Description

    Sep 20, 2026Shuyang Xu, Zhiyang Dou, Yiduo Hao +8Spatial AudioJoint Audio-Video Generation

  3. Omni2Web: Benchmarking Audiovisual Website Development

    Sep 20, 2026Minghao Han, Zhenghao Xing, Xize Cheng +7Omni-ModalAudio-Visual Reasoning

  4. OmniEcho: Audio-Visual Spatial Understanding for Omni-Modal Embodied Agents

    Sep 20, 2026Ruixun Liu, Yuxuan Wang, Jiacheng Xie +10Spatial AudioEmbodied Navigation

  5. AVTrace: Diagnosing Audio-Visual Temporal Reasoning in Omni Models

    Sep 17, 2026Longyin Zhang, Parth Sakhare Mahendra, Chengwei Wei +4Audio-Visual ReasoningCross-Modal Learning

  6. Video-HolmesV2: Can MLLMs Reason with Spatio-Temporal Audio-Visual Evidence in Long Videos?

    Sep 15, 2026Zhaoyang Wei, Zipeng Wang, Yushe Cao +10Audio-Visual ReasoningVideo Understanding

  7. Omni-Streaming Thinking

    Sep 14, 2026Enjun Du, Siyi Liu, Ziyu Zheng +4Omni-ModalAudio-Visual Reasoning

  8. The Platonic brain bridge hypothesis: human brain networks as an architectural prior for multimodal large language models

    Sep 10, 2026Pengfei Zhang, Biao Tian, Xiangang Li +1BrainHuman Brain Networks

  9. Why Is Video Still So Expensive? A Survey of Inference-Efficiency Mechanisms in Video and Audiovisual LLMs

    Sep 9, 2026Killian Steunou, Yannis Tevissen, Mounîm A. El YacoubiAudio-Visual ConsistencyVision Encoders

  10. Beyond Coherence: Benchmarking Professional Editing-Technique Execution in Multi-Shot Audio-Video Generation

    Sep 8, 2026Tianyi Zeng, Junchao Liao, Yujie Wei +9Video EditingJoint Audio-Video Generation

  11. TimeSteer: Inference-Time Speech Scheduling in Joint Audio-Visual Diffusion Models

    Sep 1, 2026Chao Zhou, Yiling Chen, Qi Chu +3Joint Audio-Video GenerationAudio Latent

  12. DreamX-Creator: Democratizing Native Audio-Video Generation at 2K Resolution

    Aug 31, 2026Jiashu Zhu, Yanhao Zheng, Ruitian Tian +7Joint Audio-Video GenerationMultimodal Generation

  13. TurboT2VA: Fast Large-Scale Text-to-Video-Audio Generation via Score-Regularized Consistency Distillation

    Aug 25, 2026Xiaoda Yang, Yuxiang Liu, Kaiwen Zheng +12Joint Audio-Video GenerationDynamic Sparse Attention

  14. The ISCSLP 2026 Real-World Audio-Visual Speech Enhancement Challenge

    Aug 24, 2026Kai Li, Wenze Ren, Junjie Li +11Speech EnhancementAudio-Visual Consistency

  15. VA-Judger: Reward Modeling from Human Preference Feedback for Joint Video-Audio Generation

    Aug 19, 2026Yinming Huang, Shuyuan Tu, Xi Yan +6Joint Audio-Video GenerationGenerative Quality

  16. Intervention, Not Shared Latents: Blocking Visual Shortcuts in Audio-Video Generation

    Aug 14, 2026Jian Xu, Delu Zeng, John PaisleyJoint Audio-Video Generation

  17. Reasoning for Social Audio-Visual Question Answering: Where Do We Stand?

    Aug 13, 2026Koen P. de Vries, Xavier Alameda-Pineda, Estefanía Talavera +1Audio-Visual ReasoningSocial Media

  18. StrAD: A Streaming Method and Benchmark for Audio Description Generation for Long-form Videos

    Aug 12, 2026Julian Spravil, Sebastian Houben, Sven BehnkeJoint Audio-Video GenerationAudio

  19. HarmoniDPO: Video-guided Audio Generation via Preference-Optimized Diffusion

    Aug 12, 2026Wenshuo Peng, Kaipeng ZhangJoint Audio-Video GenerationHarmonization

  20. UniSwap: Streaming Audio-Visual Identity Swapping for Talking Videos

    Aug 12, 2026Yuxuan Zhang, Haozhong Xiong, Jiayi Song +5Joint Audio-Video GenerationVideos

  21. CookVoice: Unified Framework for Style Controllable Multi-Modal Human Voice Generation

    Aug 12, 2026Haowei Lou, Hye-Young Paik, Dai Jia +2Singing Voice ConversionJoint Audio-Video Generation

  22. Dialogue-Aware Video-to-Music Generation Using Public Domain Film Collections

    Aug 12, 2026Haven Kim, Zachary Novack, Julian McAuley +1Joint Audio-Video GenerationFilms

  23. Qwen-MusicAVQA-7B: A Multimodal Model for Music Audio-Visual QA

    Aug 11, 2026Maryam DehdashtiAudio-Visual ReasoningAudio Representation

  24. Signpost Watermarking: Joint Optimization for Visual Watermark Coexistence

    Aug 10, 2026Shruti Agarwal, Vishal Asnani, John CollomosseWatermarksWatermarking

  25. Towards Expressive and Faithful Audio-to-Image Generation: A Unified Multimodal Dataset and Synthesis Framework

    Aug 10, 2026Dongxu Ge, Shansong Liu, Cheng Gong +3Joint Audio-Video GenerationAudio-Visual Consistency

  26. Listen, See and Track: Spatio-Temporal Audio-Visual Sound Event Reasoning for Omni-Modal Language Models

    Aug 10, 2026Zhi Zeng, Cheng Zhang, Zesheng Yang +9Audio-Visual ReasoningSpatial Audio

  27. DAVE: A Decoupled Audio-Visual Enhancement Framework for Real-World Speech Separation

    Aug 10, 2026Wei Zhou, Wanyi Ning, Yinshang Guo +3Speech EnhancementSpeech Separation

  28. Omni2LoRA: Coherence-Preserving Parametric Memory for Efficient Omni Language Models

    Aug 10, 2026Puneet Mathur, Manan Suri, Dinesh ManochaMulti-Modal Large Language ModelsOmni

  29. Deferred Audio Pruning with Local Audio-Visual Dynamics for Omni-LLMs

    Aug 9, 2026Kyeongyoon Lee, Hongyeob Kim, Youngeun Kim +1Audio-Visual ReasoningAudio-Visual Consistency

  30. Aero Realtime: Fully Aligned Input-Output Streams for Low-Latency Streaming Multimodal Generation

    Aug 9, 2026Kaichen Zhang, Wei Huang, Keming Wu +2Multimodal GenerationJoint Audio-Video Generation

  31. MMAG: A Multi-Control Mixed Audio Generation Benchmark

    Aug 7, 2026Zihao Zheng, Xuenan Xu, Jiahao Mei +5Joint Audio-Video GenerationSpeaker Attributes

  32. Vorch-Omni: Multi-Task Orchestration of Sight and Sound

    Aug 6, 2026Vorch Team, Xiaoyu Chen, Yang Ding +25Joint Audio-Video GenerationOrchestration

  33. Vorch-Streamer: Extending Human Audio-Visual Generation to Real-Time Long-Form Streaming

    Aug 6, 2026Menglin Han, Yang Ding, Yulei Lu +6Joint Audio-Video GenerationSpeech Content

  34. Visual Representation Matters: Exploiting Temporal Differences in Video-to-Audio Generation

    Aug 5, 2026Zehua Chen, Junyou Wang, Yuxuan Jiang +5Joint Audio-Video GenerationAudio Latent

  35. OmniVR: Joint Video-Audio Conditional Generation for Restoring Degraded Historical Films

    Aug 4, 2026Xin Lu, Zihao Fan, Mingchen Zhong +3Photorealistic Video RestorationJoint Audio-Video Generation

  36. OmniPack: Unified Token Compression for Efficient Omni-modal Large Language Models

    Aug 4, 2026Wanshun Su, Yang Shi, Feihu Liu +10Token CompressionLarge Language Model Compression

  37. AI-Based Sound Effect Generation: A Narrative Review of Generative Models Across Input Modalities

    Aug 4, 2026Sandy Abdo, Bill Kapralos, Priyamvada Tripathi +2Joint Audio-Video GenerationGenerative Artificial Intelligence

  38. Hear to See: Discerning Stateful Listening for Audio-Visual Instance Segmentation

    Aug 4, 2026Leiye Liu, Miao Zhang, Jiahong Jiang +7Video Object SegmentationAudio-Visual Consistency

  39. EchoCache: Energy-Guided Cross-Modal Caching for Efficient Audio-Driven Video Generation

    Aug 3, 2026Jiayu Chen, Xiaoyu Wu, Rongshan Gao +6Joint Audio-Video GenerationAudio-Visual Consistency

  40. AcoustiTrace: When Plausible Sound Violates Physics

    Aug 3, 2026Shiyang Li, Yuewen Cao, Yihao Liu +4Joint Audio-Video GenerationAcoustic

  41. SwanTale: Unified Multi-Speaker Speech and Audio Generation for Instruct and Zero-Shot Tasks

    Aug 3, 2026Yu Zhang, Ruiqi Li, Changhao Pan +3Zero-Shot Text-To-SpeechJoint Audio-Video Generation

  42. StreamTalk: Streaming Co-Speech Gesture Generation with Key-Pose Anchoring

    Aug 3, 2026Xiangyue Zhang, Jianfang Li, Jiaxu Zhang +2Co-Speech Gesture GenerationTalk

  43. InteracVid: Building a Real Interactive Audio-Visual Response Dataset from Live-Chat Videos

    Aug 2, 2026Chi Zhang, Haoyang Shi, Yueyi Liu +4Conversational DatasetsVideo Dataset

  44. Ripple: Real-Time Streaming Audio-Video Generation With Cross-Modal Recurrent Memory

    Jul 29, 2026Yanbo Ding, Zhizhi Guo, Quanyue Song +4Joint Audio-Video GenerationAudio Latent

  45. OmniDelta: Skill-Driven Budget Allocation for Token Compression in OmniLLMs

    Jul 28, 2026Haoyang Huang, Wenjie Huang, Tianqi Xu +14Token CompressionAudio-Visual Reasoning

  46. TaoMate: Anchor-Guided Memory Bridging Evolving and Reference States for Real-Time Audio-Video Digital Human Generation

    Jul 27, 2026Qijun Gan, Chenwei Zhang, Meiguang Jin +2Joint Audio-Video GenerationCross-Modal Attention

  47. AptAvatar: Fast and Vivid Long-Form Audio-Driven Video Generation for Production-Ready Avatars

    Jul 27, 2026Hengyuan Zhang, Jingna Sun, Meiguang Jin +1Joint Audio-Video GenerationHigh-Fidelity Avatar

  48. OmniVAE: An Audio-Video VAE with Cross-Modal Alignment for Joint Generation

    Jul 26, 2026Jun Zhan, Chen Yang, Yitian Gong +23Joint Audio-Video GenerationAudio Latent

  49. Omni-Prune: Query-Aware Unified Token Pruning for Efficient Omnimodal Large Language Models

    Jul 26, 2026Yiming Zhong, Chang Nie, Caifeng ShanVisual Token PruningAudio-Visual Reasoning

  50. OmniMate: Open-Ended Real-Time Streaming Audio-Visual Generation for Interactive Avatars

    Jul 25, 2026Quanyue Song, Yishan He, Yanbo Ding +4Joint Audio-Video GenerationAudio-Visual Consistency

  51. Quality-Aware Multimodal Fusion Reveals Implicit Identity in Valence-Arousal Features

    Jul 23, 2026Jisu Kim, Benjamin S. RigganMultimodal FusionFacial Recognition

  52. OmniReasoner: Thinking with Long Audio-Video via Native Tool Use

    Jul 21, 2026Yu Chen, Caorui Li, Ziyu Xiong +8Audio-Visual ReasoningMulti-Modal Large Language Models

  53. Audio-Visual Flamingo: Open Audio-Visual Intelligence for Long and Complex Videos

    Jul 17, 2026Sreyan Ghosh, Arushi Goel, Kaousheik Jayakumar +19Audio-Visual ReasoningLarge Audio Language Models

  54. AVE-Compass: Towards Holistic Evaluation for Audio-Video Editing Abilities

    Jul 17, 2026Yuqing Wen, Yukai Huang, Qianqian Xie +6Video EditingAudio-Visual Consistency

  55. MultiRef-Compass: Towards Comprehensive Evaluation of Multi-Reference-to-Audio-Video Generation

    Jul 15, 2026Xiaohan Zhang, Yuqing Wen, Junlin Chen +9Joint Audio-Video GenerationAudio-Visual Consistency

  56. Bring Music The Horizon: Music-Driven 360∘^\circ Video Generation

    Jul 15, 2026Kai Hsu Tsai, Yong Wei Fu, Hung I Yang +1Conversational Music RecommendationJoint Audio-Video Generation

  57. AVSCap: Orchestrating Audio-Visual Synergy for Omni-modal Video Captioning

    Jul 14, 2026Yanghai Wang, Jiahao Wang, Jiafu Tang +9Audio-Visual ReasoningAudio-Visual Consistency

  58. A Hybrid Mamba for Audio-Visual Navigation

    Jul 14, 2026Yi Wang, Yinfeng YuAudio-Visual ReasoningObject Goal Navigation

  59. BackgroundMellow: A Multi-Modal Cohesive Framework for Narrative-Driven Rich Cinematic Soundscape Generation

    Jul 13, 2026Ajitesh Jamulkar, Aritra HazraJoint Audio-Video GenerationZero-Shot Text-To-Speech

  60. Empowering Long-form Omni-modal Understanding with Robust Audio Perception

    Jul 11, 2026Kaiying Yan, Luoyi Sun, Xiao Zhou +1Audio-Visual ReasoningOmni-Modal