Audio Generation

Ask about this topic

Momentum

9 papers in the last four weeks, up 80% on the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 95

All topics
CardsList

  1. Improving Text-to-Audio Instruction Following via Fine-Grained Feedback from Audio-Aware Large Language Models

    Jul 15, 2026Chun-Yi Kuan, Siwon Kim, Byeonggeun Kim +7Audio-Language Model EvaluationText-to-Audio Generation

    National Taiwan University, Taiwan · Amazon, USA

  2. Adapting Diffusion-Based Music Synthesis to Speech and Singing Voice Conversion

    Jul 14, 2026Ben Maman, Frank Zalkow, Hans-Ulrich Berendes +3Audio Diffusion ModelsAudio Generation

    International Audio Laboratories Erlangen, Germany · Fraunhofer IIS, Erlangen, Germany

  3. BackgroundMellow: A Multi-Modal Cohesive Framework for Narrative-Driven Rich Cinematic Soundscape Generation

    Jul 13, 2026Ajitesh Jamulkar, Aritra HazraText-to-Audio GenerationAudio Editing

    Department of Computer Science & Engineering, Indian Institute of Technology Kharagpur, India.

  4. A Production-Oriented Framework for Evaluation of SFX Generation

    Jul 10, 2026Mélodie Desbos, Yara Bahram, Eric Granger +1Speech Generation EvaluationAudio Editing

    LIVIA, Dept. of Systems Engineering, ETS Montréal, Canada

  5. MMGenre: Benchmarking Singing Voice Synthesis across Multiple Musical Genres

    Jul 8, 2026Wenhao Feng, Yuxun Tang, Jiatong Shi +1Singing Voice SynthesisAudio Generation

  6. DELTA-TTS: Adapting Autoregressive Model into Diffusion Language Model for Text-to-Speech

    Jul 5, 2026Junwon Moon, Seungbeom Kim, Yejin Lee +4TTS SynthesisDiffusion Model Fine-Tuning

    1Sungkyunkwan University · University of Seoul

  7. An Efficient vLLM-Based Inference Pipeline for Unified Audio Understanding and Generation

    Jul 2, 2026Haoran Wang, Jinchuan Tian, Siddhant Arora +1Audio UnderstandingSpeech Language Models

    Carnegie Mellon University

  8. A Text-Steerable Instrument for Sketching Procedural Soundscapes via Language Models

    Jul 1, 2026Prabal GuptaText-to-Music GenerationControllable Music Generation

    Rama Labs, Kitchener, Canada · Rama Labs Kitchener, Ontario, Canada

  9. Predicting Timbre Traits for Interpretable Assessment of Musical Sound Synthesizers

    Jun 29, 2026Théo Chasle Cauchy, Modan Tailleur, Lindsey Reymore +2Music Generation EvaluationMusic Information Retrieval

    Nantes Université, École Centrale Nantes, CNRS, LS2N, UMR 6004, F-44000 Nantes, France · Arizona State University, School of Music, Dance and Theatre, Tempe, AZ, USA · Arturia, Montbonnot Saint-Martin, France

  10. AudioCALM: Continuous Autoregressive Language Modeling for Universal Audio Generation

    Jun 22, 2026Huadai Liu, Kaicheng Luo, Wen Wang +4Text-to-Audio GenerationFlow-Based Generative Modeling

    Hong Kong University of Science and Technology (HKUST) · Tongyi Fun Team, Alibaba Group

  11. Gradient-Based Learning of Parametric Engine Sound Representations for Real-Time Resynthesis and Tuning on Embedded Systems

    Jun 19, 2026Robin Doerfler, Matthieu Kuntz, Clemens ZimmerAudio Representation LearningAudio Generation

    Impulse Audio Lab GmbH Munich, Germany

  12. Bagpiper-Edit: Zero-Shot Open-Ended Audio Editing via Rich-Caption

    Jun 19, 2026Xun Gong, Jinchuan Tian, Haoran Wang +3Audio EditingAudio Generation

    Auditory Cognition and Computational Acoustics Lab, Shanghai Jiao Tong University, Shanghai, China · Language Technologies Institute, Carnegie Mellon University

  13. Reference-Driven Multi-Speaker Audio Scene Generation from In-the-Wild Priors

    Jun 17, 2026Michael Finkelson, Daniel Segal, Eitan Richardson +7TTS SynthesisControllable Speech Generation

    1Lightricks · 2Tel Aviv University

  14. Unified Audio Generation and Editing via Joint Condition Modeling and Progressive Training

    Jun 15, 2026Haocheng Dong, Yuheng Lu, Cheng Gong +3Text-to-Audio GenerationAudio Editing

    Department of Electronic Engineering and Information Science, University of Science and Technology of China, China · Institute of Artificial Intelligence of China Telecom (TeleAI), China · Tianjin Key Laboratory of Cognitive Computing and Application, School of Artificial Intelligence, Tianjin University, China

  15. FreeSonic: Training-Free Temporal-Aware Decoupled Attention for Precise Audio Editing

    Jun 13, 2026Yuxuan Jiang, Mingyang Han, Yusheng Dai +12Audio EditingAudio Diffusion Models

    Tsinghua University, China · Alibaba Group, China · Monash University, Australia +2

  16. AUDEDIT: Inversion-Free Text-Guided Editing with Pretrained Audio Flow Models

    Jun 13, 2026Zhongyuan FuAudio EditingAudio Generation

    College of Computer Science Nankai University

  17. FoleyGenEx: Unified Video-to-Audio Generation with Multi-Modal Control, Temporal Alignment, and Semantic Precision

    Jun 12, 2026Shiyao Wang, Xijuan Zeng, Hui Wang +4Audio-Video GenerationAudio-Visual Synchronization

    Academy for Advanced Interdisciplinary Studies, Nankai University, Tianjin, China · Kling Team, Kuaishou Technology, Beijing, China

  18. Vocal Identity Under Siege by AI Voice Cloning Technologies

    Jun 11, 2026Jyh-An Lee, Xuan SunAudio GenerationVoice Cloning

    Professor and Executive Director, Centre for Legal Innovation and Digital Society (CLINDS), The Chinese University of Hong Kong Faculty of Law. · PhD Candidate, The Chinese University of Hong Kong Faculty of Law.

  19. AudioX-Turbo: A Unified Framework for Efficient Anything-to-Audio Generation

    Jun 10, 2026Zeyue Tian, Lei Ke, Zhaoyang Liu +8Text-to-Audio GenerationDiffusion Model Distillation

    The Hong Kong University of Science and Technology · Noiz AI · Tsinghua University +1

  20. Quality-Diversity Search in Sound Generation: Investigating Innovation Engines for Audio Exploration

    Jun 8, 2026Björn Þór Jónsson, Çağrı Erdem, Stefano Fasciani +1Evolutionary OptimizationQuality-Diversity Optimization

    1*Department of Informatics, University of Oslo, Norway. · Department of Musicology, University of Oslo, Norway.

  21. Audio-Oscar: A Multi-Agent System for Complex Audio Scene Generation, Orchestration, and Refinement

    Jun 5, 2026Yifan Duan, Qixiang Xu, Hengtao Wu +6Text-to-Audio GenerationAudio Generation

    1MoE Key Lab of Artificial Intelligence, X-LANCE Lab, Shanghai Jiao Tong University · 2Shanghai Innovation Institute · 3Shanghai AI Laboratory +2

  22. VoxCPM2 Technical Report

    Jun 5, 2026Yixuan Zhou, Guoyang Zeng, Xin Liu +15Speech Foundation ModelsControllable Speech Generation

    VoxCPM Team

  23. F3-Tokenizer: Taming Audio Autoencoder Latents for Understanding and Generation

    Jun 4, 2026Dinghao Zhou, Xingchen Song, Di Wu +3Audio Representation LearningAutoencoders

    2WeNet Open Source Community · ∗Equal contribution · 1Nanjing University, China

  24. UniVoice: A Unified Model for Speech and Singing Voice Generation

    Jun 4, 2026Junjie Zheng, Huixin Xue, Shihong Ren +3Singing Voice SynthesisTTS Synthesis

    1Giant Network · 2Shanghai Conservatory of Music

  25. Foley-Omni: A Unified Multimodal Generation Model from Task-Level Audio Synthesis to Complete Video Soundtrack Generation

    Jun 2, 2026Ye Tao, Lupeng Liu, Xuenan Xu +6Audio-Video GenerationUnified Multimodal Models

    School of Intelligence Science and Technology, Nanjing University · Video Rebirth · Shanghai Jiao Tong University +2

  26. WavTTS: Towards High-Quality Zero-Shot TTS via Direct Raw Waveform Modeling

    Jun 2, 2026Wenxi Chen, Dongya Jia, Yushen Chen +11TTS SynthesisAudio Diffusion Models

    Shanghai Jiao Tong University · Shanghai Innovation Institute · ByteDance Seed

  27. C2GA: A Class-Controllable Generative Augmentation Framework for Respiratory Sound Classification

    Jun 1, 2026Ziqi Ma, Mengyu Han, Anteng Cai +4Synthetic Data AugmentationAudio Classification

    aSchool of Computer Engineering and Science, Shanghai University, Shanghai, 200444, China · bSchool of AI and Advanced Computing (AIAC), XJTLU Entrepreneur College (Taicang), Xi’an Jiaotong-Liverpool University, Taicang, Suzhou, 215400, China · cISIR, Osaka University, Suita, 567-0047, Osaka, Japan

  28. JenBridge: Adaptive Long-Form Video Soundtracking across Scene Transitions

    Jun 1, 2026Jiashuo Yu, Yao Yao, Boyu Chen +1Audio-Video GenerationAudio-Visual Alignment

    Jen Music AI

  29. UniVocal: Unified Speech-Singing Code-Switching Synthesis

    Jun 1, 2026Yufei Shi, Qian Chen, Wen Wang +3Singing Voice SynthesisTTS Synthesis

    Tongyi Fun Team, Alibaba Group

  30. Quality Audio Prototyping: a prototype system for unified sound retrieval and procedural generation

    May 30, 2026Nelly Garcia, Aditya Bhattacharjee, Gabryel Mason-Williams +3Audio Generation

    Queen Mary University of London, King’s College of London London, UK