Audio Generation

Ask about this topic

Momentum

9 papers in the last four weeks, up 80% on the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 95

All topics
CardsList

  1. WorldSonus: Bringing Sound to Worlds

    Oct 6, 2026Pengjun Fang, Jingyi Fa, Kam Man Wu +9Audio-Video GenerationAudio Diffusion Models

    The Hong Kong University of Science and Technology · Noiz AI · MetaX +1

  2. Empirical Variational Autoencoder

    Oct 5, 2026Kaede ShioharaVariational AutoencodersLatent Variable Models

    The University of Tokyo

  3. Smorph: Playable Sound Morphing with Diffusion Models

    Oct 5, 2026Annie Chu, Hugo Flores García, Johannes Imort +5Diffusion Model GuidanceAudio Editing

    Northwestern University, Evanston, IL, USA · Adobe Research, San Francisco, CA, USA · Wizdom Music, New York, NY, USA

  4. Relational Synthesis: Structure-Mediated Concatenative Synthesis for Foley and Retrieval-Augmented Audio Generation

    Oct 5, 2026Keren Shao, Ayaka Kawano, Shlomo DubnovSound Effects GenerationAudio Generation

    University of California San Diego, La Jolla, CA, USA

  5. AudioGAR: Bridging Reconstruction and Generation in Latent Audio Generative Models

    Oct 5, 2026Xianghong Fang, Geeyang Tay, Wentao Ma +2Neural Audio CodecsAudio Diffusion Models

    University of Toronto · Vijil

  6. Game Sound-Effect Completion with Event-Level Transformation Hints

    Sep 30, 2026Xinrui Jiang, Heng YuAudio EditingAudio Diffusion Models

    Department of Electrical Engineering Stanford University · Department of Computer Science Stanford University

  7. Audible World Models: Spatially Aware Sound Generation for 3D Worlds

    Sep 29, 2026Duowen Chen, Jinjin He, Gouthaman KV +2Sound Effects Generation3D Scene Generation

    Georgia Institute of Technology · Dolby Laboratories

  8. YuE2: Unifying Symbolic and Audio Music Generation at Frontier Quality

    Sep 27, 2026Ruibin Yuan, Jiahao Pan, Junyan Jiang +32Audio Representation LearningControllable Music Generation

    HKUST HKGAI M-A-P Tokenwave.AI New York University Stanford University MBZUAI ACE Studio

  9. Fast Time-Varying Exponentiated Convolution Methods for Generative Direction Dependent Reverberation

    Sep 21, 2026Yuancheng LuoSynthetic Data GenerationSpatial Audio

    NuSpace Audio, Cambridge, MA, USA

  10. Generating the Unheard: Phylogeny-Guided Latent Generation for Ancestral Sound Reconstruction

    Sep 14, 2026Tianyi Xu, Shrinaath Narasimhan, Evan Gorstein +3BioacousticsAudio Generation

    University of Wisconsin–Madison · 2Massachusetts Institute of Technology

  11. StepAudio 3 Gen Technical Report

    Sep 14, 2026Bin Lin, Bo Zhao, Boyang Wang +68TTS SynthesisZero-Shot TTS

  12. PhaseGAN: High-Fidelity Vocoder via Decoupled Amplitude and GAN-Driven Phase Reconstruction

    Sep 14, 2026Wenzheng Zhang, Xueliang Zhang, Shulin He +7Speech ProcessingAudio Generation

    College of Computer Science, Inner Mongolia University, China

  13. Learned Continuous Synthesis of Quadratic Difference Tone Spectra

    Sep 11, 2026Esteban Gutiérrez, Behzad Haki, Christopher Haworth +2Music GenerationAudio Generation

    Department of Information and Communications Technologies Universitat Pompeu Fabra · Independent Researcher Barcelona, Spain · Department of Music University of Birmingham +1

  14. Preference Optimization with LALM Feedback for Continuous Autoregressive Non-Verbal Vocalization Generation

    Sep 10, 2026Jingbin Hu, Qirui Zhan, Yuang Cao +7Direct Preference OptimizationControllable Speech Generation

    Shenzhen Pimei Technology Co., Ltd., Guangdong, China · Yutu Zhineng, Beijing, China · State Key Laboratory of Novel Software Technology, Nanjing University, Nanjing, China +1

  15. VoxAudio: Vocalized Audio Synthesis via Multi-Reward Autoregressive Flow Matching

    Aug 13, 2026Wenxiang Guo, Changhao Pan, Ziyue Jiang +2Text-to-Audio GenerationPreference Optimization

    Zhejiang University, Hangzhou, China

  16. MiDashengLM-Gen: Unified Audio Scene Generation via LLM-Driven Autoregressive Flow Matching

    Aug 12, 2026Xingwei Sun, Heinrich Dinkel, Gang Li +7Text-to-Audio GenerationAutoregressive Generation

    MiLM Plus, Xiaomi Inc., Beijing, China · X-LANCE Lab, Shanghai Jiao Tong University, Shanghai, China

  17. Monophonic Audio Synthesizer Using FPGAs

    Aug 10, 2026Michael Smith, D. G. PereraAudio Generation

    Department of Electrical and Computer Engineering, University of Colorado Colorado Springs, Colorado Springs, Colorado, USA

  18. SonicWeave: Chunk-Routed Mixture-of-Experts for Unified Audio Scene Generation

    Aug 10, 2026Yunrui Cai, Xu Li, Yucheng Zhou +8Text-to-Audio GenerationMixture-of-Experts Models

    Kling Team, Kuaishou Technology · The Chinese University of Hong Kong · Shenzhen International Graduate School, Tsinghua University

  19. RAG-Audio: Retrieval-Augmented Generation for Faithful Brain-to-Audio Reconstruction

    Aug 10, 2026Ambuj Mehrish, Sebastiano VasconNeural DecodingMusic Generation

    CVML Lab · Ca’ Foscari University of Venice

  20. VIOLET: High-Fidelity Violin Synthesis with Techniques and Dynamics

    Aug 8, 2026Baotong Tian, Cynthia Lu, Vincent K. M. Cheung +3Controllable Music GenerationAudio Generation

    University of Rochester, USA · Sony Computer Science Laboratories, Tokyo, Japan · National Taiwan University, Taiwan +1

  21. SemBridge: Semantic Token Anchoring for Continuous-Latent Autoregressive Speech Generation

    Aug 7, 2026Hanke Xie, Haopeng Lin, Jiale Qian +13Zero-Shot TTSAutoregressive Generation

    Soul AI Lab, China

  22. MMAG: A Multi-Control Mixed Audio Generation Benchmark

    Aug 7, 2026Zihao Zheng, Xuenan Xu, Jiahao Mei +5Speech Generation EvaluationAudio Generation

    MoE Key Lab of Artificial Intelligence, X-LANCE Lab, Shanghai Jiao Tong University, China · Shanghai AI Lab, China

  23. AI-Based Sound Effect Generation: A Narrative Review of Generative Models Across Input Modalities

    Aug 4, 2026Sandy Abdo, Bill Kapralos, Priyamvada Tripathi +2Text-to-Audio GenerationSound Effects Generation

    Ontario Tech University, Oshawa, ON, Canada · Durham College, Oshawa, ON, Canada · Carleton University, Ottawa, ON, Canada

  24. CLASVS: Continuous-Latent Autoregression for Melody-Preserving Lyric Editing in Singing Voice Synthesis

    Aug 4, 2026Yizhong Geng, Tian-Hao Zhang, Chunfeng Wang +7Singing Voice SynthesisAudio Editing

    Beijing University of Posts and Telecommunications, Beijing, China · Li Auto Inc., Beijing, China · Tsinghua University, Beijing, China

  25. SwanTale: Unified Multi-Speaker Speech and Audio Generation for Instruct and Zero-Shot Tasks

    Aug 3, 2026Yu Zhang, Ruiqi Li, Changhao Pan +3Text-to-Audio GenerationTTS Synthesis

    1ByteDance · 2Zhejiang University

  26. Multi-Backbone Self-Supervised Ensembles for Audio Deepfake Detection and a Cross-Track Analysis of Generation-Detection Asymmetry

    Aug 3, 2026Seunghyun Kim, Junghyun Kim, Jiyoung WooAudio Deepfake DetectionDeep Ensembles

    Soonchunhyang University, Department of AI and Big Data Engineering, Asan, Republic of Korea

  27. Scene2Sound: Auditory-Grounded Soundscape Generation for 3D Gaussian Worlds

    Aug 1, 2026Masaki Yoshida, Ren Togo, Takahiro Ogawa +1Spatial AudioAudio Generation

    Hokkaido University

  28. Stable Autoregressive Speech Generation with Low-Frame-Rate High-Dimensional Continuous Tokens

    Jul 31, 2026Yi Luo, Rongzhi Gu, Jixun YaoFlow MatchingAudio Representation Learning

    ByteDance Seed · Work done during an internship at ByteDance Seed.

  29. VocalRender: Score-Native Singing Voice Synthesis for Real-World Composition

    Jul 30, 2026Yukun Chen, Tianrui Wang, Zhaoxi Mu +2Singing Voice SynthesisAudio Diffusion Models

    Xi’an Jiaotong University · Nanyang Technological University · Ant Group +1

  30. SoundscapeAgent: Agentic Soundscape Construction for Controllable Synthesis and Scalable Audio-Language Supervision

    Jul 23, 2026Hao Zhang, Yiwen Zhao, Yixuan Zhang +2Tool-Augmented Language Model AgentsAudio Generation

    Wuhan University, Wuhan, China · Tencent Hunyuan, Bellevue, WA, USA

  31. Improving Text-to-Audio Instruction Following via Fine-Grained Feedback from Audio-Aware Large Language Models

    Jul 15, 2026Chun-Yi Kuan, Siwon Kim, Byeonggeun Kim +7Audio-Language Model EvaluationText-to-Audio Generation

    National Taiwan University, Taiwan · Amazon, USA

  32. Adapting Diffusion-Based Music Synthesis to Speech and Singing Voice Conversion

    Jul 14, 2026Ben Maman, Frank Zalkow, Hans-Ulrich Berendes +3Audio Diffusion ModelsAudio Generation

    International Audio Laboratories Erlangen, Germany · Fraunhofer IIS, Erlangen, Germany

  33. BackgroundMellow: A Multi-Modal Cohesive Framework for Narrative-Driven Rich Cinematic Soundscape Generation

    Jul 13, 2026Ajitesh Jamulkar, Aritra HazraText-to-Audio GenerationAudio Editing

    Department of Computer Science & Engineering, Indian Institute of Technology Kharagpur, India.

  34. A Production-Oriented Framework for Evaluation of SFX Generation

    Jul 10, 2026Mélodie Desbos, Yara Bahram, Eric Granger +1Speech Generation EvaluationAudio Editing

    LIVIA, Dept. of Systems Engineering, ETS Montréal, Canada

  35. MMGenre: Benchmarking Singing Voice Synthesis across Multiple Musical Genres

    Jul 8, 2026Wenhao Feng, Yuxun Tang, Jiatong Shi +1Singing Voice SynthesisAudio Generation

  36. DELTA-TTS: Adapting Autoregressive Model into Diffusion Language Model for Text-to-Speech

    Jul 5, 2026Junwon Moon, Seungbeom Kim, Yejin Lee +4TTS SynthesisDiffusion Model Fine-Tuning

    1Sungkyunkwan University · University of Seoul

  37. An Efficient vLLM-Based Inference Pipeline for Unified Audio Understanding and Generation

    Jul 2, 2026Haoran Wang, Jinchuan Tian, Siddhant Arora +1Audio UnderstandingSpeech Language Models

    Carnegie Mellon University

  38. A Text-Steerable Instrument for Sketching Procedural Soundscapes via Language Models

    Jul 1, 2026Prabal GuptaText-to-Music GenerationControllable Music Generation

    Rama Labs, Kitchener, Canada · Rama Labs Kitchener, Ontario, Canada

  39. Predicting Timbre Traits for Interpretable Assessment of Musical Sound Synthesizers

    Jun 29, 2026Théo Chasle Cauchy, Modan Tailleur, Lindsey Reymore +2Music Generation EvaluationMusic Information Retrieval

    Nantes Université, École Centrale Nantes, CNRS, LS2N, UMR 6004, F-44000 Nantes, France · Arizona State University, School of Music, Dance and Theatre, Tempe, AZ, USA · Arturia, Montbonnot Saint-Martin, France

  40. AudioCALM: Continuous Autoregressive Language Modeling for Universal Audio Generation

    Jun 22, 2026Huadai Liu, Kaicheng Luo, Wen Wang +4Text-to-Audio GenerationFlow-Based Generative Modeling

    Hong Kong University of Science and Technology (HKUST) · Tongyi Fun Team, Alibaba Group

  41. Gradient-Based Learning of Parametric Engine Sound Representations for Real-Time Resynthesis and Tuning on Embedded Systems

    Jun 19, 2026Robin Doerfler, Matthieu Kuntz, Clemens ZimmerAudio Representation LearningAudio Generation

    Impulse Audio Lab GmbH Munich, Germany

  42. Bagpiper-Edit: Zero-Shot Open-Ended Audio Editing via Rich-Caption

    Jun 19, 2026Xun Gong, Jinchuan Tian, Haoran Wang +3Audio EditingAudio Generation

    Auditory Cognition and Computational Acoustics Lab, Shanghai Jiao Tong University, Shanghai, China · Language Technologies Institute, Carnegie Mellon University

  43. Reference-Driven Multi-Speaker Audio Scene Generation from In-the-Wild Priors

    Jun 17, 2026Michael Finkelson, Daniel Segal, Eitan Richardson +7TTS SynthesisControllable Speech Generation

    1Lightricks · 2Tel Aviv University

  44. Unified Audio Generation and Editing via Joint Condition Modeling and Progressive Training

    Jun 15, 2026Haocheng Dong, Yuheng Lu, Cheng Gong +3Text-to-Audio GenerationAudio Editing

    Department of Electronic Engineering and Information Science, University of Science and Technology of China, China · Institute of Artificial Intelligence of China Telecom (TeleAI), China · Tianjin Key Laboratory of Cognitive Computing and Application, School of Artificial Intelligence, Tianjin University, China

  45. FreeSonic: Training-Free Temporal-Aware Decoupled Attention for Precise Audio Editing

    Jun 13, 2026Yuxuan Jiang, Mingyang Han, Yusheng Dai +12Audio EditingAudio Diffusion Models

    Tsinghua University, China · Alibaba Group, China · Monash University, Australia +2

  46. AUDEDIT: Inversion-Free Text-Guided Editing with Pretrained Audio Flow Models

    Jun 13, 2026Zhongyuan FuAudio EditingAudio Generation

    College of Computer Science Nankai University

  47. FoleyGenEx: Unified Video-to-Audio Generation with Multi-Modal Control, Temporal Alignment, and Semantic Precision

    Jun 12, 2026Shiyao Wang, Xijuan Zeng, Hui Wang +4Audio-Video GenerationAudio-Visual Synchronization

    Academy for Advanced Interdisciplinary Studies, Nankai University, Tianjin, China · Kling Team, Kuaishou Technology, Beijing, China

  48. Vocal Identity Under Siege by AI Voice Cloning Technologies

    Jun 11, 2026Jyh-An Lee, Xuan SunAudio GenerationVoice Cloning

    Professor and Executive Director, Centre for Legal Innovation and Digital Society (CLINDS), The Chinese University of Hong Kong Faculty of Law. · PhD Candidate, The Chinese University of Hong Kong Faculty of Law.

  49. AudioX-Turbo: A Unified Framework for Efficient Anything-to-Audio Generation

    Jun 10, 2026Zeyue Tian, Lei Ke, Zhaoyang Liu +8Text-to-Audio GenerationDiffusion Model Distillation

    The Hong Kong University of Science and Technology · Noiz AI · Tsinghua University +1

  50. Quality-Diversity Search in Sound Generation: Investigating Innovation Engines for Audio Exploration

    Jun 8, 2026Björn Þór Jónsson, Çağrı Erdem, Stefano Fasciani +1Evolutionary OptimizationQuality-Diversity Optimization

    1*Department of Informatics, University of Oslo, Norway. · Department of Musicology, University of Oslo, Norway.

  51. Audio-Oscar: A Multi-Agent System for Complex Audio Scene Generation, Orchestration, and Refinement

    Jun 5, 2026Yifan Duan, Qixiang Xu, Hengtao Wu +6Text-to-Audio GenerationAudio Generation

    1MoE Key Lab of Artificial Intelligence, X-LANCE Lab, Shanghai Jiao Tong University · 2Shanghai Innovation Institute · 3Shanghai AI Laboratory +2

  52. VoxCPM2 Technical Report

    Jun 5, 2026Yixuan Zhou, Guoyang Zeng, Xin Liu +15Speech Foundation ModelsControllable Speech Generation

    VoxCPM Team

  53. F3-Tokenizer: Taming Audio Autoencoder Latents for Understanding and Generation

    Jun 4, 2026Dinghao Zhou, Xingchen Song, Di Wu +3Audio Representation LearningAutoencoders

    2WeNet Open Source Community · ∗Equal contribution · 1Nanjing University, China

  54. UniVoice: A Unified Model for Speech and Singing Voice Generation

    Jun 4, 2026Junjie Zheng, Huixin Xue, Shihong Ren +3Singing Voice SynthesisTTS Synthesis

    1Giant Network · 2Shanghai Conservatory of Music

  55. Foley-Omni: A Unified Multimodal Generation Model from Task-Level Audio Synthesis to Complete Video Soundtrack Generation

    Jun 2, 2026Ye Tao, Lupeng Liu, Xuenan Xu +6Audio-Video GenerationUnified Multimodal Models

    School of Intelligence Science and Technology, Nanjing University · Video Rebirth · Shanghai Jiao Tong University +2

  56. WavTTS: Towards High-Quality Zero-Shot TTS via Direct Raw Waveform Modeling

    Jun 2, 2026Wenxi Chen, Dongya Jia, Yushen Chen +11TTS SynthesisAudio Diffusion Models

    Shanghai Jiao Tong University · Shanghai Innovation Institute · ByteDance Seed

  57. C2GA: A Class-Controllable Generative Augmentation Framework for Respiratory Sound Classification

    Jun 1, 2026Ziqi Ma, Mengyu Han, Anteng Cai +4Synthetic Data AugmentationAudio Classification

    aSchool of Computer Engineering and Science, Shanghai University, Shanghai, 200444, China · bSchool of AI and Advanced Computing (AIAC), XJTLU Entrepreneur College (Taicang), Xi’an Jiaotong-Liverpool University, Taicang, Suzhou, 215400, China · cISIR, Osaka University, Suita, 567-0047, Osaka, Japan

  58. JenBridge: Adaptive Long-Form Video Soundtracking across Scene Transitions

    Jun 1, 2026Jiashuo Yu, Yao Yao, Boyu Chen +1Audio-Video GenerationAudio-Visual Alignment

    Jen Music AI

  59. UniVocal: Unified Speech-Singing Code-Switching Synthesis

    Jun 1, 2026Yufei Shi, Qian Chen, Wen Wang +3Singing Voice SynthesisTTS Synthesis

    Tongyi Fun Team, Alibaba Group

  60. Quality Audio Prototyping: a prototype system for unified sound retrieval and procedural generation

    May 30, 2026Nelly Garcia, Aditya Bhattacharjee, Gabryel Mason-Williams +3Audio Generation

    Queen Mary University of London, King’s College of London London, UK