Overview

Text-to-audio generation studies how to turn written prompts into speech, music, sound effects, and layered soundscapes. Common approaches use latent diffusion or flow matching, often with semantic audio representations; autoregressive models and language-model planning are also used to organize events and support longer or more complex outputs. Researchers are working to improve prompt adherence, temporal order, and control of specific sounds, while evaluation increasingly examines individual events and attributes rather than relying only on global similarity scores. A central challenge is balancing faithful, controllable generation with diversity, high audio quality, and efficient inference.

Latest papers

CardsList

48 papers4 papers in the last four weeks, up 33% on the four weeks before. 0.0% of all new papers.

  1. CoTTAGE: An Explainable Judge for Text-to-Audio Generation

    Nov 13, 2026Yu-Xiang Lin, Yun-Man Hsu, Bo-Ru Lu +11audio quality assessmentText-to-Audio Generation

  2. AUTEUR: Acoustic Plan Learning for Red-Teaming Text-to-Audio Models

    Nov 6, 2026Jiashu Zhang, Jiaming He, Zheming Zhang +4Text-to-Audio Generation

  3. Rel2Traj: Inter-Source Relation-Aware Trajectory Generation for Text-To-Spatial-Audio

    Oct 31, 2026Yihang Bao, Lingfeng Yao, Shengyao Wang +3Spatial AudioTrajectory Generation

  4. MFlowAudio: Efficient Text-to-Audio Synthesis via Mamba-based Stateful Flow Matching

    Oct 30, 2026Hao Dai, Panyu Chen, Jagmohan ChauhanText-to-Audio GenerationAudio Generation

  5. PLACE: Positional Latent Adaptation via Conditioned Embeddings for Binaural Audio Generation

    Sep 30, 2026Tiernon Riesenmy, You Zhang, Gautam Bhattacharya +1Text-to-Audio GenerationAudio-Video Generation

  6. TinyAudio: Compact and Efficient Text-to-Audio Generation for Low-Resource Deployment

    Sep 25, 2026Junxi Liu, Xiquan Li, Wenhao Guan +5Text-to-Audio Generation

  7. UNITE-AUDIO: Joint Learning of Continuous Tokenization and Latent Flow Matching for Text-to-Audio Generation

    Sep 23, 2026Runwu Shi, Kai Li, Yujin Wang +8Text-to-Audio GenerationAudio Representation Learning

  8. PhysWave: Physics-Guided Latent Diffusion Models for Controllable Spatial Audio Generation

    Aug 30, 2026Lingfeng Yao, Chenpei Huang, Xingke Yang +5Spatial AudioText-to-Audio Generation

  9. VoxAudio: Vocalized Audio Synthesis via Multi-Reward Autoregressive Flow Matching

    Aug 13, 2026Wenxiang Guo, Changhao Pan, Ziyue Jiang +2Text-to-Audio GenerationPreference Optimization

  10. MiDashengLM-Gen: Unified Audio Scene Generation via LLM-Driven Autoregressive Flow Matching

    Aug 12, 2026Xingwei Sun, Heinrich Dinkel, Gang Li +7Text-to-Audio GenerationAutoregressive Generation

  11. SonicWeave: Chunk-Routed Mixture-of-Experts for Unified Audio Scene Generation

    Aug 10, 2026Yunrui Cai, Xu Li, Yucheng Zhou +8Text-to-Audio GenerationMixture-of-Experts Models

  12. AudioScape-TTA: A Structured Soundscape Benchmark for Fine-Grained Text-to-Audio Evaluation

    Aug 5, 2026Jinting Wang, Yuguang Yang, Shengyu Li +4Text-to-Audio GenerationRubric-Based Evaluation

  13. AI-Based Sound Effect Generation: A Narrative Review of Generative Models Across Input Modalities

    Aug 4, 2026Sandy Abdo, Bill Kapralos, Priyamvada Tripathi +2Text-to-Audio GenerationSound Effects Generation

  14. Efficient Text-to-Audio Generation via Pruning

    Jul 14, 2026Arshdeep Singh, Yi Yuan, Yun Chen +2Text-to-Audio GenerationLatent Diffusion Models

  15. BackgroundMellow: A Multi-Modal Cohesive Framework for Narrative-Driven Rich Cinematic Soundscape Generation

    Jul 13, 2026Ajitesh Jamulkar, Aritra HazraText-to-Audio GenerationAudio Editing

  16. FdAudio: MeanFlow-Anchored Fréchet-Distance Post-Training for One-Step Text-to-Audio Generation

    Jul 11, 2026Kuan-Po Huang, Bo-Ru Lu, Ho-Lam Chung +2Text-to-Audio GenerationFlow Matching

  17. A Quantized Native Runtime for On-Device Semantic Audio Generation

    Jul 9, 2026Matteo Spanio, Antonio RodàText-to-Audio GenerationControllable Music Generation

  18. SwiftAudio: Data-Efficient Caption-Only Distillation for One-Step Text-to-Audio Diffusion-based Generation

    Jun 30, 2026Binh Mai, Tran Quoc Bao Le, Hung Dinh +1Text-to-Audio GenerationDiffusion Model Distillation

  19. AudioCALM: Continuous Autoregressive Language Modeling for Universal Audio Generation

    Jun 22, 2026Huadai Liu, Kaicheng Luo, Wen Wang +4Text-to-Audio GenerationFlow-Based Generative Modeling

  20. STAR-VAE: Structured Topology-Aware Regularization for Audio Reconstruction and Generation

    Jun 22, 2026Huadai Liu, Wen Wang, Kaicheng Luo +3Variational AutoencodersText-to-Audio Generation

  21. InstructFX2FX: A Multi-Turn Text-to-Effect System for Sequential Audio Effect Refinement

    Jun 20, 2026Song-Ze Yu, Milan Liessens Dujardin, Yuxuan Cai +4Text-to-Audio GenerationLarge Language Model-Guided Optimization

  22. Unified Audio Generation and Editing via Joint Condition Modeling and Progressive Training

    Jun 15, 2026Haocheng Dong, Yuheng Lu, Cheng Gong +3Text-to-Audio GenerationAudio Editing

  23. AudioX-Turbo: A Unified Framework for Efficient Anything-to-Audio Generation

    Jun 10, 2026Zeyue Tian, Lei Ke, Zhaoyang Liu +8Text-to-Audio GenerationDiffusion Model Distillation

  24. Audio-Oscar: A Multi-Agent System for Complex Audio Scene Generation, Orchestration, and Refinement

    Jun 5, 2026Yifan Duan, Qixiang Xu, Hengtao Wu +6Text-to-Audio GenerationAudio Generation

  25. UNISON: A Unified Sound Generation and Editing Framework via Deep LLM Fusion

    May 29, 2026Zhaoqing Li, Haoning Xu, Jingran Su +9Text-to-Audio GenerationTTS Synthesis