Audio Diffusion Models

Follow this topic Ask about this topic

Momentum

5 papers in the last four weeks, against 2 the four weeks before. 0.0% of all new papers.

Jul 13Week of Sep 28

Latest papers 63

All topics

Improving Text-to-Music Generation with Human Preference Rewards
Jun 19, 2026Yonghyun Kim, Junwon Lee, Haiwen Xia +2Text-to-Music Generation Audio Diffusion Models
Georgia Tech · KAIST · Peking University +2
How Do Instructions Shape Speech? Cross-Attention Attribution for Style-Captioned Text-to-Speech
Jun 18, 2026Nityanand Mathur, Hamees Sayed, Wasim Madha +4TTS Synthesis Audio Diffusion Models
Repurposing a Speech Classifier for Guided Diffusion-Based Speech Generation
Jun 18, 2026Rostislav Makarov, Timo GerkmannDiffusion Model Guidance Audio Diffusion Models
University of Hamburg, Germany
RFM-Editing 2: Text-Guided Audio Editing with Rectified Flow Matching and Coarse-to-Fine Diffusion Transformers
Jun 18, 2026Liting Gao, Yonggang Zhu, Yaru Chen +5Diffusion Transformer Audio Editing
Centre for Vision, Speech and Signal Processing (CVSSP), University of Surrey, Guildford GU2 7XH, U.K. · School of Artificial Intelligence, Beijing University of Posts and Telecommunications, Beijing, China · Fisheries College, Ocean University of China, Qingdao, China +1
AdaTT: Text-Guided Instrument Timbre Transfer with Target-Adaptive Structural Control
Jun 14, 2026Dabin Kim, Junwon Lee, Juhan NamControllable Music Generation Audio Diffusion Models
Graduate School of Cultural Technology and 2Graduate School of AI, KAIST, South Korea
FreeSonic: Training-Free Temporal-Aware Decoupled Attention for Precise Audio Editing
Jun 13, 2026Yuxuan Jiang, Mingyang Han, Yusheng Dai +12Audio Editing Audio Diffusion Models
Tsinghua University, China · Alibaba Group, China · Monash University, Australia +2
Inside the Latent Flow: Causal Deciphering of Attention Dynamics in Audio Separation Foundation Models
Jun 8, 2026Yuxuan Chen, Haoyuan Yu, Peize HeCross-Attention Audio Diffusion Models
Jilin University · Hunan University · University of Electronic Science and Technology of China
MeanVC 2: Robust Low-Latency Streaming Zero-Shot Voice Conversion
Jun 8, 2026Guobin Ma, Yuxuan Xia, Yuepeng Jiang +6Diffusion Transformer Audio Diffusion Models
The University of New South Wales, Australia · WeNet Open Source Community, China
Making the Most of Limited Data: Score-Aware Training for Text-to-Music Generation
Jun 5, 2026Yun-Chen Cheng, Tzu-Hung Huang, Chih-Pin TanText-to-Music Generation Audio Diffusion Models
Graduate Institute of Communication Engineering, National Taiwan University, Taipei, Taiwan
DirectAudioEdit: Inversion-Free Text-Guided Audio Editing via Diffusion Prediction Contrast
Jun 5, 2026Zhengkun Ge, Xiaoqian Liu, Haoran Zhang +5Audio Editing Audio Diffusion Models
School of Computer Science and Engineering, Northeastern University, Shenyang, China · Kunming University of Science and Technology · NiuTrans Research, Shenyang, China
TargetSEC: Plug-and-Play In-the-Wild Speech Emotion Conversion via Arousal-Conditioned Latent Style Diffusion
Jun 5, 2026Constantin Alexander AugaLatent Diffusion Models Audio Diffusion Models
Hasso Plattner Institute / University of Potsdam, Potsdam, Germany
Entropy as a Structural Prior: How a Log-Barrier on DiT Belief Space Drives Musical Diversity and Development
Jun 5, 2026Zixi Li, Youzhen LiText-to-Music Generation Diffusion Transformer
Sun Yat-sen University · Datawhale
WavTTS: Towards High-Quality Zero-Shot TTS via Direct Raw Waveform Modeling
Jun 2, 2026Wenxi Chen, Dongya Jia, Yushen Chen +11TTS Synthesis Audio Diffusion Models
Shanghai Jiao Tong University · Shanghai Innovation Institute · ByteDance Seed
Diffusion-Based Heart Sound Generation: Evaluation with Physiological Signal Metrics, Classifiers, and Expert Listening
Jun 1, 2026Xinqi Bao, Jia Bi, Xin Chen +2Audio Diffusion Models Conditional Diffusion Models
Department of Information Science & Engineering, KTH Royal Institute of Technology, Stockholm, 114 28 Sweden · Karolinska Institutet (KI), Stockholm, Sweden · Rutherford Appleton Laboratory, United Kingdom +2
AnchorSteer: Self-Discovered Concept Injection for Structure-Preserving Music Editing
May 29, 2026Chih-Heng Chang, Keng-Seng Ho, Chih-Yu Tsai +3Audio Editing Controllable Music Generation
National Taiwan University Taipei, Taiwan
DEMON: Diffusion Engine for Musical Orchestrated Noise
May 27, 2026Ryan FosdickControllable Music Generation Audio Diffusion Models
Daydream
Live Music Diffusion Models: Efficient Fine-Tuning and Post-Training of Interactive Diffusion Music Generators
May 21, 2026Zachary Novack, Stephen Brade, Haven Kim +8Diffusion Model Alignment Controllable Music Generation
UC San Diego · MIT · Adobe
DUET: Unified Dual-Space Emotion Control for Diffusion and Flow-Matching Driven Text-to-Speech
May 20, 2026Xu Zhang, Longbing Cao, Zhangkai WuTTS Synthesis Audio Diffusion Models
Frontier AI Research Centre, Macquarie University, Sydney, NSW, Australia
A Survey of Advancing Audio Super-Resolution and Bandwidth Extension from Discriminative to Generative Models
May 15, 2026Ningyuan Yang, Yize Li, Diego A. Cuji +4Audio Diffusion Models Conditional Generative Modeling
Department of Electrical and Computer Engineering Stony Brook University · Department of Electrical and Computer Engineering Northeastern University · Department of Electrical and Computer Engineering University of Illinois Chicago & Discovery Partners Institute
A Cold Diffusion Approach for Percussive Dereverberation
May 11, 2026Dimos Makris, András Barják, Maximos Kaliakatsos-PapakostasAudio Diffusion Models
Department of Music Technology and Acoustics Hellenic Mediterranean University Rethymno, Greece · XLN Audio Stockholm, Sweden
Polyphonia: Zero-Shot Timbre Transfer in Polyphonic Music with Acoustic-Informed Attention Calibration
May 11, 2026Haowen Li, Tianxiang Li, Yi Yang +2Audio Editing Controllable Music Generation
School of Future Technology, South China University of Technology, Guangzhou, China
PoDAR: Power-Disentangled Audio Representation for Generative Modeling
May 11, 2026Alejandro Luebs, Mithilesh Vaidya, Ishaan Kumar +5Audio Representation Learning Latent Diffusion Models
Descript
Remix the Timbre: Diffusion-Based Style Transfer Across Polyphonic Stems
May 10, 2026Leduo Chen, Junchuan Zhao, Shengchen LiDiffusion Transformer Controllable Music Generation
XJTLU
Stage-adaptive audio diffusion modeling
May 6, 2026Xuanhao Zhang, Chang LiText-to-Audio Generation Diffusion Model Guidance
China Pharmaceutical University · University of Science and Technology of China
DiffAnon: Diffusion-based Prosody Control for Voice Anonymization
Apr 29, 2026Ismail Rasim Ulgen, Zexin Cai, Nicholas Andrews +2Audio Diffusion Models Speech Prosody
Center for Language and Speech Processing, Johns Hopkins University, USA · Human Language Technology Center of Excellence (COE), Johns Hopkins University, USA
Latent Fourier Transform
Apr 20, 2026Mason Wang, Cheng-Zhi Anna HuangControllable Music Generation Frequency-Domain Feature Learning
CSAIL
Video-Robin: Autoregressive Diffusion Planning for Intent-Grounded Video-to-Music Generation
Apr 19, 2026Vaibhavi Lokegaonkar, Aryan Vijay Bhosale, Vishnu Raj +5Controllable Music Generation Audio Diffusion Models
University of Maryland College Park, USA · Dolby Laboratories, USA · NVIDIA, USA
DialogueSidon: Recovering Full-Duplex Dialogue Tracks from In-the-Wild Dialogue Audio
Apr 10, 2026Wataru Nakata, Yuki Saito, Kazuki Yamauchi +2Audio Diffusion Models Speech Processing
The University of Tokyo, Tokyo, Japan · National Institute of Advanced Industrial Science and Technology (AIST), Tokyo, Japan
YingMusic-Singer: Controllable Singing Voice Synthesis with Flexible Lyric Manipulation and Annotation-free Melody Guidance
Mar 25, 2026Chunbo Hao, Junjie Zheng, Guobin Ma +6Singing Voice Synthesis Controllable Music Generation
AI Lab, Giant Network, China
Controllable Accent Normalization via Discrete Diffusion
Mar 15, 2026Qibing Bai, Yuhan Du, Tom Ko +3Audio Diffusion Models Speech Processing
SDS, 2 SAI, and 3 SRIBD, The Chinese University of Hong Kong, Shenzhen, China · School of Intelligence Science and Technology, Nanjing University, Suzhou, China · Shenzhen Loop Area Institute, Shenzhen, China +2

Jun 19, 2026, cs.SDJ/K move · Enter open · S save

Improving Text-to-Music Generation with Human Preference Rewards

Yonghyun Kim, Junwon Lee, Haiwen Xia, Yinghao Ma+1

Georgia Tech · KAIST · Peking University+2

Text-to-Music Generation Audio Diffusion Models

Open paper AskPDF arXiv

We describe our entry to the efficiency track of the Academic Text-to-Music (ATTM) Grand Challenge at ICME 2026. Beyond the challenge protocol's FAD-CLAP and CLAP score, we add a learned human-preference reward from TuneJury, a twin pairwise ranker trained over open music-preference datasets. The reward serves both as a training-time conditioning signal and as a sample-selection criterion. The pipeline combines five engineering decisions on a 120M-parameter FluxAudio-S backbone, four at training time and one at inference: (i) training-time reward conditioning that doubles as an inference-time CFG axis, (ii) a sweep over five score-conditioning architectures, where training and inference use different variants, (iii) expert iteration on the top decile, (iv) a short preference-tuning pass (CRPO) for audio-text alignment, and (v) inference post-processing via joint CFG, source separation, and loudness normalization. Per-stage decomposition on 100 Song Describer prompts shows training-time reward conditioning as a functional conditioning axis, expert iteration as the dominant contributor, the preference-tuning pass adding only noise-level gain, and the inference-time score scalar already saturated by the end of the chain.

Momentum

Related topics

Latest papers 63