Controllable Music Generation

Ask about this topic

Momentum

10 papers in the last four weeks, up 43% on the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 66

All topics
CardsList

  1. Where the Body Keeps the Beat: Structured Motion Conditioning and Music Dynamics Supervision for Dance-to-Music Generation

    Sep 30, 2026Changchang Sun, Lu Cheng, Yan YanFlow MatchingLatent Dynamics Modeling

    University of Illinois Chicago · Penn State University

  2. From One-Shot Generation to Incremental Music Composition: Adapting a General-Purpose Instruction LLM for Persistent Symbolic Editing

    Sep 28, 2026André Ricardo Ducca Fernandes, Jean-Pierre Briot, Simone Diniz Junqueira Barbosa1 +1Controllable Music GenerationSymbolic Music Generation

    Department of Informatics (DI), Pontifícia Universidade Católica do Rio de Janeiro (PUC-Rio), Rio de Janeiro, RJ 22451-900, Brazil · Sorbonne Université, CNRS, LIP6, F-75005 Paris, France · CBAE, Universidade Federal do Rio de Janeiro (UFRJ), Rio de Janeiro, RJ 22250-020, Brazil

  3. YuE2: Unifying Symbolic and Audio Music Generation at Frontier Quality

    Sep 27, 2026Ruibin Yuan, Jiahao Pan, Junyan Jiang +32Audio Representation LearningControllable Music Generation

    HKUST HKGAI M-A-P Tokenwave.AI New York University Stanford University MBZUAI ACE Studio

  4. Synthesis and editing of multi-instrument audio mixtures using scalar-quantised latents with MIDI Span conditioning

    Sep 22, 2026Sungkyun Chang, Keshav Bhandari, Simon Dixon +1Audio EditingControllable Music Generation

    Centre for Digital Music, Queen Mary University of London

  5. Do Language Models Need Music Supervision? Verifiable Rewards for Multi-Constraint Symbolic Music Generation

    Sep 20, 2026Haoyue Liu, Xiaoying TangMusic Generation EvaluationControllable Music Generation

    School of Science and Engineering, The Chinese University of Hong Kong, Shenzhen 518172, China · Shenzhen Future Network of Intelligence Institute (FNii-Shenzhen)

  6. CPR: Combining global composing, local performing and full-sequence refining in piano rendering with continuous autoregressive modelling

    Sep 16, 2026Chong Jing, Junan Zhang, Zhizheng WuControllable Music GenerationMusic Generation

    The Chinese University of Hong Kong, Shenzhen

  7. SongCraft: Unified Song Generation and Editing with Reconstructive Learning

    Sep 14, 2026Haohe Liu, Varun Nagaraja, Gael Le Lan +5Text-to-Music GenerationAudio Editing

    Meta AI

  8. DiffSynth-Music: Audio-Conditioned KV-Cache Adapters for Controllable Music Generation

    Sep 14, 2026Zhongjie Duan, Shengchuan Gao, Hong Zhang +1Controllable Music GenerationAudio Diffusion Models

    Alibaba Group · Shanghai Jiao Tong University

  9. Copying Versus Randomization in Lempel-Ziv Music Synthesis

    Sep 11, 2026Nadav Mishan, Ram ZamirControllable Music GenerationSymbolic Music Generation

    Department of Electrical Engineering Tel Aviv University Tel Aviv, Israel

  10. Silent Metronome: Rhythmic Grounding for Live Music Accompaniment

    Sep 7, 2026Kevin Bretz, Derya Soydaner, Aske PlaatControllable Music GenerationMusic Generation

    Leiden Institute of Advanced Computer Science (LIACS), Leiden University, Leiden, The Netherlands

  11. Local Chord Corruption Is Not Recognizer Replay: Structure-Matched Calibration for Chord-Conditioned Generation

    Sep 3, 2026Weiwen HuangMusic Generation EvaluationControllable Music Generation

    Shenzhen University

  12. MusGU+: Toward a Musician-Centered Evaluation Framework and Discovery Tool for Generative Music AI

    Aug 31, 2026Laura Ibáñez-Martínez, Roser Batlle-Roca, Xavier Serra +1Music Generation EvaluationControllable Music Generation

    Music Technology Group Universitat Pompeu Fabra Barcelona, Spain

  13. VIBE: Video Instruction-aligned Background music gEneration

    Aug 31, 2026Aryan Vijay Bhosale, Vaibhavi Lokegaonkar, Vishnu Raj +5Controllable Music GenerationMusic Generation

    University of Maryland, College Park, USA · Dolby Laboratories, USA

  14. How Well Do Generative Music Models Follow Emotion Conditioning?

    Aug 30, 2026Morteza HeydariText-to-Music GenerationMusic Generation Evaluation

    Istinye University, Graduate School, Istanbul, Turkey

  15. Drive-to-Music: Context-Aware Generative Audio for In-Vehicle Experiences

    Aug 12, 2026Cosmin Dragoiu, Nooshin NabizadehControllable Music GenerationMusic Generation

    Mercedes-Benz Research & Development North America

  16. Do Text-to-Music Models Really Follow Instructions? A Counterfactual Evaluation of Key and Beat Grouping

    Aug 12, 2026Yining WangText-to-Music GenerationMusic Generation Evaluation

    Bilibili Inc.

  17. MazzikaAI: A knowledge-based performance-to-prompt compiler for real-time Arabic maqam accompaniment with a streaming text-to-music model

    Aug 11, 2026Jiaxin Du, Boulbaba Abdeljaouad, Yong Zhuang +1Text-to-Music GenerationPrompt Learning

    aGrand Valley State University, Allendale, MI, USA

  18. VIOLET: High-Fidelity Violin Synthesis with Techniques and Dynamics

    Aug 8, 2026Baotong Tian, Cynthia Lu, Vincent K. M. Cheung +3Controllable Music GenerationAudio Generation

    University of Rochester, USA · Sony Computer Science Laboratories, Tokyo, Japan · National Taiwan University, Taiwan +1

  19. MI-MIDI: Mechanistic Interpretability of Text-to-MIDI Generation Models via Probing, Lenses and Steering

    Aug 6, 2026Jakub Poćwiardowski, Mateusz ModrzejewskiControllable Music GenerationSymbolic Music Generation

    Institute of Computer Science Warsaw University of Technology Warsaw, Poland

  20. Diff2Mix: Controllable Music Mixing via Diffusion Models and Differentiable Audio Effects

    Aug 5, 2026Yisu Zong, Jinjie Shi, Joshua ReissControllable Music GenerationAudio Diffusion Models

    Centre for Digital Music, Queen Mary University of London, UK

  21. Diff-Symbo: Text-Controlled Long-Duration Symbolic Music Generation Using Autoregressive Latent Diffusion Model

    Aug 5, 2026Zhiwei Lin, Jun Chen, Boshi Tang +5Text-to-Music GenerationLatent Diffusion Models

    Shenzhen International Graduate School, Tsinghua University, Shenzhen, China · Huawei Technologies Co., Ltd., Shenzhen, China · The Chinese University of Hong Kong, Hong Kong SAR, China

  22. Helping Music Co-Creation Agents 'Listen' Well: Hierarchical Self-Supervised World Models for Understanding and Generation

    Aug 5, 2026Scott H. HawleyRepresentation LearningSelf-Supervised Pre-Training

    Department of Chemistry & Physics Belmont University Nashville, TN, USA

  23. Learning Music Style for Piano Arrangement Through Cross-Modal Bootstrapping

    Aug 4, 2026Jingwei Zhao, Gus Xia, Ziyu Wang +1Controllable Music GenerationCross-Modal Alignment

    1Songscription · School of Computing, National University of Singapore · Mohamed bin Zayed University of Artificial Intelligence (MBZUAI) +1

  24. Calliphony: A Calligraphy-Driven Interface for Real-Time Generative Music Performance

    Aug 4, 2026Tristan Wu, Ruiji Yu, Gus XiaControllable Music GenerationMusic Generation

    Mohamed Bin Zayed University of Artificial Intelligence Abu Dhabi, United Arab Emirates

  25. P-MUSE: Prompt-MIDI-Optional Model for Unified Instrumental Music Synthesis and Editing

    Aug 3, 2026Chong Jing, Junan Zhang, Jing Yang +3Audio EditingControllable Music Generation

    The Chinese University of Hong Kong, Shen Zhen · Central Media Technology Institute, Huawei

  26. MPEcho: A Melody and Phoneme-Aware Generative Framework for Controllable Cover Song Generation

    Jul 29, 2026Wei-Jaw Lee, Hsuan-Yu Yeh, Ting-Yi Hu +3Controllable Music GenerationMusic Generation

    GICE, National Taiwan University

  27. MusiChat: Vibe Composing for Music Creation

    Jul 27, 2026Callie C. Liao, Duoduo Liao, Ellie L. ZhangControllable Music GenerationSymbolic Music Generation

    George Mason University Fairfax, VA · IntelliSky McLean, VA

  28. WanSong v1.0 Technical Report

    Jul 16, 2026Binghui Chen, Pandeng Li, Yu Liu +1Controllable Music GenerationAudio Diffusion Models

    Wan Team, Alibaba Group

  29. Qwen-Music Technical Report

    Jul 13, 2026Jin Xu, Kangdi Wang, Ruibin Yuan +24Text-to-Music GenerationControllable Music Generation

    Qwen Team

  30. Anysynth:Zero-Shot Instrument Cloning via In-Context Learning and Asymmetric Hierarchical Guidance

    Jul 13, 2026Chong Jing, Junan Zhang, Jing Yang +3Diffusion Model GuidanceControllable Music Generation

    Chinese University of Hong Kong · Central Media Technology Institute, Huawei