cs.SDNov 4, 2026

Latent Terrain: Adapting Neural Audio Autoencoders as Design Materials in NIME

Authors: Shuoyang Jasper Zheng, Keigo Yoshida, Nico García-Peguinho, Jiatong Liu, Dan Hearn, Anna Xambó Sedó, Nick Bryan-Kinns

Organizations: Centre for Digital Music, Queen Mary University of London London, UK · Graduate School of Media and Governance, Keio University Kanagawa, Japan · Creative Computing Institute, University of the Arts London London, UK

Abstract

Neural audio autoencoders, a deep learning method for sound synthesis, are increasingly popular in AI-enhanced NIMEs. It is timely to explore as a community how this technological opportunity has opened a domain of design in NIME. This paper focuses on one compelling technique of using autoencoders for sound synthesis: navigating their latent space as a generative sound space. We introduce Latent Terrain, a Max/MSP tool package designed to tailor latent spaces into corpus-based sound spaces for NIMEs. We describe the rationale and development process of Latent Terrain to offer insights into the use of autoencoders in a material-oriented crafting space of musical interface design. We deliver an annotated portfolio resulting from a collaborative artistic exploration of Latent Terrain with four NIME makers, to showcase the design possibilities opened by autoencoders. We reflect on our practice-based account to discuss the challenges and opportunities of enabling neural audio autoencoders as design materials for AI-enhanced NIMEs.

Figures & tables

Appendix figures & tables5 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Explainable AI through the Lens of Material Agency: Enabling Musical Interface Design with Neural Audio Models

    Jul 25, 2026Shuoyang Jasper Zheng, Anna Xambó Sedó, Nick Bryan-KinnsExplainable Artificial IntelligenceHuman-AI Co-Creation

  2. SCAPES: Semantically Conditioned Autoregressive Prior for Environmental Sounds

    Sep 4, 2026Esteban Gutiérrez, Lonce Wyse, Frederic Font +1Audio GenerationSound Effects Generation

  3. SAME: A Semantically-Aligned Music Autoencoder

    May 18, 2026Julian D. Parker, Zach Evans, CJ Carr +4Audio Representation LearningNeural Audio Codecs