Overview

Audio source separation estimates the individual sounds hidden in a recording, supporting clearer speech, editable music stems, and selective control of noisy soundscapes. Methods range from spatial filtering and nonnegative matrix factorization to neural mask estimators such as Demucs and Band-Split RNN, with newer Transformer, flow-matching, and diffusion models guided by text, video, speaker identity, or musical scores. Systems are tested on speech mixtures such as Libri2Mix, music benchmarks such as MUSDB18, and open-domain sound datasets, using signal metrics alongside listening tests and downstream tasks. A central challenge is balancing separation quality and perceptual naturalness with generalization, real-time efficiency, and reliable performance when separated audio is used for tasks such as speech recognition.

Latest papers

CardsList

72 papers7 papers in the last four weeks, down 56% on the four weeks before. 0.1% of all new papers.

  1. Textraction: Unified Text-Guided Speaker Extraction and Enhancement for Single- and Multi-Channel Audio

    Nov 9, 2026Aviad Eisenberg, Sharon Gannot, Shlomo E. ChazanTarget Speaker ExtractionAudio Source Separation

  2. CallCleaner: Lightweight Bioacoustic Denoising from an Audio Foundation Model

    Nov 8, 2026Michael Xie, Gašper Beguš, Morris AlperBioacousticsAudio Source Separation

  3. Steer Unified Audio Editing Toward Reliable Source Selection

    Nov 7, 2026Youquan Fu, Dongnuan Cai, Yu Pan +8Audio EditingAudio Source Separation

  4. AnomSep: Bridging Optimization-Based Separation and Deep Neural Refinement for Anomaly Detection with Listenable Explanations

    Nov 6, 2026Koki Shoda, Jun Younes Louhi Kasahara, Qi An +1Anomaly DetectionInterpretable Anomaly Detection

  5. Self-Supervised Object-Centric Representation for Multi-Task Audio Analysis

    Oct 30, 2026Parthasaarathy Sudarsanam, Tuomas VirtanenAudio Representation LearningAudio Source Separation

  6. SelectSep: Target-Selective Video Queries for Audio Source Separation

    Oct 28, 2026Suyeon Lee, Doyeop Kwak, Joon Son ChungAudio Source Separation

  7. Supervised Source Separation of Electric Vehicle Interior Noise Using a Hybrid Transformer Architecture

    Oct 23, 2026Philipp Diel, Zhuo Cao, Arne Hildenbrand +4Audio Source Separation

  8. Soloist: A Generative Model for Blind Voice Separation in the Wild

    Oct 14, 2026Chen Yang, ChuFan Yu, Botian Jiang +5Audio Source SeparationSpeech Separation

  9. FLOMSS: Generative Music Source Separation by Flow Matching

    Oct 13, 2026Shuyang Cui, Zhi Zhong, Keisuke Toyama +10Music Source SeparationAudio Source Separation

  10. FlowGRPO for Vocal Separation: From Reward Analysis to Reward Design

    Oct 11, 2026Lishi Zuo, Chong-Xin Gan, Zezhong Jin +3Music Source SeparationAudio Source Separation

  11. Learning Where to Split: Dynamic Band Splitting for Audio Source Separation

    Oct 10, 2026Bingzhe Zhang, Kai Li, Xiaolin HuAudio Source Separation

  12. Lightweight Systems for Spatial Semantic Segmentation of Sound Scenes

    Oct 8, 2026Mayank Mishra, Paul Magron, Romain SerizelSpatial AudioAudio Source Separation

  13. SepGen: Multi-Stem Audio-Video Separation and Generation in a Single Model

    Oct 8, 2026Aviad Dahan, Rajaei Khatib, Yonatan Bitton +3Audio-Video GenerationAudio Source Separation

  14. Restore, Separate, Restore: A Modular Framework for Music Source Restoration

    Oct 6, 2026Tobias Morocutti, Emmanouil Karystinaios, Gerhard WidmerAudio Source SeparationMusic Source Separation

  15. GAANet: Global-guided Asymmetric Attention Network for Audio-Visual Speech Separation

    Oct 2, 2026Zhiyuan Zhang, Jingyuan Xu, Yiming Tang +2Audio Source SeparationMultimodal Fusion

  16. Trigger Sound Suppression for Misophonia

    Sep 28, 2026Vaishnavi Vidyasagar, Jasmine Zhang, Mahima Uliyar +4Mental HealthAudio Source Separation

  17. SCISSOR: Score-Conditioned Instrument Source Separation for Orchestral Recordings

    Sep 27, 2026Yiheng Lu, Hao-Wen DongAudio Source SeparationMusic Source Separation

  18. Music Source Separation via Stem Discovery

    Sep 25, 2026V. Valtteri Kallinen, Eloi Moliner, Lauri Juvela +1Music Source SeparationAudio Source Separation

  19. Spot, Separate, and Enhance: Fully Generative Approach for Audio Mixing

    Sep 24, 2026Ilpo Viertola, Giulio Cengarle, Gouthaman KV +2Audio EditingAudio Source Separation

  20. On a Separate Note: Robust Score-Informed Note Separation with a Two-Stream TFC-TDF U-Net and Adaptive Set Ownership

    Sep 24, 2026Benjamin Shiue-Hal Chou, Purvish Jajal, Nicholas John Eliopoulos +5Audio Source SeparationMusic Source Separation

  21. MambaVoice: Lightweight Audiovisual Singing Voice Separation Via A Hybrid Mamba-Transformer Model

    Sep 22, 2026Adithi Shankar, Gopika Krishnan, Gloria Haro +2Hybrid Mamba-Transformer ArchitecturesAudio Source Separation

  22. LiteCASS: A Lightweight End-to-End Network for Real-Time Stereo Cinematic Audio Source Separation

    Sep 20, 2026Yuanxin Guo, Qiang Ji, Mengmei Liu +3Spatial AudioAudio Source Separation

  23. Investigating the Performance and Energy Costs of Replicating Band-Split RNN for Music Source Separation

    Sep 18, 2026Paul Magron, Romain Serizel, Constance DouwesAudio Source SeparationML Reproducibility

  24. Online Algorithms for Independent Low-Rank Matrix Analysis and Rank-Constrained Spatial Covariance Matrix Estimation Based on Maximum Weighted Likelihood Estimation

    Sep 18, 2026Yuto Ishikawa, Norihiro Takamune, Tomohiko Nakamura +4Audio Source SeparationCovariance Estimation

  25. Differentiable Digital Signal Processing Mixture Model-Guided Diffusion for Synthesis Parameter Estimation from Harmonic Sound Mixtures

    Sep 13, 2026Kengo Takemoto, Tomohiko Nakamura, Hiroshi SaruwatariDifferentiable Digital Signal ProcessingParameter Estimation

  26. Real-Time Music Source Separation on a Low-Power Audio DSP

    Sep 10, 2026Jianan Li, Li Liu, Ken Malsky +1Efficient Neural Network InferenceMusic Information Retrieval

  27. Neural Multichannel Distant Speaker Diarization with Heavy-tailed Source Separation Model

    Sep 10, 2026Sicheng Mao, Baihan Li, Mathieu Fontaine +2Audio Source SeparationSpeaker Diarization

  28. Open-Set Ego-Noise Separation for Legged-Robot Audition via Annotation-Free Adaptation and Pretrained-Model Transfer

    Sep 7, 2026Koki Shoda, Jun Younes Louhi Kasahara, Aoba Koyanagi +2Legged RoboticsUnsupervised Domain Adaptation