Overview

Speech separation studies how to recover individual speaker streams from mixtures, including recordings with overlap, noise, reverberation, or moving speakers. Common approaches use time- or frequency-domain neural networks, spatial cues from microphone arrays, and target-speaker conditioning; newer generative methods use diffusion, flow matching, or autoregressive audio models. Systems are increasingly evaluated on real conversations and by downstream tasks such as speech recognition and diarization, not only signal-quality scores. Key challenges include generalizing beyond simulated mixtures, keeping speaker identities aligned across long recordings, and balancing quality with streaming latency and computation.

Latest papers

CardsList

38 papers4 papers in the last four weeks, down 20% on the four weeks before. 0.0% of all new papers.

  1. GTCRN-SS: Lightweight Causal Speech Separation with Residual Allocation and Reconstruction Refinement

    Nov 6, 2026Shao-Chun Hu, Zi-Xiang Lin, Hsin-Min Wang +2Speech ProcessingSpeech Separation

  2. SLM-SS: Token-Based Speech Separation with Speech Language Models

    Oct 20, 2026Chenda Li, Tianhua Li, Yiming Chen +4Speech SeparationSpeech Language Models

  3. Beyond Two Tracks: Speaker-Anchored Full-Duplex Dialogue Recovery

    Oct 19, 2026Yuxuan Chen, Yang Xiao, Jack Sun +3Full-Duplex Spoken Dialogue SystemsSpeaker Diarization

  4. Soloist: A Generative Model for Blind Voice Separation in the Wild

    Oct 14, 2026Chen Yang, ChuFan Yu, Botian Jiang +5Audio Source SeparationSpeech Separation

  5. Frontend-Assisted Large Audio-Language Models for SLT2026 SmartGlasses Challenge

    Oct 9, 2026Yushi Wang, Zeyan Song, Xiaobin Rong +3Speaker-Attributed ASRAutomatic Speech Recognition

  6. VM-ARRAYDPS: Virtual Microphone Augmented Diffusion Posterior Sampling for Unsupervised Blind Speech Separation

    Oct 7, 2026Jingqi Sun, Haozhan Tang, Shulin He +1Speech SeparationMicrophone Array Processing

  7. SEAL: Mixture-Closed Additive Reconstruction and Refinement-Aware Expert Routing for Efficient Speech Separation

    Oct 5, 2026Shao-Chun Hu, Zi-Xiang Lin, Jeih-Weih Hung +1Speech SeparationSparse Mixture-of-Experts

  8. SepRQ : Self-Supervised Speech Mixture Representation Learning via Mask-Free, Multi-Scale Source Separation

    Oct 3, 2026Séverin Baroudi, Hervé Bredin, Ricard MarxerSelf-Supervised Speech Representation LearningSpeech Separation

  9. RadarVox: Radar-Audio Multimodal Cocktail-Party Speech Separation with Speaker-Aware Cross-Modal Matching

    Sep 20, 2026Yanlin Xu, Yiwei Ru, Mupei Li +3Speech Separation

  10. Neural Multichannel Distant Speaker Diarization with Heavy-tailed Source Separation Model

    Sep 10, 2026Sicheng Mao, Baihan Li, Mathieu Fontaine +2Audio Source SeparationSpeaker Diarization

  11. EConv-TasNet: Efficient Conv-TasNet for Effective Speech Separation

    Sep 10, 2026Pei-Chun Chang, Chuan-Yi LiuEfficient Neural Network InferenceTemporal Convolutional Networks

  12. Dynamic Clustering for Cross-Segment Permutation Alignment in Long Speech Separation

    Aug 10, 2026Yuzhu Wang, Archontis Politis, Konstantinos Drossos +1Audio Source SeparationSpeech Separation

  13. DAVE: A Decoupled Audio-Visual Enhancement Framework for Real-World Speech Separation

    Aug 10, 2026Wei Zhou, Wanyi Ning, Yinshang Guo +3Speech EnhancementNoise Robustness

  14. From Speech to Interaction: Analyzing Multimodal Systems in Cocktail-Party Scenarios

    Aug 9, 2026Thai-Binh Nguyen, Zhaolin Li, Jan Niehues +1Target Speaker ExtractionAutomatic Speech Recognition

  15. SAGE: Switch-Aware EEG-Guided Soft Gating for Target Speaker Extraction with In-Trial Switching

    Aug 3, 2026Xuefei Wang, Ximin Chen, Yuting Ding +2Target Speaker ExtractionAudio Source Separation

  16. SLT 2026 REAL-TSE Challenge: Real-world Target Speaker Extraction from Conversational Recordings

    Jul 16, 2026Shuai Wang, Zihan Qian, Ke Zhang +9Target Speaker ExtractionSpeech Processing

  17. Teaching Speech Enhancement Models to Sing: Domain Adaptation from Speech Enhancement to Singing Voice Separation

    Jul 13, 2026Paul A. Bereuter, Mark D. Plumbley, Alois SontacchiFine-TuningDomain Adaptation

  18. The SonicAGI System for the REAL-TSE Challenge

    Jul 13, 2026Kai Li, Wendi Sang, Jintao Cheng +1Target Speaker ExtractionSpeech Processing

  19. PS4: Proxy-Supervised Joint Training for Real Target Speaker Extraction

    Jul 9, 2026Wanyi Ning, Wei Zhou, Yingpeng Li +3Target Speaker ExtractionSpeech Processing

  20. Flow Matching-Based Speech Source Separation with Best-of-N Biometric Sampling

    Jul 7, 2026Anastasia Zorkina, Alexandr Anikin, Nikita Khmelev +5Flow MatchingSpeech Processing

  21. TF-MoE: Time-Frequency Mixture-of-Experts for Efficient Speech Separation

    Jun 28, 2026Qinzhe Hu, Chenda Li, Wangyou Zhang +3Sparse Mixture-of-ExpertsSpeech Processing

  22. Position-Aware Target Speaker Extraction for Long-Form Multi-Party Conversations: A Diarization-Free Framework for ASR

    Jun 28, 2026Yichi Wang, Junzhe Chen, Wangjin Zhou +1Target Speaker ExtractionSpeech Processing

  23. MeCo: One-Step MeanFlow-based Corrector for Multi-Channel Speech Separation

    Jun 8, 2026Dohwan Kim, Jung-Woo ChoiFlow MatchingMeanFlow

  24. Feasibility of Time-Domain DNN-Based Speech Enhancement on Embedded FPGA for Hearing Aid

    Jun 2, 2026Feyisayo Olalere, Umut Altin, Kiki van der Heijden +1Efficient Neural Network InferenceSpeech Processing

  25. Cross-Talk Speech Reduction, by Separation, for Separation

    May 19, 2026Zhong-Qiu Wang, Samuele CornellSpeech ProcessingSpeech Separation

  26. Predictive-Generative Drift Decomposition for Speech Enhancement and Separation

    May 7, 2026Julius Richter, Yoshiki Masuyama, Christoph Boeddeker +3Stochastic InterpolantsSpeech Processing