Overview

Target speaker extraction separates or enhances a selected person’s speech in mixtures, helping listeners follow conversations and improving downstream speech recognition. Systems condition neural separators or masking networks on enrollment speech, while other approaches use visual identity, microphone-array spatial cues, text, or neural signals; generative flows and autoregressive models offer alternatives to conventional separation. Current work increasingly addresses streaming and real conversations, where overlap, reverberation, noise, changing speakers, and differences between enrollment and target speech challenge models trained on simulated mixtures. A central tension is balancing intelligibility, speaker fidelity, perceptual quality, and latency, while ensuring objective metrics reflect real listening and recognition performance.

Latest papers

CardsList

43 papers13 papers in the last four weeks, up 44% on the four weeks before. 0.1% of all new papers.

  1. Textraction: Unified Text-Guided Speaker Extraction and Enhancement for Single- and Multi-Channel Audio

    Nov 9, 2026Aviad Eisenberg, Sharon Gannot, Shlomo E. ChazanTarget Speaker ExtractionAudio Source Separation

  2. Speaker-Consistent Grounding for Confusion-Resilient LLM-Based Target Speech Extraction

    Nov 4, 2026Hanyu Meng, Hao Shi, Zhanhong He +5Target Speaker Extraction

  3. Spatially-Guided Speaker Extraction Based on Relative Position Cues

    Nov 1, 2026Aviad Eisenberg, Shlomo E. Chazan, Sharon GannotTarget Speaker ExtractionMicrophone Array Processing

  4. Microphone Geometry Aware Regional Target Speaker Extraction

    Oct 31, 2026Shitong Xu, Niki Trigoni, Andrew MarkhamTarget Speaker ExtractionMicrophone Array Processing

  5. The Voice on the Line

    Oct 26, 2026Husein ZolkepliSpeech ProcessingTarget Speaker Extraction

  6. Efficient Streaming Audio-Visual Target Speaker Extraction for Real-World Acoustic Scenes

    Oct 23, 2026Wendi Sang, Kai Li, Yifan Li +2Target Speaker ExtractionStreaming Inference

  7. MG-REPA: Multi-Granularity Representation Alignment for Generative Target Speaker Extraction

    Oct 23, 2026Dohwan Kim, Jung-Woo ChoiTarget Speaker ExtractionDiffusion Model Alignment

  8. NeuroCodec: EEG-Guided Latent-Domain Generative Model for High-Fidelity Target Speaker Extraction

    Oct 21, 2026Julian Silva, Jaliya Kodithuwakku, Navindu Sirimanna +3Target Speaker ExtractionSpeech Processing

  9. XingChen-UniFE: A Unified Generative Speech Front-End via Complementary Acoustic-Semantic Modeling

    Oct 21, 2026Kelan Kuang, Qihan Hu, Jian Kang +3Audio-Language ModelsTarget Speaker Extraction

  10. PromptSep-Speaker: Generative Target Speaker Extraction via Multimodal Prompting and Semantic Alignment

    Oct 16, 2026Yutong Wen, Ke Chen, Prem Seetharaman +5Target Speaker Extraction

  11. CF-AVSS: A Coarse-to-Fine Audio-Visual Speech Separation Framework with Target-Speaker Refinement and Post-Fusion for Real-World AVSE Challenge

    Oct 15, 2026Longjie Luo, Zhongshu Hou, Yuepeng Li +3Speech EnhancementTarget Speaker Extraction

  12. Phonology-Aware Speaker Extraction Frontend for Audio LLMs

    Oct 9, 2026Yanxiang Chen, Haoyuan Deng, Jinyu Wang +4Target Speaker ExtractionSpeech Processing

  13. Multimodal Target Speaker Extraction: Towards Unified Speaker Cues Across Modalities

    Sep 28, 2026Xinyuan Qian, Yanghao Zhou, Ziyang Jiang +10Target Speaker ExtractionMultimodal Fusion

  14. RemixIT-TSE: Progressive Synthetic-to-Real Adaptation for Target Speech Extraction via Target-Aware Supervision and Remixing

    Sep 28, 2026Yu Wang, Haixin Guan, Shuang Wei +1Synthetic-to-Real Domain AdaptationTarget Speaker Extraction

  15. Unified Target-Speaker ASR with Text and Enrollment Speech Cues

    Sep 27, 2026Yuxiang Mei, Yuchen Yan, Dongxing Xu +2Target Speaker ExtractionAutomatic Speech Recognition

  16. Dialogue-Based Streaming Audio-Visual Target Speaker Extraction with Predictive Dialogue Information

    Sep 25, 2026Shuhan Zhang, Wenxuan Wu, Haizhou LiTarget Speaker ExtractionSpeech Processing

  17. CHiME-9 ECHI: A Machine Learning Challenge for Enhancing Conversations to Address Hearing Impairment

    Sep 22, 2026Robert Sutherland, Thomas Kuebert, Marko Lugger +6Target Speaker ExtractionSpeech Enhancement

  18. Challenges of Multi-Speaker Extraction for Real Conversational Speech Enhancement

    Sep 22, 2026Robert Sutherland, Stefan Goetze, Jon BarkerTarget Speaker ExtractionSpeech Processing

  19. From Speech to Interaction: Analyzing Multimodal Systems in Cocktail-Party Scenarios

    Aug 9, 2026Thai-Binh Nguyen, Zhaolin Li, Jan Niehues +1Target Speaker ExtractionAutomatic Speech Recognition

  20. SAGE: Switch-Aware EEG-Guided Soft Gating for Target Speaker Extraction with In-Trial Switching

    Aug 3, 2026Xuefei Wang, Ximin Chen, Yuting Ding +2Target Speaker ExtractionAudio Source Separation

  21. SLT 2026 REAL-TSE Challenge: Real-world Target Speaker Extraction from Conversational Recordings

    Jul 16, 2026Shuai Wang, Zihan Qian, Ke Zhang +9Target Speaker ExtractionSpeech Processing

  22. The SonicAGI System for the REAL-TSE Challenge

    Jul 13, 2026Kai Li, Wendi Sang, Jintao Cheng +1Target Speaker ExtractionSpeech Processing

  23. Breaking the Quality--Intelligibility Trade-off in Streaming Target Speaker Extraction via Deep-Feature-Anchored Preference Optimization

    Jul 11, 2026Shuhai Peng, Jinjiang Liu, Hui Lu +5Target Speaker ExtractionSpeech Processing

  24. PS4: Proxy-Supervised Joint Training for Real Target Speaker Extraction

    Jul 9, 2026Wanyi Ning, Wei Zhou, Yingpeng Li +3Target Speaker ExtractionSpeech Processing

  25. Position-Aware Target Speaker Extraction for Long-Form Multi-Party Conversations: A Diarization-Free Framework for ASR

    Jun 28, 2026Yichi Wang, Junzhe Chen, Wangjin Zhou +1Target Speaker ExtractionSpeech Processing