Speech Enhancement

Ask about this topic

Overview

Speech enhancement seeks to recover clear, intelligible speech from recordings degraded by background noise, reverberation, echo, or other speakers. Methods range from spectral masking and multichannel beamforming, such as MVDR, to neural time-domain models and newer diffusion, flow-matching, and codec-based generators; visual cues and speaker references can help identify the target. Systems are commonly tested on benchmarks such as VoiceBank+DEMAND, DNS, and CHiME, while real-world meetings, hearing aids, and mobile devices bring challenges in domain shift, latency, and power use. A central tension is that better perceptual scores do not always mean more accurate speech recognition, and generative methods must improve quality without changing the speaker’s words or introducing artifacts.

Latest papers

CardsList

127 papers15 papers in the last four weeks, down 50% on the four weeks before. 0.1% of all new papers.

  1. The Voice on the Line

    Oct 26, 2026Husein ZolkepliSpeech ProcessingTarget Speaker Extraction

    Scicom (MSC) Berhad, Malaysia

  2. Noisy Target Training Meets Drifting for Weakly-Supervised Speech Enhancement

    Oct 23, 2026Yoshiki Masuyama, Dominik Klement, Christoph Boeddeker +5Speech Enhancement

    Mitsubishi Electric Research Laboratories (MERL), USA · Mitsubishi Electric Corporation, Japan

  3. When Do Self-Supervised Representations Help Speech Restoration?

    Oct 22, 2026Yongjoon Lee, Younghoo Kwon, Jung-Woo ChoiSelf-Supervised LearningSpeech Enhancement

    School of Electrical Engineering, KAIST, Daejeon, South Korea · Department of AI Systems, KAIST, Daejeon, South Korea

  4. XingChen-UniFE: A Unified Generative Speech Front-End via Complementary Acoustic-Semantic Modeling

    Oct 21, 2026Kelan Kuang, Qihan Hu, Jian Kang +3Audio-Language ModelsTarget Speaker Extraction

    China Telecom Artificial Intelligence Technology (Beijing) Co., Ltd.

  5. CF-AVSS: A Coarse-to-Fine Audio-Visual Speech Separation Framework with Target-Speaker Refinement and Post-Fusion for Real-World AVSE Challenge

    Oct 15, 2026Longjie Luo, Zhongshu Hou, Yuepeng Li +3Speech EnhancementTarget Speaker Extraction

    Tencent Ethereal Audio Lab, Tencent Corporation, China · University of Electronic Science and Technology of China, China

  6. SNOAR: Self-training with Noise filtering, Observation adding, and Remixing for Speech Denoising Without Clean References

    Oct 14, 2026Samuele Cornell, Matthew MaciejewskiSpeech Enhancement

    Carnegie Mellon University, USA · Johns Hopkins University, USA

  7. Multimodal Contrastive Representation Learning Based Voice Conversion for Electrolaryngeal Speech Enhancement

    Oct 13, 2026Ding Ma, Jinyi Mi, Jiajun He +3Voice ConversionSpeech Enhancement

    Graduate School of Informatics, Nagoya University, Nagoya, Japan · Alibaba Token Foundry, Alibaba Group, Hangzhou, China · Headquarters, TARVO, Inc., Nagoya, Japan +2

  8. Efficient Audio-Visual Speech Enhancement via Reinforcement Learning-Based Neural Architecture Search

    Oct 8, 2026Khubaib Ahmed, Ahsan Adeel, Nasir Saleem +3Speech EnhancementNeural Architecture Search

    University of Stirling, UK · Edinburgh Napier University, UK · University of Technology and Applied Sciences, Oman

  9. SEER: Source-Conditioned Emotion Enhancement via Retrieval for Cochlear-Implant Speech

    Oct 8, 2026Hsing-Hang Chou, Yun-Shao Lin, Ching-Chin Sung +1Speech ProcessingSpeech Enhancement

    Department of Electrical Engineering, National Tsing Hua University, Taiwan · Research Center for Information Technology Innovation, Academia Sinica, Taiwan

  10. SwinDS-BWE: A Parameter-Efficient Swin-1D Lattice Generator with Decision-Science Discriminators for Speech Bandwidth Extension

    Oct 6, 2026Tarikul Islam Tamiti, Sajid Fardin Dipto, Luke Baja-Ricketts +2Speech EnhancementGenerative Adversarial Networks

    Department of Cyber Security Engineering, George Mason University, Virginia, USA

  11. AuraSE: Low-Hallucination Generative Speech Enhancement via Multimodal Flow Matching and Inference Policy Optimization

    Oct 5, 2026Yingda Shen, Yao Qian, Yuxuan Hu +7Inference-Time OptimizationAudio Diffusion Models

    The Chinese University of Hong Kong, Shenzhen · Microsoft Research

  12. Long-Term Memory-Guided Enhancement for Target Perception in Audio-Language Models

    Sep 29, 2026Zhenhong Zhou, Xuanyue Zhao, Youji Liu +4Audio-Language ModelsSpeech Enhancement

    Nanyang Technological University · Beijing University of Posts and Telecommunications

  13. Perceptual Quality Loss or Loss of Perceptual Quality?

    Sep 28, 2026Danilo de Oliveira, Tal Peer, Maurício do V. M. da Costa +1Perceptual LossSpeech Quality Assessment

    Signal Processing, University of Hamburg, Germany

  14. Domain-Incremental Learning for Generative Speech Enhancement

    Sep 28, 2026Manjunath Mulimani, Annamaria Mesaros, Minje Kim +1Domain-Incremental LearningSpeech Enhancement

    Aalborg University, Department of Electronic Systems, Denmark · Tampere University, Signal Processing Research Centre, Finland · University of Illinois Urbana-Champaign, Siebel School of Computing and Data Science, USA

  15. Unsupervised Speech Enhancement via Drifting

    Sep 28, 2026Diego Caviedes-Nozal, Liang Xu, Rasmus Kongsgaard Olsson +1Speech Enhancement

    GN A/S, Denmark · Victoria University of Wellington, New Zealand

  16. Prox-Friendly Log-Magnitude Prior on Complex-Valued Signal

    Sep 28, 2026Kazuki Matsumoto, Keidai Arai, Kohei YatabeSpectral RegularizationSpeech Enhancement

    Tokyo University of Agriculture and Technology (TUAT), Tokyo, Japan

  17. Transformer-based Neural Beamforming for Real-Time Speech Enhancement on Smart Low-Power Hearable Devices

    Sep 27, 2026Luca Bompani, Marco Fariselli, Giovanni Oltrecolli +1Speech EnhancementSpatial Audio

    Electrical, Electronic and Information Engineering (DEI), University of Bologna, Italy

  18. WhisperVC-AV: Audio-Visual Content Restoration for Noise-Robust Whisper-to-Normal Voice Conversion

    Sep 26, 2026Ziyue Yin, Dong Liu, Ming LiVoice ConversionSpeech Enhancement

    Digital Innovation Research Center, Duke Kunshan University, Kunshan, China · Department of Computer Science, Johns Hopkins University, Baltimore, MD, USA · School of Computer Science, Wuhan University, Wuhan, China +1

  19. Room Impulse Response Embeddings for Speech Enhancement in Noisy and Reverberant Environments

    Sep 25, 2026Adrian Meise, Reinhold Haeb-UmbachRepresentation LearningSpeech Enhancement

    Paderborn University, Germany

  20. Adapting Personalized Speech Enhancement for Low-Latency Audio-Visual Target-Speaker Extraction

    Sep 24, 2026Rayhan Rashed, Senja Filipi, Ross CutlerTarget Speaker ExtractionSpeech Enhancement

    Microsoft · University of Michigan

  21. Does per-frame early exit pay? A compute-matched study of dynamic depth for on-device speech enhancement

    Sep 24, 2026Clément Laroche, Riccardo MicciniEfficient Neural Network InferenceSpeech Enhancement

    GN A/S, Denmark · Technical University of Denmark, Denmark

  22. Beyond Model Size: Redesigning LiSenNet for embedded speech enhancement

    Sep 24, 2026Clément Laroche, Rasmus Kongsgaard OlssonEfficient Neural Network InferenceSpeech Enhancement

    GN A/S, Audio Research, Lauptrupbjerg 7, 2750, Denmark

  23. Transcript-Supervised Post-Training of Generative Speech Enhancement on Real Recordings via Reinforce Adjoint Matching

    Sep 24, 2026Julius Richter, Christoph Boeddeker, Yoshiki Masuyama +4Speech EnhancementRL Post-Training

    Mitsubishi Electric Research Laboratories (MERL), USA · Mitsubishi Electric Corporation, Japan

  24. CHiME-9 ECHI: A Machine Learning Challenge for Enhancing Conversations to Address Hearing Impairment

    Sep 22, 2026Robert Sutherland, Thomas Kuebert, Marko Lugger +6Target Speaker ExtractionSpeech Enhancement

    School of Computer Science, University of Sheffield, Sheffield, United Kingdom · WS Audiology, Erlangen, Germany · ORCA Labs, WS Audiology, Lynge, Denmark +3

  25. SE-MSB: End-to-End Unpaired Speech Enhancement using Mamba Schrödinger Bridges

    Sep 22, 2026Andreas Bagge, Andreas Nymand, Michael Riis Andersen +1Schrödinger BridgesSpeech Enhancement

    DTU Compute, Kgs. Lyngby, Denmark · WSA, Lynge, Denmark

  26. Challenges of Multi-Speaker Extraction for Real Conversational Speech Enhancement

    Sep 22, 2026Robert Sutherland, Stefan Goetze, Jon BarkerTarget Speaker ExtractionSpeech Processing

    School of Computer Science, University of Sheffield, Sheffield, United Kingdom · South Westphalia University of Applied Sciences, Iserlohn, Germany

  27. Corrective Forcing: Unified Post-Training for Diffusions and Flows in Generative Speech Enhancement

    Sep 21, 2026Qing Yao, Lijian Gao, Qirong MaoDiffusion Model Fine-TuningSpeech Enhancement

    School of Computer Science and Communication Engineering, Jiangsu University Jiangsu Engineering Research Center of Big Data Ubiquitous Perception and Intelligent Agriculture Applications Provincial Key Laboratory of Computational Intelligence and New Technologies in Low-Altitude Digital Agriculture Zhenjiang, China

  28. P2Flow: Phoneme-aware Progressive Flow Matching for Extreme Speech Super-Resolution

    Sep 21, 2026Ningyuan Yang, Yize Li, Pu Zhao +5Flow MatchingSpeech Processing

    Stony Brook University, NY, US · Northeastern University, MA, US · UIUC, IL, US +1

  29. DiffVQE2: An Efficient Low-delay Diffusion Model for Acoustic Echo and Noise Control

    Sep 19, 2026Haljan Lugo, Ernst Seidel, Pejman Mowlaee +2Audio Diffusion ModelsSpeech Enhancement

    Institute for Communications Technology, Technische Universität Braunschweig, Schleinitzstraße 22, 38106 Braunschweig, Germany · GN Advanced Science, Lautrupbjerg 7, 2750 Ballerup, Denmark

  30. BLINC: Blind Calibration For Training-Free Speech Enhancement Adaptation

    Sep 18, 2026Tobias Raichle, Ekaterina Gavrilko, Bin YangSpeech EnhancementUnsupervised Domain Adaptation

    University of Stuttgart, Institute of Signal Processing and System Theory, Stuttgart, Germany