Speech Enhancement

Ask about this topic

Overview

Speech enhancement seeks to recover clear, intelligible speech from recordings degraded by background noise, reverberation, echo, or other speakers. Methods range from spectral masking and multichannel beamforming, such as MVDR, to neural time-domain models and newer diffusion, flow-matching, and codec-based generators; visual cues and speaker references can help identify the target. Systems are commonly tested on benchmarks such as VoiceBank+DEMAND, DNS, and CHiME, while real-world meetings, hearing aids, and mobile devices bring challenges in domain shift, latency, and power use. A central tension is that better perceptual scores do not always mean more accurate speech recognition, and generative methods must improve quality without changing the speaker’s words or introducing artifacts.

Latest papers

CardsList

128 papers15 papers in the last four weeks, down 50% on the four weeks before. 0.1% of all new papers.

  1. AnyBand: Unified Multi-Bandwidth Speech Extension via Frequency-Aware In-Context Spectral Infilling

    Aug 1, 2026Junchuan Zhao, Minh Duc Vu, Bowen Zhang +1Audio Diffusion ModelsSpeech Enhancement

    School of Computing, National University of Singapore · Department of Statistics & Data Science, National University of Singapore · College of Computing and Data Science, Nanyang Technological University

  2. faster-enhancer.c: A Dependency-Free int8 Runtime for Streaming Speech Enhancement on Commodity CPUs

    Jul 28, 2026Gyeongmin KimEfficient Neural Network InferenceSpeech Enhancement

    Department of Computer Science, Hanyang University, Seoul, Korea

  3. Towards Array-Invariant Speech Enhancement via Geometry-Aware Dynamic Convolution

    Jul 21, 2026Zhenglong Liu, Wangyou Zhang, Chenda Li +1Dynamic ConvolutionSpeech Enhancement

    Auditory Cognition and Computational Acoustics Lab Shanghai Jiao Tong University, Shanghai, China · VUI Labs

  4. CAPS: A Cascaded Reconstruction Model to Power Saving in Hearables Using Sub-Nyquist Sampling with Bandwidth Extension

    Jul 21, 2026Tarikul Islam Tamiti, Sajid Fardin Dipto, Luke Baja-Ricketts +2Energy-Efficient MLSpeech Enhancement

    Cyber-Security Engineering, George Mason University, USA

  5. It Takes Few to TANGO: A Quantized Distributed Model for Binaural Speech Enhancement

    Jul 9, 2026Zahra Benslimane, Pierre Chouteau, Martyna Poreba +4Quantization-Aware TrainingSpeech Enhancement

    Université Paris-Saclay, CEA, List, F-91120 Palaiseau, France · Université de Lorraine, CNRS, Inria, LORIA, F-54000 Nancy, France

  6. Ranking the Impact of Contextual Specialization in Neural Speech Enhancement

    Jul 6, 2026Peter Leer, Svend Feldt, Zheng-Hua Tan +2Speech Enhancement

    Eriksholm Research Centre, Snekkersten, Denmark · Aalborg University, Department of Electronic Systems, Aalborg, Denmark

  7. Weakly Guided and Autoregressive Beamformer Parameterization for Generalizable Moving Speaker Extraction in Higher-Order Ambisonics

    Jul 5, 2026Jakob Kienegger, Tal Peer, Sina Khanagha +1Speech EnhancementSpatial Audio

    Signal Processing (SP) Group, University of Hamburg

  8. RT-Tango: Real-Time Distributed Binaural Speech Enhancement for Low-Power Hearing Aid Devices

    Jul 2, 2026Z. Benslimane, P. Chouteau, M. Poreba +4Speech ProcessingSpeech Enhancement

    Universit´e Paris-Saclay, CEA, List, F-91120 Palaiseau, France · Universit´e de Lorraine, CNRS, Inria, LORIA, F-54000 Nancy, France

  9. Improving multichannel speech enhancement through accurate room-acoustic simulations

    Jun 30, 2026Georg Götz, Alessia Milo, Steinar Guðjónsson +3Synthetic Data AugmentationSpeech Enhancement

    Treble Technologies, Reykjavík, Iceland

  10. SE-AGCNet: An End-to-End Framework for Joint Speech Enhancement and Loudness Control in Meeting Scenarios

    Jun 24, 2026Jinming Zhang, Wei Rao, Xionghu Zhong +1Speech ProcessingSpeech Enhancement

    Zhejiang University, China · Nanyang Technological University, Singapore · Hunan University, China

  11. One Model, Many Latencies: Universal Speech Enhancement for Diverse Real-Time Applications

    Jun 24, 2026Szu-Wei Fu, Rong Chao, Xuesong Yang +4Speech Enhancement

    NVIDIA · Academia Sinica, Taipei, Taiwan

  12. Beyond U-Net: A Latent-Representation-Aligned Skip-Free Backbone for Flow-Matching Speech Enhancement

    Jun 23, 2026Wangyi Pu, Michele ScarpinitiFlow MatchingSpeech Enhancement

    Department of Information Engineering, Electronics and Telecommunications, Sapienza University of Rome, Italy

  13. Joint Learning of Covariance Estimation and White Noise Gain for Robust MVDR Beamforming

    Jun 23, 2026Yongyi Deng, Hanchen Pei, Jianbo Ma +3Speech EnhancementNoise Robustness

    School of Electronic Information, Wuhan University, Wuhan, Hubei, China · Dolby Laboratories · CIAIC, Northwestern Polytechnical University, Xi’an, Shaanxi, China +1

  14. Neuromorphic Speech Enhancement with Dual-Branch Spiking Neural Networks

    Jun 22, 2026Taiyu Meng, Wenbin Jiang, Haoyi Zhang +2Speech EnhancementSpiking Neural Networks

    School of Communication Engineering, Hangzhou Dianzi University, Hangzhou, China

  15. Bridging Self-Supervised Learning and Speech Enhancement: A Wav2Vec2-Conditioned Framework

    Jun 21, 2026Shuubham Ojha, Carol Espy-WilsonAudio Diffusion ModelsSpeech Enhancement

    Institute for Systems Research, University of Maryland, College Park

  16. Time-Frequency Weighted Losses for Phoneme Reconstruction in DNN-Based Speech Enhancement

    Jun 19, 2026Nasser-Eddine Monir, Paul Magron, Romain SerizelSpeech EnhancementAdaptive Loss Weighting

    Université de Lorraine, CNRS, Inria, LORIA, F-54000 Nancy, France

  17. Post-Training Speech Enhancement Language Models with Perceptual Rewards

    Jun 19, 2026Frédéric Berdoz, Luca A. Lanzendörfer, Antonis Asonitis +1Multi-Objective Reinforcement LearningRL for Language Models

    ETH Zürich, Switzerland

  18. Latency-Configurable Streaming Speech Enhancement via Asymmetric Temporal Padding

    Jun 18, 2026Yunsik Kim, Yoonyoung ChungSpeech EnhancementStreaming Algorithms

    Department of Electrical Engineering, Pohang University of Science and Technology (POSTECH), Pohang 37673, Republic of Korea · Intus Co. Ltd., Pohang 37673, Republic of Korea

  19. QC-GAN: A Parameter-Efficient Quaternion Conformer GAN for High-Fidelity Speech Enhancement

    Jun 17, 2026Shogo Yamauchi, Hideaki Tamori, Makoto Sakai +2TransformerComplex-Valued Neural Networks

    The Asahi Shimbun Company, Japan · Tokyo Woman’s Christian University, Japan

  20. Audio-visual Contrastive Alignment for Diffusion-based Visual-conditioned Speech Enhancement

    Jun 16, 2026Colombe Mboungou, Mostafa Sadeghi, Jean-Eudes Ayilo +1Speech EnhancementAudio-Visual Alignment

    MULTISPEECH · Universit´e de Lorraine, CNRS, Inria, Loria, Nancy, France

  21. Towards Robust Generative Speech Enhancement Using Vector Quantisation-Based Neural Audio Codec

    Jun 15, 2026Haixin Zhao, Nilesh MadhuNeural Audio CodecsVector Quantization

    IDLab, Ghent University - imec, Belgium

  22. Generating Training Targets for Real-World Speech Enhancement via Close-to-Distant Microphone Projection

    Jun 11, 2026Tomohiro Nakatani, Rintaro Ikeshita, Naoyuki Kamo +2Speech Enhancement

    NTT, Inc., Japan

  23. BASENet: Band-Adapted Speech Enhancement Network with Cross-Band Attention

    Jun 10, 2026Damien Martins Gomes, François CapmanFrequency-Domain Feature LearningSpeech Enhancement

    Thales SIX GTS, FRANCE

  24. G-MaP-SE: Guided Speech Enhancement via GMM-Based Prior Matching

    Jun 7, 2026Yike Zhu, Ziqian Wang, Zikai Liu +5Speaker EmbeddingSpeech Enhancement

  25. DBHN-Net: Dual-Branch Hybrid Neural Network For Low-Complexity Monaural Speech Enhancement

    Jun 4, 2026Cunhang Fan, Enrui Liu, Jing Zhou +6Efficient Neural Network InferenceSpeech Enhancement

    State Key Laboratory of Opto-Electronic Information Acquisition and Protection Technology, (School of Computer Science and Technology), Anhui University, Hefei, 230601, Anhui, P. R. China · China Telecom Artificial Intelligence Technology (Beijing) Co., Ltd · Institute of Acoustics, University of Chinese Academy of Sciences, Beijing 100190, China +1

  26. SB-RF: Schrödinger Bridge Rectified Flow for One-Step Robust Speech Enhancement

    Jun 4, 2026Caixia Lu, Xueyang Lv, Penglong Hu +1Rectified FlowSchrödinger Bridges

  27. Feasibility of Time-Domain DNN-Based Speech Enhancement on Embedded FPGA for Hearing Aid

    Jun 2, 2026Feyisayo Olalere, Umut Altin, Kiki van der Heijden +1Efficient Neural Network InferenceSpeech Processing

    Radboud University, Donders Institute for Brain, Cognition, and Behaviour, The Netherlands · Mortimer B. Zuckerman Mind, Brain, Behavior Institute, Columbia University, USA.

  28. The Differentiable Auditory Loop (DAL): An ML Framework for Hyper-Personalized Hearing Aids

    Jun 2, 2026Alejandro Ballesta Rosen, Jason Mikiel-Hunter, Julian Maclaren +3Speech Enhancement

    1Google Research Australia · 2Macquarie University

  29. Audio Spotforming via Post-Filtering Using Cross-Array Non-target Estimates

    Jun 2, 2026Yuto Ishikawa, Li Li, Shogo Seki +1Microphone Array ProcessingTarget Speaker Extraction

    CyberAgent, Inc., Japan · The University of Tokyo, Japan

  30. A Comparison of Generative and Discriminative Methods for Speech Enhancement: Robustness, Complexity, and Hallucination

    Jun 1, 2026Shrishti Saha Shetu, Emanuël A. P. Habets, Andreas BrendelSpeech Enhancement

    International Audio Laboratories Erlangen, Am Wolfsmantel 33, 91058 Erlangen, Germany · Fraunhofer IIS, Am Wolfsmantel 33, 91058 Erlangen, Germany