Speech Processing

Ask about this topic

Overview

Speech processing studies how computers can recognize words, identify speakers, understand vocal cues, and generate or improve speech. Common approaches include self-supervised speech encoders and Transformer or CTC models, alongside diffusion and flow-matching methods for synthesis, conversion, enhancement, and separation. Researchers evaluate these systems on tasks such as conversational transcription, speaker diarization, pronunciation assessment, and clinical speech analysis, increasingly including noisy, multilingual, and low-resource settings. A central challenge is making systems reliable across speakers, languages, and recording conditions while balancing accuracy and naturalness against latency, computation, privacy, and fairness.

Latest papers

CardsList

412 papers39 papers in the last four weeks, down 34% on the four weeks before. 0.2% of all new papers.

  1. Keyword spotting using convolutional neural network for speech recognition in Hindi

    Apr 26, 2026Saru Bharti, Pushparaj Mani PathakKeyword SpottingSpeech Processing

    iHub DivyaSampark Indian Institute of Technology, Roorkee Roorkee, India · Mechanical and Industrial Engineering Department Indian Institute of Technology, Roorkee Roorkee, India

  2. Explainable AI in Speaker Recognition -- Making Latent Representations Understandable

    Apr 25, 2026Yanze Xu, Wenwu Wang, Mark D. PlumbleyClusteringHierarchical Clustering

    Centre for Vision, Speech and Signal Processing, University of Surrey, Guildford, GU2 7XH, UK · Department of Informatics, King’s College London, London, WC2R 2LS, UK

  3. Au-M-ol: A Unified Model for Medical Audio and Language Understanding

    Apr 25, 2026Meizhu Liu, Nistha Mitra, Paul Li +3Medical Speech RecognitionSpeech Processing

    Oracle AI Science · Neuramill

  4. Spectro-Temporal Modulation Representation Framework for Human-Imitated Speech Detection

    Apr 25, 2026Khalid Zaman, Masashi UnokiAudio Deepfake DetectionSpeech Processing

    Graduate School of Advanced Science and Technology, Japan Advanced Institute of Science and Technology, Nomi, Ishikawa 923-1292, Japan

  5. Prompting Whisper for Joint Speech Transcription and Diarization

    Apr 24, 2026Mariia Zamyrova, Henk van den HeuvelSpeech ProcessingAutomatic Speech Recognition

    Radboud University Nijmegen

  6. Beyond Acoustic Sparsity and Linguistic Bias: A Prompt-Free Paradigm for Mispronunciation Detection and Diagnosis

    Apr 24, 2026Haopeng Geng, Longfei Yang, Xi Chen +3Mispronunciation Detection and DiagnosisSpeech Processing

    Graduate School of Engineering, The University of Tokyo, Japan

  7. Time vs. Layer: Locating Predictive Cues for Dysarthric Speech Descriptors in wav2vec 2.0

    Apr 23, 2026Natalie Engert, Dominik Wagner, Korbinian Riedhammer +1Speech ProcessingDysarthria Assessment

    Technische Hochschule Nürnberg Georg Simon Ohm, Germany

  8. Aligning Stuttered-Speech Research with End-User Needs: Scoping Review, Survey, and Guidelines

    Apr 22, 2026Hawau Olamide Toyin, Mutiah Apampa, Toluwani Aremu +6Speech ProcessingAutomatic Speech Recognition

    MBZUAI, UAE · SpeechCare, Portugal & UAE · School of Health Sciences & IEETA, University of Aveiro, Portugal +2

  9. Enhancing Speaker Verification with Whispered Speech via Post-Processing

    Apr 22, 2026Magdalena Gołębiowska, Piotr SygaAudio Representation LearningSpeaker Verification

    Department of Artificial Intelligence, Wroclaw University of Science and Technology, Wybrzeze Wyspianskiego 27, Wroclaw, 50-370, Poland

  10. StarTSE: Towards Streaming Target Speaker Extraction via Chunk-wise Interleaved Splicing of Autoregressive Language Model

    Apr 21, 2026Shuhai Peng, Hui Lu, Jinjiang Liu +8Target Speaker ExtractionSpeech Processing

    Shenzhen International Graduate School, Tsinghua University · The Chinese University of Hong Kong · SenseTime Research

  11. UAF: A Unified Audio Front-end LLM for Full-Duplex Speech Interaction

    Apr 21, 2026Yadong Li, Guoxin Wu, Haiping Hou +1Speech ProcessingAudio Understanding

    Alibaba Inc.

  12. Tadabur: A Large-Scale Quran Audio Dataset

    Apr 21, 2026Faisal AlherranSpeech Processing

    Riyadh, Saudi Arabia

  13. Comparison of sEMG Encoding Accuracy Across Speech Modes Using Articulatory and Phoneme Features

    Apr 20, 2026Chenqian Le, Ruisi Li, Beatrice Fumagalli +6Speech ProcessingSurface Electromyography

    New York University, New York, NY, USA

  14. Where Do Self-Supervised Speech Models Become Unfair?

    Apr 20, 2026Felix Herron, Maja Hjuler, Solange Rossato +2Speech ProcessingDemographic Bias in ASR

    MILES Team, LAMSADE, Universit´e Paris Dauphine-PSL · GETALP Team, LIG, Universit´e Grenoble Alpes · Queensland University of Technology

  15. Speech Emotion Recognition Using MFCC Features and LSTM-Based Deep Learning Model

    Apr 16, 2026Adelekun Oluwademilade, Ademola Adedamola, Abiola Abdulhakeem +7Speech ProcessingSpeech Emotion Recognition

    Department of Electrical Electronics and Telecommunications Engineering, Bells University of Technology, P.M.B. 1015, Ota, Ogun State, Nigeria · New Horizons Bells University of Technology, P.M.B. 1015, Ota, Ogun State, Nigeria · Department of Computer Engineering, Bells University of Technology, P.M.B. 1015, Ota, Ogun State, Nigeria +1

  16. ClariCodec: Optimising Neural Speech Codes for 200bps Communication using Reinforcement Learning

    Apr 16, 2026Junyi Wang, Chi Zhang, Jing Qian +4Neural Audio CodecsSpeech Processing

    Tsinghua University, China · Huawei Technologies Co., Ltd, China

  17. The Acoustic Camouflage Phenomenon: Re-evaluating Speech Features for Financial Risk Prediction

    Apr 16, 2026Dhruvin Dungrani, Disha DungraniSpeech ProcessingMultimodal Learning

    Department of Information Systems, Independent Researchers

  18. Listening Alone, Understanding Together: Collaborative Context Recovery for Privacy-Aware AI

    Apr 14, 2026Tanmay Srivastava, Amartya Basu, Shubham Jain +1Privacy-Preserving Speech ProcessingConversational Agents

    Stony Brook University · Microsoft Research

  19. X-VC: Zero-shot Streaming Voice Conversion in Codec Space

    Apr 14, 2026Qixi Zheng, Yuxiang Zhao, Tianrui Wang +7Zero-Shot Voice ConversionVoice Conversion

    Shanghai Jiao Tong University, Shanghai, China · Tianjin University, Tianjin, China · Shanghai Jiao Tong University, Shanghai Innovation Institute, Shanghai, China +3

  20. Saar-Voice: A Multi-Speaker Saarbrücken Dialect Speech Corpus

    Apr 13, 2026Lena S. Oberkircher, Jesujoba O. Alabi, Dietrich Klakow +1Speech Corpus ConstructionSpeech Processing

    Language Science and Technology (LST), Saarland University, Saarbrücken, Germany

  21. MimicLM: Zero-Shot Voice Imitation through Autoregressive Modeling of Pseudo-Parallel Speech Corpora

    Apr 13, 2026Tao Feng, Yuxiang Wang, Yuancheng Wang +5Zero-Shot Voice ConversionSpeech Processing

    Tsinghua University · The Chinese University of Hong Kong, Shenzhen

  22. A Survey of Text and Speech Resources for Hausa and Fongbe: Availability, Quality, and Gaps for NLP Development

    Apr 13, 2026Mahounan Pericles Adjovi, Victor Olufemi, Roald Eiselen +1Low-Resource Language ProcessingSpeech Processing

    Carnegie Mellon University Africa, Kigali, Rwanda · Centre for Text Technology, North-West University, South Africa

  23. Utterance-Level Methods for Identifying Reliable ASR-Output for Child Speech

    Apr 10, 2026Gus Lathouwers, Lingyun Gao, Catia Cucchiarini +1Speech ProcessingASR Evaluation

    Centre for Language Studies, Radboud University, Netherlands · Department of Language and Communication, Radboud University, Netherlands

  24. DialogueSidon: Recovering Full-Duplex Dialogue Tracks from In-the-Wild Dialogue Audio

    Apr 10, 2026Wataru Nakata, Yuki Saito, Kazuki Yamauchi +2Audio Diffusion ModelsSpeech Processing

    The University of Tokyo, Tokyo, Japan · National Institute of Advanced Industrial Science and Technology (AIST), Tokyo, Japan

  25. DDSP-QbE++: Improving Speech Quality for Speech Anonymisation for Atypical Speech

    Apr 10, 2026Suhita Ghosh, Yamini Sinha, Sebastian StoberSpeech ProcessingVoice Conversion

    Artificial Intelligence Lab, Otto-von-Guericke University Magdeburg, Germany · MDS-IIKT Otto-von-Guericke University Magdeburg, Germany

  26. Selective Attention System (SAS): Device-Addressed Speech Detection for Real-Time On-Device Voice AI

    Apr 9, 2026David Joohun Kim, Daniyal Anjum, Bonny Banerjee +1Speech ProcessingSequential Decision Making

    Attention Labs

  27. A Novel Automatic Framework for Speaker Drift Detection in Synthesized Speech

    Apr 7, 2026Jia-Hong Huang, Seulgi Kim, Yi Chieh Liu +5Speech ProcessingTTS Synthesis

    University of Amsterdam · Georgia Institute of Technology · Halmstad University

  28. "OK Aura, Be Fair With Me": Demographics-Agnostic Training for Bias Mitigation in Wake-up Word Detection

    Apr 7, 2026Fernando López, Paula Delgado-Santos, Pablo Gómez +2Demographic Bias in ASRSpeech Processing

    Telefónica Innovación Digital, Madrid, Spain · Universidad Autónoma de Madrid, Madrid, Spain

  29. Full-Duplex-Bench-v3: Benchmarking Tool Use for Full-Duplex Voice Agents Under Real-World Disfluency

    Apr 6, 2026Guan-Ting Lin, Chen Chen, Zhehuai Chen +1Voice Agent EvaluationFull-Duplex Spoken Dialogue Systems

    National Taiwan University · NVIDIA

  30. Real-Time Voicemail Detection in Telephony Audio Using Temporal Speech Activity Features

    Apr 2, 2026Kumar SauravSpeech ProcessingAudio Classification

    CTO, ClearGrid