Speech Processing

Ask about this topic

Overview

Speech processing studies how computers can recognize words, identify speakers, understand vocal cues, and generate or improve speech. Common approaches include self-supervised speech encoders and Transformer or CTC models, alongside diffusion and flow-matching methods for synthesis, conversion, enhancement, and separation. Researchers evaluate these systems on tasks such as conversational transcription, speaker diarization, pronunciation assessment, and clinical speech analysis, increasingly including noisy, multilingual, and low-resource settings. A central challenge is making systems reliable across speakers, languages, and recording conditions while balancing accuracy and naturalness against latency, computation, privacy, and fairness.

Latest papers

CardsList

412 papers39 papers in the last four weeks, down 34% on the four weeks before. 0.2% of all new papers.

  1. Toward Complex-Valued Neural Networks for Waveform Generation

    Mar 12, 2026Hyung-Seok Oh, Deok-Hyeon Cho, Seung-Bin Kim +1Neural VocodersComplex-Valued Neural Networks

    Department of Artificial Intelligence Korea University Seoul, Republic of Korea

  2. Beyond Deep Learning: Speech Segmentation and Phone Classification with Neural Assemblies

    Mar 11, 2026Trevor Adelson, Vidhyasaharan Sethu, Ting DangSpeech ProcessingAutomatic Speech Recognition

    The University of Melbourne, Australia · The University of New South Wales, Australia

  3. Abjad-Kids: An Arabic Speech Classification Dataset for Primary Education

    Mar 11, 2026Abdul Aziz Snoubara, Baraa Al_Maradni, Haya Al_Naal +4Speech ProcessingAudio Classification

    Arab International University, Daraa, Syria.

  4. FireRedASR2S: A State-of-the-Art Industrial-Grade All-in-One Automatic Speech Recognition System

    Mar 11, 2026Kaituo Xu, Yan Jia, Kai Huang +6Voice Activity DetectionSpeech Processing

    Super Intelligence Team, Xiaohongshu Inc.

  5. Harf-Speech: A Clinically Aligned Framework for Arabic Phoneme-Level Speech Assessment

    Mar 11, 2026Asif Azad, MD Sadik Hossain Shanto, Mohammad Sadat Hossain +6Speech ProcessingClinical Speech Processing

    Ministry of Defense, Saudi Arabia · Ability Center, Saudi Arabia · University of Rochester, USA

  6. Speech Codec Probing from Semantic and Phonetic Perspectives

    Mar 11, 2026Xuan Shi, Chang Zeng, Tiantian Feng +3Audio Representation LearningNeural Audio Codecs

    University of Southern California, USA · Dolby Laboratories, USA

  7. Scalable Neural Vocoder from Range-Null Space Decomposition

    Mar 9, 2026Andong Li, Tong Lei, Zhihang Sun +4Neural VocodersSpeech Processing

    the Key Laboratory of Noise and Vibration Research, Institute of Acoustics, Chinese Academy of Sciences, Beijing, 100190, China, and also with University of Chinese Academy of Sciences, Beijing, 100049, China. · Tencent AI Lab. · School of Communications and Information Engineering, Chongqing University of Posts and Telecommunications, Chongqing 400065, China.

  8. Learning Multiple Utterance-Level Attribute Representations with a Unified Speech Encoder

    Mar 9, 2026Maryem Bouziane, Salima Mdhaffar, Yannick EstèveSpeech ProcessingAudio Representation Learning

    LIA - Avignon Université, France

  9. Quantifying Cross-Lingual Transfer in Paralinguistic Speech Tasks

    Mar 9, 2026Pol Buitrago, Oriol Pareras, Federico Costa +1Speaker VerificationSpeech Processing

    Barcelona Supercomputing Center (BSC), Spain · Universitat Polit`ecnica de Catalunya (UPC), Spain

  10. PathBench: Speech Intelligibility Benchmark for Automatic Pathological Speech Assessment

    Mar 9, 2026Bence Mark Halpern, Thomas Tienkamp, Defne Abur +1Benchmark DesignSpeech Quality Assessment

    1Nagoya University, Japan · Department of Neurology, Faculty of Medicine and University Hospital Cologne, University of Cologne, Germany · University of Groningen, The Netherlands

  11. WhispEar: A Bi-directional Framework for Scaling Whispered Speech Conversion via Pseudo-Parallel Whisper Generation

    Mar 9, 2026Zihao Fang, Yingda Shen, Zifan Guan +3Zero-Shot Voice ConversionSpeech Processing

    School of Data Science, The Chinese University of Hong Kong, Shenzhen, China · Honor Device Co., Ltd, China

  12. TW-Sound580K: A Regional Audio-Text Dataset with Verification-Guided Curation for Localized Audio-Language Modeling

    Mar 5, 2026Hao-Hui Xie, Ho-Lam Chung, Yi-Cheng Lin +4Audio-Language ModelsSpeech Processing

    National Taiwan University · Shanghai Jiao Tong University

  13. FlowW2N: Whispered-to-Normal Speech Conversion via Flow-Matching

    Mar 4, 2026Fabian Ritter-Gutierrez, Md Asif Jalal, Pablo Peso Parada +5Speech ProcessingVoice Conversion

    Samsung Electronics R&D Institute UK (SRUK), London, United Kingdom · Samsung Electronics, Mobile eXperience Business, Suwon, Republic of Korea

  14. Single Microphone Own Voice Detection based on Simulated Transfer Functions for Hearing Aids

    Mar 3, 2026Mathuranathan Mayuravaani, W. Bastiaan Kleijn, Andrew Lensen +1Synthetic-to-Real Domain AdaptationSynthetic Data Augmentation

  15. When Spoof Detectors Travel: Evaluation Across 66 Languages in the Low-Resource Language Spoofing Corpus

    Mar 2, 2026Kirill Borodin, Vasiliy Kudryavtsev, Maxim Maslov +2Audio Deepfake DetectionSpeech Processing

    lab260, Moscow Technical University of Communications and Informatics, Russia · BitmanagerAI, UAE

  16. TCG CREST System Description for the DISPLACE-M Challenge

    Mar 2, 2026Nikhil Raghav, Md SahidullahVoice Activity DetectionSpeaker Diarization

    Institute for Advancing Intelligence, TCG CREST, Kolkata-700 091, India · Department of Computer Science, RKMVERI, Howrah-711 202, India

  17. VietSuperSpeech: A Large-Scale Vietnamese Conversational Speech Dataset for ASR Fine-Tuning in Chatbot, Customer Support, and Call Center Applications

    Mar 2, 2026Loan Do, Thanh Ngoc Nguyen, Thanh Pham +3Conversational Speech RecognitionSpeech Corpus Construction

    FPT University · Phuong Hai JSC

  18. VoxKnesset: A Large-Scale Longitudinal Hebrew Speech Dataset for Aging Speaker Modeling

    Mar 1, 2026Yanir Marmor, Arad Zulti, David Krongauz +4Speech ProcessingSpeaker Verification

    Department of Computer Science and Applied Mathematics, Department of Molecular Cell Biology, Weizmann Institute of Science, Rehovot, Israel

  19. Polynomial Mixing for Efficient Self-supervised Speech Encoders

    Feb 28, 2026Eva Feillet, Ryan Whetten, David Picard +1Speech ProcessingSelf-Supervised Speech Representation Learning

    Universit´e Paris-Saclay, CNRS, Laboratoire Interdisciplinaire des Sciences du Num´erique · Miles team, Universit´e Paris-Dauphine-PSL · Laboratoire Informatique d’Avignon, Avignon Universit´e +1

  20. MEBM-Speech: Multi-scale Enhanced BrainMagic for Robust MEG Speech Detection

    Feb 27, 2026Li Songyi, Zheng Linze, Liang Jinghua +1Neural DecodingSpeech Processing

    Speech and Hearing Research Center, School of Intelligence Science and Technology, Peking University, Beijing, China 100871 · Center for BioMed-X Research, Academy for Advanced Interdisciplinary Studies, Peking University, Beijing, China 100871

  21. Breeze Taigi: Benchmarks and Models for Taiwanese Hokkien Speech Recognition and Synthesis

    Feb 26, 2026Yu-Siang Lan, Chia-Sheng Liu, Yi-Chang Chen +5Speech ProcessingASR Evaluation

    National Yang Ming Chiao Tung University · Work done at MediaTek Research · MediaTek Research

  22. TADA: A Generative Framework for Speech Modeling via Text-Acoustic Dual Alignment

    Feb 26, 2026Trung Dang, Sharath Rao, Ananya Gupta +6TTS SynthesisSpeech Processing

    Hume AI, USA · Dartmouth College, USA

  23. A Holistic Framework for Robust Bangla ASR and Speaker Diarization with Optimized VAD and CTC Alignment

    Feb 26, 2026Zarif Ishmam, Zarif Mahir, Shafnan Wasif +1Voice Activity DetectionForced Alignment

    Computer Science and Engineering, Bangladesh University of Engineering and Technology, Dhaka, Bangladesh

  24. ShobdoSetu: A Data-Centric Framework for Bengali Long-Form Speech Recognition and Speaker Diarization

    Feb 25, 2026Md. Nazmus Sakib, Shafiul Tanvir, Mesbah Uddin Ahamed +1Long-Form Speech RecognitionSpeech Processing

    Dept. of Computer Science & Engineering Bangladesh University of Engineering and Technology Dhaka, Bangladesh

  25. TG-ASR: Translation-Guided Learning with Parallel Gated Cross Attention for Low-Resource Automatic Speech Recognition

    Feb 25, 2026Cheng-Yeh Yang, Chien-Chun Wang, Li-Wei Chen +3Automatic Speech RecognitionSpeech Processing

    Dept. Computer Science and Information Engineering, National Taiwan Normal University, Taiwan · United Link Co., Ltd., Taiwan · Institute of Computer Science, Academia Sinica, Taiwan

  26. Quantifying Dimensional Independence in Speech: An Information-Theoretic Framework for Disentangled Representation Learning

    Feb 24, 2026Bipasha Kashyap, Björn W. Schuller, Pubudu N. PathiranaRepresentation DisentanglementSpeech Processing

    NSBE Research Lab, School of Engineering, Deakin University, Australia · Chair of Health Informatics (CHI), TUM University Hospital, Germany · Group on Language, Audio & Music (GLAM), Imperial College London, UK

  27. StyleStream: Real-Time Zero-Shot Voice Style Conversion

    Feb 23, 2026Yisi Liu, Nicholas Lee, Gopala AnumanchipalliZero-Shot Voice ConversionSpeech Processing

    UC Berkeley, USA

  28. DECAF: Dynamic Envelope Context-Aware Fusion for Speech-Envelope Reconstruction from EEG

    Feb 23, 2026Karan Thakkar, Mounya ElhilaliEEG DecodingSpeech Processing

    Laboratory for Computational Audio Perception, Johns Hopkins University, USA

  29. CosyAccent: Duration-Controllable Accent Normalization Using Source-Synthesis Training Data

    Feb 22, 2026Qibing Bai, Shuhao Shi, Shuai Wang +3Speech ProcessingControllable Speech Generation

    SDS, The Chinese University of Hong Kong, Shenzhen, China · SRIBD, The Chinese University of Hong Kong, Shenzhen, China · Tencent Ethereal Audio Lab, Tencent, Shenzhen, China +3

  30. MEG-to-MEG Transfer Learning and Cross-Task Speech/Silence Detection with Limited Data

    Feb 20, 2026Xabier de Zuazo, Vincenzo Verbeni, Eva Navas +3Neural DecodingTransfer Learning

    HiTZ Center, University of the Basque Country – UPV/EHU, Spain · Basque Center on Cognition, Brain and Language – BCBL, Spain · Laboratory of Functional Anatomy, Faculty of Human Motor Sciences, Université libre de Bruxelles (ULB), Belgium +3