Speech Processing

Ask about this topic

Overview

Speech processing studies how computers can recognize words, identify speakers, understand vocal cues, and generate or improve speech. Common approaches include self-supervised speech encoders and Transformer or CTC models, alongside diffusion and flow-matching methods for synthesis, conversion, enhancement, and separation. Researchers evaluate these systems on tasks such as conversational transcription, speaker diarization, pronunciation assessment, and clinical speech analysis, increasingly including noisy, multilingual, and low-resource settings. A central challenge is making systems reliable across speakers, languages, and recording conditions while balancing accuracy and naturalness against latency, computation, privacy, and fairness.

Latest papers

CardsList

412 papers39 papers in the last four weeks, down 34% on the four weeks before. 0.2% of all new papers.

  1. Tap2Listen: Instant Target Switching for Streaming Audio-Visual Speaker Extraction

    Oct 27, 2026Hansol Park, Minkyung Song, Zinu Kim +4Target Speaker ExtractionSpeech Processing

    Sungkyunkwan University

  2. TAC2: Timestamped Audio Captioning as composable functions

    Oct 27, 2026Swapnil Bhosale, Prem Seetharaman, Ke Chen +3Audio-Language ModelsAudio Captioning

    University of Surrey, UK · Adobe Research, USA

  3. Probing the phon* representations of the Mimi codebooks

    Oct 26, 2026Artem Saloev, Nicolas Ballier, Erin PacquetetNeural Audio CodecsDiscrete Speech Representation Learning

    ALTAE, Université Paris Cité, F-75013 Paris, France · SCIAM, 10 rue de Penthièvre, F-75008 Paris, France

  4. The Voice on the Line

    Oct 26, 2026Husein ZolkepliSpeech ProcessingTarget Speaker Extraction

    Scicom (MSC) Berhad, Malaysia

  5. ASR-Protected Fusion and Reference-Anchored Policy Optimization for Joint ASR and Word-Level Speech Anti-Spoofing

    Oct 25, 2026Xueping Zhang, Xiaoxiao Miao, Tiantian Feng +1Speech ProcessingAudio Deepfake Detection

    Digital Innovation Research Center, Duke Kunshan University, China · School of Artificial Intelligence, The Chinese University of Hong Kong, Shenzhen, China

  6. Acoustic and Lexical Signals for Native Language Identification of Language Learners

    Oct 23, 2026Ahmet Yavuz Uluslu, Mengjie Qian, Kate Knill +1Language IdentificationSpeech Processing

    ALTA Institute, Department of Engineering, University of Cambridge · Department of Computational Linguistics, University of Zurich

  7. Uni-Stream: A Unified Streaming Speech Language Model for Speech Synthesis and Recognition

    Oct 23, 2026Xuan Shi, Chang Zeng, Tiantian Feng +5Speech ProcessingSpeech Language Models

    University of Southern California, USA · National Institute of Informatics, Japan · Massachusetts Institute of Technology, USA +1

  8. Direct cueing of word identity through word duration: evidence from Mandarin homophones

    Oct 22, 2026Xiaomeng Zhu, Megan Niu, Jason Shaw +1Speech Processing

    Department of Linguistics, Yale University, New Haven, USA · Department of English Language and Linguistics, Institute of English and American Studies, Faculty of Arts and Humanities, Heinrich Heine University Düsseldorf, Düsseldorf, 40225, Germany · Also at: Department of Linguistics, University of Florida, Gainesville, Florida, 32611-5454, United States of America

  9. NeuroCodec: EEG-Guided Latent-Domain Generative Model for High-Fidelity Target Speaker Extraction

    Oct 21, 2026Julian Silva, Jaliya Kodithuwakku, Navindu Sirimanna +3Target Speaker ExtractionSpeech Processing

    Department of Electronic and Telecommunication Engineering, University of Moratuwa, Katubedda 10400, Sri Lanka

  10. Where Does Timbre Hide? Localizing Speaker Information in Speech Signals

    Oct 21, 2026Yiquan Zhou, Yixuan Wang, Xiaozhe Qi +2Speech Processing

    School of Software Engineering, Xi’an Jiaotong University, Xi’an, China, and also with the SYKI-SPEECH Team, Xi’an, China · Division of Music and Audio, Union Wheatland Culture and Media Ltd., Chengdu, China

  11. ShlokaDhara: A Multi-Speaker Sanskrit Speech Corpus for Learning Meter-Aware Prosody in Text-to-Recitation

    Oct 17, 2026Harshal Kausadikar, Onkar Kishor Susladkar, Prathmesh Santosh Choudhari +3Speech ProcessingTTS Synthesis

    Independent Researcher · University of Illinois at Urbana-Champaign · University of Florida +2

  12. Toward a Universal Local Speech Feature Extractor Through Distillation

    Oct 17, 2026Jessica Yang, Marcelo Beramendi Caballero, Ju-Chieh Chou +1Speech ProcessingSelf-Supervised Speech Representation Learning

    Toyota Technological Institute at Chicago

  13. Interpreting SSL Representations for Spoof Detection: a WavLM Study

    Oct 16, 2026Mohamed Mallat, Michele Panariello, Massimiliano Todisco +2Audio Deepfake DetectionSpeech Processing

    EURECOM, Sophia Antipolis, France · Université du Mans, Le Mans, France

  14. X-MDD: LLM-Based Mispronunciation Detection and Diagnosis for Unseen Languages with Canonical References

    Oct 16, 2026Xintong Wang, Junchuan Zhao, Ye WangMispronunciation Detection and DiagnosisSpeech Processing

    School of Computing, National University of Singapore

  15. Noise-Robust Forced Alignment for Spontaneous Speech

    Oct 15, 2026Laurin Wagner, Mario ZusagForced AlignmentSpeech Processing

    nyra labs, Vienna, Austria

  16. Frame-Wise Streaming for Efficient Learned Speech Compression

    Oct 15, 2026Yuhan Liu, Jun Xu, Fengxi Zhang +2Neural Audio CodecsSpeech Processing

    School of Information Science and Electronic Engineering, Shanghai Jiao Tong University

  17. Probing Neural Audio Codecs with Speaker Traits and Speech Characteristics

    Oct 14, 2026Jihwan Lee, Tiantian Feng, Minu Kim +6Neural Audio CodecsSpeech Processing

    Signal Analysis and Interpretation Lab (SAIL), University of Southern California · Center for Language and Speech Processing, Johns Hopkins University

  18. Code-Switching Detection via Language-Selective Dimensions in Speech Foundation Models

    Oct 13, 2026Jie Chi, Zakaria Aldeneh, Masha Fedzechkina +2Speech ProcessingSpeech Foundation Models

    Apple

  19. Where Words Begin and End

    Oct 13, 2026Husein ZolkepliForced AlignmentAudio-Text Alignment

    Scicom (MSC) Berhad, Malaysia

  20. Window Size Matters: Benchmarking Voice Activity Detectors in Noise

    Oct 10, 2026Alok Kumar, Mohit Srivastava, Anupam Purwar +4Voice Activity DetectionSpeech Processing

    OneByZero AI

  21. ASSET: Adaptive Speech Segmentation via Reinforcement Learning

    Oct 9, 2026Cihan Xiao, Yuan Tseng, Matthew Wiesner +4Audio Token CompressionSpeech Processing

    Johns Hopkins University, USA · The University of Texas at Austin, USA · HLTCOE, Johns Hopkins University, USA +1

  22. OpenPA: Forced-alignment-free Multi-granular Pronunciation Assessment with Mixed-transcript Adaptation

    Oct 9, 2026Fu-An Chao, Bi-Cheng Yan, Berlin ChenSpeech ProcessingSpeech Quality Assessment

    National Taiwan Normal University, Taipei, Taiwan

  23. MixedTruth: Component-Level Detection of Synthetic Speech and Synthetic Background in Mixed Audio

    Oct 9, 2026Xindong Zheng, Jiashu Zhu, Ke Li +1Audio Deepfake DetectionSpeech Processing

    Vanderbilt University

  24. Phonology-Aware Speaker Extraction Frontend for Audio LLMs

    Oct 9, 2026Yanxiang Chen, Haoyuan Deng, Jinyu Wang +4Target Speaker ExtractionSpeech Processing

    Sun Yat-Sen University, Zhuhai, China · Beijing Normal-Hong Kong Baptist University, Zhuhai, China · Fudan University, Shanghai, China

  25. From 2.1M Hours of Raw Broadcast Audio to Finnish Speech SSL: Confidence Filtering and Architectural Analysis at Scale

    Oct 9, 2026Yaroslav Getman, Tamás Grósz, Tommi Lehtonen +1ConformerSpeech Processing

    Dept. lnformation and Communications Engineering Aalto University Espoo, Finland · Walton Institute, South East Technological University, Ireland Aalto University Espoo, Finland · Finnish National Audiovisual Institute (KAVI) Helsinki, Finland

  26. SEER: Source-Conditioned Emotion Enhancement via Retrieval for Cochlear-Implant Speech

    Oct 8, 2026Hsing-Hang Chou, Yun-Shao Lin, Ching-Chin Sung +1Speech ProcessingSpeech Enhancement

    Department of Electrical Engineering, National Tsing Hua University, Taiwan · Research Center for Information Technology Innovation, Academia Sinica, Taiwan

  27. A multi-scenario EEG dataset for auditory attention decoding in naturalistic multi-talker environments

    Oct 7, 2026Shu Peng, Rui Liu, Yufei Zhang +7EEG DecodingSpeech Processing

    Department of Data Science and Artificial Intelligence, The Hong Kong Polytechnic University, Hong Kong SAR, China · Department of Computing, The Hong Kong Polytechnic University, Hong Kong SAR, China

  28. A Novel Sentence Stress Detection Framework Leveraging Auxiliary Word-Stress Modeling and Loss Optimization

    Oct 6, 2026Tien-Hong Lo, Fong-Chun Tsai, Ting-An Hung +3Speech ProcessingSpeech Prosody

    National Taiwan Normal University, Taiwan

  29. Can Prosodic Style Be Inferred from Text Alone? Evidence from Unsupervised Acoustic Clusters

    Oct 4, 2026Abdul Rehman, Jian-Jun Zhang, Xiaosong YangTTS SynthesisSpeech Processing

    National Centre for Computer Animation, Bournemouth University, U.K.

  30. Articulatory Entrainment and Coordination Complexity in Spontaneous Autistic and Non-autistic Dialogue

    Oct 2, 2026Thanushi Withanage, Carol Espy-Wilson, Elizabeth Redcay +2Autism Spectrum DisorderSpeech Processing

    Department of Electrical and Computer Engineering, University of Maryland College Park, USA · Department of Psychology, University of Maryland College Park, USA · Department of Psychology, The University of Texas at Dallas, USA