Clinical Speech Processing

Ask about this topic

Overview

Clinical speech processing studies how speech can be measured and interpreted to support tasks such as transcription, speaker diarization, disease screening, severity assessment, and longitudinal monitoring. Common approaches include adapting automatic speech recognition to clinical vocabularies and atypical speech, analyzing acoustic features or self-supervised speech representations, and combining audio with text, clinical prompts, or language models. Work spans conditions including Parkinson’s disease, dementia, depression, dysarthria, aphasia, and stuttering, with benchmarks increasingly testing cross-speaker, cross-language, and cross-corpus performance. A central challenge is that strong results on a particular dataset may reflect demographic or recording differences rather than clinical signals, so robust external validation, fairness checks, privacy protection, and harmonized measures remain important.

Latest papers

CardsList

57 papers13 papers in the last four weeks, up 86% on the four weeks before. 0.1% of all new papers.

  1. Improved automatic speech-based cognitive assessment using neuropsychologically calibrated diagnostic labels

    Oct 20, 2026Madhurananda Pahar, Caitlin Illingworth, Adam Hampshire +5Speech-Based Dementia DetectionClinical Speech Processing

    School of Computer Science, The University of Sheffield, Sheffield, S1 4DP, UK · Sheffield Institute for Translational Neuroscience (SITraN), The University of Sheffield, Sheffield, S10 2HQ, UK · Centre for Neuroimaging Sciences, IoPPN, King’s College London, London, UK +1

  2. AudiPsy: Evidence-Grounded Multimodal Reasoning over Spoken Counseling Conversations for Depression Assessment

    Oct 20, 2026Chuanbo Zhu, Run Luo, Weibo Zhao +6Depression DetectionClinical Speech Processing

    The Hong Kong University of Science and Technology · National University of Singapore · University of the Chinese Academy of Sciences +2

  3. Pronouncing Hard Words: Phoneme Adaptation of a Pretrained Conversational Text to Speech Model

    Oct 16, 2026Yashish M. Siriwardena, Dinesh K. Gnanasekaran, Tanmay Laud +3TTS SynthesisControllable Speech Generation

    Hippocratic AI · Carnegie Mellon University

  4. Disentangling Depression from Cognitive Decline in Elderly Speech Using Concurrent Clinical Assessments

    Oct 15, 2026Woori Jeon, Seunghee Ha, Sang-Kyu Lee +5Depression DetectionClinical Speech Processing

    Sogang University, South Korea · Hallym University, South Korea · Sungshin Women’s University, South Korea

  5. Automatic Sentence Completion Using Bengali Audio Speech with a Transformer-Based Early Speech Recognition System

    Oct 15, 2026Md Asif Akram, Arif Faisal, Sakir Hossain Faruque +1Speech-Based Dementia DetectionClinical Speech Processing

    Department of Computer Science and Engineering, Daffodil International University, Dhaka-1216, Bangladesh

  6. MedSonor: Learning to Use Clinical Audio in Medical LLMs

    Oct 14, 2026Geyang Yu, Junying Chen, Benyou WangMedical LLMsAudio-Language Models

    The Chinese University of Hong Kong, Shenzhen

  7. From Detection To Anticipation: Continuous Onset Forecasting For Stuttered Speech

    Oct 13, 2026Tampu Ravi Kumar, Ayoub Daliri, Vivek GuptaClinical Speech Processing

    School of Computing and Augmented Intelligence, Arizona State University, USA · College of Health Solutions, Arizona State University, USA

  8. Word-Aligned Prosody Reflects Speaker Differences More Than Depression or PTSD Severity

    Oct 10, 2026Hsiang-Chen Yeh, Aurosweta Mahapatra, Shreeram Suresh Chandra +2Speech ProsodyClinical Speech Processing

    Clinical Mental Health Counseling, Johns Hopkins University, Baltimore, MD, USA · Center for Language and Speech Processing (CLSP), Johns Hopkins University, Baltimore, MD, USA · College of Connected Computing, Vanderbilt University, Nashville, TN, USA

  9. AegisVox: Factorized Privacy and Clinical Preservation for Long-Form Speech

    Oct 10, 2026Praphul Singh, Akshat Agarwal, Ratul Ghosh +5Speaker AnonymizationSpeech Editing

    Oracle Health AI

  10. AphaVoice: Text-to-Speech Model for Aphasia Patient Simulation

    Oct 10, 2026Al Varrel Putra Kusuma, Fernando Bello, Joshua BrownTTS SynthesisClinical Speech Processing

    Imperial College London, United Kingdom

  11. Self-Supervised Speech Representations for Cross-Speaker Dysarthria Detection During Awake Craniotomy

    Oct 8, 2026Kanthila Chinmayi, Abdallah Nassib, Misy Harrison +4Dysarthria AssessmentClinical Speech Processing

    IRDL, LaTIM · LARIS · LaTIM +2

  12. Personalized Automatic Speech Recognition for a Dysarthric and Tracheostomic Speaker using Artificial Conversations

    Oct 2, 2026David Nadrchal, Monorama Swain, Florian Schmid +2Personalized Speech RecognitionAutomatic Speech Recognition

    Institute of Computational Perception (CP-JKU) Johannes Kepler University Linz Linz, Austria

  13. Role-guided Speaker Deletion Verification in Clinical Psychiatry Speech Recordings with Audio Language Models

    Sep 29, 2026Joseph T Colonel, Daniel Katzman, Kelsey Kirker +6Audio-Language Model EvaluationSpeaker Verification

    Icahn School of Medicine at Mount Sinai, Department of Psychiatry, New York, NY, USA

  14. Deep Learning Techniques for Phoneme Recognition in Italian Children' s Speech

    Sep 27, 2026Nicola Barbaro, Cristina Gena, Francesco Petriglia +3ConformerAutomatic Speech Recognition

    University of Turin, Computer Science Department, Via Pessinetto 12, 10149 Turin, Italy · Fondazione Paideia Ente Filantropico, Via Moncalvo 1, 10131 Turin, Italy

  15. Why Alzheimer's Speech Screening Fails to Generalize: Bridging the Deployment Gap via Cross-Corpus Evidence Anchoring

    Sep 25, 2026Zijian Lu, Sizhe Liu, Yin Zhang +6Speech-Based Dementia DetectionDomain Generalization

    Nanjing University of Posts and Telecommunications, Nanjing, China · University of Science and Technology of China, Hefei, China · Shouyi Technology, Hefei, China +1

  16. Towards clinical adoption of voice and speech as measures of health: the need for harmonization

    Sep 24, 2026Nicholas Cummins, Vikram Ramanarayanan, Daniel Low +9Speech ProcessingClinical Speech Processing

    Institute of Psychiatry, Psychology and Neuroscience, King’s College London, UK · NIHR Biomedical Research Centre: Maudsley, UK · Modality.AI Inc, San Francisco, California, USA +12

  17. Automatic estimation of verbal fluency index in people with Motor Neuron Disease using ASR alignment and pause modelling

    Sep 22, 2026Bahman Mirheidari, Leslie Ing, Daniel Blackburn +3Clinical Speech ProcessingSpeech Processing

    School of Computer Science, University of Sheffield, UK · Sheffield Institute for Translational Neuroscience (SITraN) · Department of Psychology, School of Philosophy, Psychology and Language Sciences, University of Edinburgh, UK +1

  18. Cross-Lingual Parkinson's Disease Severity Assessment Using Pre-trained Speech Embeddings: A Multi-Class Evaluation

    Sep 16, 2026Simon Pals, Cristian Tejedor-GarciaParkinson's Disease Detection from SpeechParkinson's Disease

    Centre for Language Studies Radboud University Nijmegen, the Netherlands

  19. Bridging the Modality Gap in Long-Form Clinical Audio: A Comparative Study of Lightweight and Heavyweight End-to-End SOAP Generation

    Sep 13, 2026Ziyu Zhang, Mingchen Shao, Wenjie Tian +3Medical Report GenerationClinical Speech Processing

  20. Exploiting Speech LLM Representations for Multilingual and Cross-Lingual Parkinson's Disease Detection

    Sep 13, 2026Sarthak Giri, Zi Haur Pang, Tatsuya KawaharaParkinson's Disease Detection from SpeechParkinson's Disease

    Graduate School of Informatics, Kyoto University, Japan

  21. Benchmarking Open-Source Speech Emotion Recognition in Naturalistic Mandarin Spine Clinic Consultations: A Pilot Validation Study

    Aug 24, 2026Tsz Yuet Yeung, Zonglin He, Dong Chen +3Speech Emotion RecognitionClinical Speech Processing

    The LKS Faculty of Medicine, The University of Hong Kong, Hong Kong SAR · The University of Hong Kong-Shenzhen Hospital, Shenzhen

  22. Separating Voice from Age in COPD Screening

    Aug 21, 2026George P. Kafentzis, Nikoletta ArvanitiClinical Speech Processing

    Department of Computer Science, University of Crete

  23. Motor, Cognitive, or Corpus? What Survives Cross-Lingual Transfer in Speech-Based Parkinsons Disease Detection

    Aug 13, 2026Serli Kopar, Sam Gijsen, Abner Hernandez +2Cross-Lingual TransferSpeech Processing

    Hertie Institute for AI in Brain Health, University of Tübingen, Tübingen, Germany · Tübingen AI Center, University of Tübingen, Tübingen, Germany · Charité–Universitätsmedizin, Department of Psychiatry and Psychotherapy, Berlin, Germany +1

  24. myMediWhisper: Construction of Burmese Medical Speech Corpus and Whisper Fine-Tuning for Clinical Dialogue ASR

    Aug 11, 2026Ye Kyaw Thu, Ye Bhone Lin, Thura Aung +6Speech ProcessingAutomatic Speech Recognition

    National Electronics and Computer Technology Center (NECTEC), Thailand · Language Understanding Laboratory, Myanmar · King Mongkut’s University of Technology Thonburi, Thailand +1

  25. Normal-Anchored First-Order Model-Agnostic Meta-Learning based Whisper Fine-Tuning for Enhancing Fairness of Cleft Lip and Palate Speech Recognition

    Jul 31, 2026Susmita Bhattacharjee, Jagabandhu Mishra, H. S. Shekhawat +2Speech Foundation ModelsMeta-Learning

    Department of Electronics and Electrical Engineering, Indian Institute of Technology Guwahati, Guwahati, 781039, Assam, India · School of Computing, University of Eastern Finland, Joensuu, Finland · Brigham and Women’s Hospital, Harvard Medical School, Boston, MA, United States +1

  26. Synthetic Speech, Real Signal: Paralinguistic Preservation and Cross-Lingual Augmentation via Voice Cloning

    Jul 24, 2026Roseline Polle, Owen Parsons, George Fairs +5Synthetic Data AugmentationSpeech Processing

    thymia, UK · The University of Edinburgh, UK · University of Southampton, UK

  27. SamaVaani: Auditing and Debiasing Multilingual Clinical ASR for Indian Languages

    Jun 25, 2026Subham Kumar, Prakrithi Shivaprakash, Abhishek Manoharan +7ASR EvaluationDemographic Bias in ASR

    IIT, Kharagpur · NIMHANS, Bangalore · LGBRIMH, Tezpur

  28. Cross-lingual Retrieval-Augmented Classification for Dysarthria Severity Assessment

    Jun 22, 2026Taeyoung Jeong, Insung Lee, Du-Seong Chang +1Retrieval-Augmented ClassificationSpeech Quality Assessment

    Department of Artificial Intelligence, Sogang University, South Korea

  29. SpeechDx: A Multi-Task Benchmark for Clinical Speech AI

    Jun 15, 2026Sejal Bhalla, Larry Kieu, Aina Merchant +2Speech ProcessingSelf-Supervised Speech Representation Learning

    University of Toronto, Canada

  30. Beyond Binary: Speech Representations Across the Cognitive Score Hierarchy

    May 26, 2026Serli Kopar, Roshan Prakash Rane, Christian Mychajliw +6Speech ProcessingAudio Understanding

    Hertie Institute for AI in Brain Health, University of Tübingen, Tübingen, Germany · Tübingen AI Center, University of Tübingen, Tübingen, Germany · Department of Psychology, Humboldt-Universität zu Berlin +8