eess.ASNov 18, 2026

Beyond Intelligibility: Fine-Grained Perceptual Assessment of Dysarthric Speech with Auditory Large Language Models

Authors: Haotian Wei, Can Long, Wen Xian Jim, Guangzhi Sun, Zengrui Jin, Chao Zhang

Organizations: 1Tsinghua University · University of Cambridge

Abstract

Accurate assessment of dysarthric speech is vital for clinical diagnosis and rehabilitation, yet existing automated methods rely heavily on isolated, single-task models or generic speech quality metrics that fail to disentangle heterogeneous neuromotor deficits. This work presents the first systematic investigation into adapting auditory large language models (ALLMs) for multi-dimensional dysarthric speech assessment under a unified, prompt-conditioned framework. Four representative ALLMs are benchmarked across five clinical perceptual dimensions from the Speech Accessibility Project (SAP): naturalness, monopitch, intelligibility, imprecise consonants, and inappropriate silences. To bridge generic perceptual quality and clinical evaluation, a two-stage training paradigm is explored, leveraging out-of-domain pre-training followed by in-domain clinical adaptation. Experimental results demonstrate that leading ALLMs reliably capture fine-grained pathological variations, exhibiting distinct and complementary strengths across prosodic and articulatory attributes. These findings establish ALLMs as a scalable foundation for clinical speech evaluation and provide practical insights into model selection and multi-task transfer potential.

Figures & tables

Explore similar work

CardsList
  1. When Audio-Language Models Fail to Leverage Multimodal Context for Dysarthric Speech Recognition

    May 4, 2026Pehuén Moure, Niclas Pokel, Bilal Bounajma +4Audio-Language Model EvaluationASR Evaluation

  2. Augmenting Dysarthric Speech Severity Assessment with MOS Supervision

    Jun 17, 2026Kaimeng Jia, Minzhu Tu, Zengrui Jin +2Speech Quality AssessmentSpeech Processing

  3. Something from Nothing: Data Augmentation for Robust Severity Level Estimation of Dysarthric Speech

    Mar 16, 2026Jaesung Bae, Xiuwen Zheng, Minje Kim +2Speech Quality AssessmentDysarthria Assessment