cs.SDNov 15, 2026

An Interpretable Acoustic Coordinate System for Japanese Consonant Morae in Dysarthric Speech

Authors: Yuma Enomoto, Misa Yamaguchi, Hiroki Nishikawa, Ittetsu Taniguchi, Kazuhide Matsunaga, Narikazu Uzawa, Takao Onoye

Organizations: Graduate School of Information Science and Technology, The University of Osaka, Japan · Graduate School of Dentistry, The University of Osaka, Japan

Abstract

Dysarthria reduces speech intelligibility, requiring self-directed rehabilitation based on fine-grained feedback to capture gradual articulatory changes. For Japanese speakers, such feedback is naturally provided in mora units due to its distinct moraic timing and consonant-vowel structure. While recent visualization methods have explored distance-based feedback, most are limited to vowels. Extending them to consonants is challenging, as generative embeddings often smooth transient spectral structures. We propose a visualization system for Japanese consonant morae that maps articulatory deviations onto a two-dimensional space defined by temporal and spectral distances from healthy reference speech. Experiments show consistent geometric separation of consonant categories, with Silhouette Coefficients exceeding 0.5 and origin-based ROC-AUC scores above 0.86. Furthermore, evaluations using real dysarthric speech achieved a high ROC-AUC of 0.897 in screening for unclear pronunciations. Perturbation tests confirm orthogonal temporal and spectral shifts, yielding a physically interpretable mapping for rehabilitation.

Explore similar work

CardsList
  1. Analyzing Speech Condition Effects in Dysarthric ASR: A Layer-wise Probing Study

    Aug 3, 2026Darwin Jelestin Muthu, Navya Gupta, Wei Lin Tay +3Speech ProcessingLow-Resource Speech Recognition

  2. Cross-lingual Retrieval-Augmented Classification for Dysarthria Severity Assessment

    Jun 22, 2026Taeyoung Jeong, Insung Lee, Du-Seong Chang +1Retrieval-Augmented ClassificationSpeech Quality Assessment

  3. Training-Free Cross-Lingual Dysarthria Severity Assessment via Phonological Subspace Analysis in Self-Supervised Speech Representations

    Apr 11, 2026Bernard Muller, Antonio Armando Ortiz Barrañón, LaVonne RobertsDysarthria AssessmentClinical Speech Processing