eess.ASOct 10, 2026

Word-Aligned Prosody Reflects Speaker Differences More Than Depression or PTSD Severity

Authors: Hsiang-Chen Yeh, Aurosweta Mahapatra, Shreeram Suresh Chandra, Ryan L. Boyd, Berrak Sisman

Organizations: Clinical Mental Health Counseling, Johns Hopkins University, Baltimore, MD, USA · Center for Language and Speech Processing (CLSP), Johns Hopkins University, Baltimore, MD, USA · College of Connected Computing, Vanderbilt University, Nashville, TN, USA

Abstract

Word-aligned prosody is increasingly used to detect depression and posttraumatic stress disorder (PTSD), yet the stability and clinical relevance of these measurements remain unclear. We examine stability at two levels. At the word level, we ask whether a speaker produces the same word in a similar speaker-specific way across different utterance contexts. At the speaker level, we ask whether averaging prosody across many words produces consistent speaker scores across separate recordings. Drawing on principles of psychological measurement, we compare these representations in four corpora spanning acted, spontaneous, and clinical speech. Word-specific deviations show little cross-context recurrence (0.01-0.16), whereas speaker summaries are highly consistent, reaching 0.997 in ESD, 0.73-0.90 in MSP-Podcast, and 0.84-0.996 in DAIC-WOZ and PTSD-STOP. Despite this consistency, associations with depression or PTSD severity do not exceed 0.15; equivalence tests exclude effects of 0.30 in all analyses and 0.20 in DAIC-WOZ, while within-person associations with daily PTSD symptoms are near zero (∣ρ∣≤0.04|ρ|\leq0.04). Thus, aggregation yields stable speaker-level prosodic measures, but these measures do not detectably track depression or PTSD severity in the studied corpora. Code is available at https://github.com/jen900704/word-aligned-prosody.

Figures & tables

Explore similar work

CardsList
  1. Depression Markers in Speech: An Approach based on Tract Variables Dynamics

    Jul 28, 2026Sahar Altalhi, Tanaya Guha, Alessandro VinciarelliDepression DetectionSpeech Processing

  2. Clinically Inspired Symptom-Guided Depression Detection from Emotion-Aware Speech Representations

    Feb 17, 2026Chaithra Nerella, Chiranjeevi YarraDepression Severity EstimationClinical Speech Processing