cs.AIApr 13, 2026

Dynamic Summary Generation for Interpretable Multimodal Depression Detection

Authors: Shiyu Teng, Jiaqing Liu, Hao Sun, Yu Li, Shurong Chai, Ruibo Hou, Tomoko Tateyama, Lanfen Lin, +1 more

Organizations: College of Information Science and Engineering, Ritsumeikan University, Shiga, Japan · College of Computer Science and Technology, Zhejiang University, Hangzhou, China · Faculty of Engineering, University of the Ryukyus, Japan

Abstract

Depression remains widely underdiagnosed and undertreated because stigma and subjective symptom ratings hinder reliable screening. To address this challenge, we propose a coarse-to-fine, multi-stage framework that leverages large language models (LLMs) for accurate and interpretable detection. The pipeline performs binary screening, five-class severity classification, and continuous regression. At each stage, an LLM produces progressively richer clinical summaries that guide a multimodal fusion module integrating text, audio, and video features, yielding predictions with transparent rationale. The system then consolidates all summaries into a concise, human-readable assessment report. Experiments on the E-DAIC and CMDC datasets show significant improvements over state-of-the-art baselines in both accuracy and interpretability.

Figures & tables

Explore similar work

CardsList
  1. Dep-LLM: Training-Free Depression Diagnosis via Evidence-Guided Structured Multi-factor with Reliable LLM Reasoning

    Jun 9, 2026Yiqing Lyu, Xianbing Zhao, Buzhou Tang +1LLM InferenceDepression Detection

  2. Multimodal Domain Generalization for Depression Detection: An Attention-Based BiLSTM Network with Domain-Adversarial Training

    Jul 24, 2026Ali Tabaraei, Federico Simonetta, Stavros NtalampirasDepression DetectionDomain Generalization