cs.AINov 17, 2026

EDA: Observe, Verify, and Assess for Evidence-Grounded Multimodal Depression Analysis

Authors: Changzeng Fu, Ming Shang, Xinyi Zhang, Jiadong Wang, Runhao Zeng, Shiqi Zhao

Organizations: Northeastern University · Northeastern University at Qinhuangdao · Technical University of Munich · Shenzhen MSU-BIT University

Abstract

Existing multimodal depression assessment methods often summarize long recordings into global behavioral descriptions. This leaves the source and decision relevance of individual observations difficult to inspect. We propose EDA, an evidence-grounded framework organized around Observe, Verify, and Assess. In Observe, literature-informed acoustic and visual cues are localized into source-linked Evidence Records with temporal intervals and behavioral measurements. In Verify, frozen multimodal agents examine whether the cited media support each observation. The simplified Support admission policy retains positively verified records and their review grounds. In Assess, statistical descriptors and temporal events support reference-based behavioral comparison, while PHQ-9-guided text analysis provides complementary symptom evidence. Cross-modal disagreement triggers review of the original text before final selection. Experiments on D-Vlog and LMVD evaluate human-referenced cue agreement and downstream assessment utility separately. AI cue annotations achieve 91.02% accuracy against human consensus labels on shared source segments. With a frozen 7B backbone, EDA Support improves F1 over direct prediction by 7.61 and 9.88 percentage points on D-Vlog Leave-Query-Out and LMVD, respectively. These findings support explicit, source-linked behavioral evidence for inspectable multimodal depression assessment.

Figures & tables

Appendix figures & tables16 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. From Sparse Representations to Behavioral Insights for Multimodal Depression Assessment

    Oct 8, 2026Guimin Hu, Zihao Song, Jiachen Luo +2Depression DetectionMultimodal Model Interpretability

  2. EviDep: Uncertainty-Aware Multimodal Depression Estimation via Disentangled Evidential Learning

    Apr 17, 2026Fangyuan Liu, Sirui Zhao, Yangsong Zhang +5Disentangled Representation LearningEvidential Deep Learning