Depression severity estimation is crucial for mental health assessment and intervention, yet traditional approaches depend on clinical interviews or self-report questionnaires that require users' active participation. With the widespread use of online social media, users leave rich social traces that may reflect their mental states, motivating the task of social media-based depression severity estimation. Existing efforts have progressed from textual-feature-based classification to LLM-based questionnaire completion over standardized scale items, yet they still fall short in user-specific mental priors modeling, diversified semantic retrieval, and fine-grained reasoning over mental evidence. To address these limitations, we propose UMer, a user-specific mental evidence reasoning framework for social traces-based depression severity estimation. UMer first distills a user-specific mental prior from historical social traces to capture the user's psychological tendencies, behavioral patterns, and self-expression style. It then performs scale-guided multi-query retrieval to construct evidence memories from item-relevant posts. Finally, it conducts coarse-to-fine evidence-aware reasoning to distinguish direct and indirect evidence and predict item-level scores with interpretable rationales. Extensive experiments on real-world benchmarks demonstrate that UMer not only achieves competitive performance over existing baselines, but also provides evidence-grounded interpretability and generalizes to other scale-based tasks.
Figures & tables
Figure 1: Existing Efforts vs. UMer.
Figure 2: Overview of UMer, a three-stage LLM-based agentic framework. The model progressively constructs the user-specific mental prior from historical social traces, retrieves item-relevant posts to construct scale-aware mental evidence memories, and performs coarse-to-fine evidence-aware reasoning for interpretable item-level scoring.
Questionnaire Metrics
Symptom Metrics
Collection
Model
DCHR % ( ↑ )
ADODL % ( ↑ )
AHR % ( ↑ )
ACR % ( ↑ )
eRisk 2020
BioInfo ‡
30.00
76.01
38.30
69.21
iLab ‡
27.14
81.70
37.07
69.41
RELAI ‡
34.29
83.15
36.39
68.32
Sense2Vec ‡
37.14
82.61
38.97
70.10
Voting †
47.14
85.33
35.24
67.41
Table 1: Depression severity estimation on eRisk 2020 and eRisk 2021. † : uses manual annotations; ‡ : involves task-specific model training. The best results are highlighted in bold , and the second-best results are underlined .
Figure 3: The score distribution between proprietary LLM and Open-weight LLM
Dataset
Objective Accuracy
Completeness
Subjective Reasonableness
eRisk-Avg
4.53
4.02
4.14
Table 2: Average scores assigned by three human annotators for each mental prior quality metric.
Configuration
MAE ( ↓ )
Symptom Metrics
Questionnaire Metrics
AHR % ( ↑ )
ACR % ( ↑ )
ADODL % ( ↑ )
DCHR % ( ↑ )
UMer
0.8082
41.97
73.77
84.13
40.00
w/o Su
0.8707
38.57
70.97
81.72
28.57
w/o SMR
0.8361
40.27
72.13
82.56
31.43
w/o EaR
0.8721
39.12
70.93
81.68
38.57
Table 3: Ablation study on eRisk 2020.
Figure 4: Generalization evaluation on eRisk 2022 and eRisk 2023 EDE-Q scoring tasks. Lower values indicate better performance.
Appendix figures & tables9 assets
Supplementary material from the paper’s appendix.
Appendix
Figure A1: Content attention analysis. "Mixed" denotes reasoning that jointly relies on information from both the mental prior and retrieved posts.
Retriever
MAE ↓
Symptom Metrics
Questionnaire Metrics
AHR % ( ↑ )
ACR % ( ↑ )
ADODL % ( ↑ )
DCHR % ( ↑ )
BGE-M3
0.8082
41.97
73.77
84.13
40.00
GTE multilingual base
0.8354
38.91
72.15
83.13
44.29
Qwen3 embedding 0.6B
0.8517
39.66
71.61
82.18
38.29
Appendix
Table A1: Performance of different embedding encoders.
Configuration
MAE ↓
Symptom Metrics
Questionnaire Metrics
AHR % ( ↑ )
ACR % ( ↑ )
ADODL % ( ↑ )
DCHR % ( ↑ )
top-25
0.8082
41.97
73.77
84.13
40.00
top-10
0.8422
39.66
71.93
82.22
30.00
top-15
0.8395
39.46
72.02
82.45
28.57
top-20
0.8388
39.18
72.04
82.93
32.86
top-30
0.8279
39.93
72.40
82.84
34.29
Appendix
Table A2: Performance of different retrieval depths.
Figure A2: Case study for mental prior
Figure A3: Prompt template for constructing the accumulated mental prior from posts.
Figure A4: Prompt template for multi-query construction.
Figure A5: Prompt template for structured reasoning and final item-level self-rating simulation.
Figure A6: Prompt template for key-LLM-based query generation.
Figure A7: Prompt template for Generalization ability Experiment.