A Principle-Driven Adaptive Policy for Group Cognitive Stimulation Dialogue for Elderly with Cognitive Impairment
Organizations: The Chinese University of Hong Kong · The University of Hong Kong · Guangdong Laboratory of Artificial Intelligence and Digital Economy (SZ) · Huawei
Abstract
Cognitive impairment is becoming a major public health challenge. Cognitive Stimulation Therapy (CST) is an effective intervention for cognitive impairment, but traditional methods are difficult to scale, and existing digital systems struggle with group dialogues and cognitive stimulation principles. While Large Language Models (LLMs) are powerful, their application in this context faces key challenges: cognitive stimulation dialogue paradigms, a lack of therapeutic reasoning, and static-only user modeling. To address these issues, we propose a principle-driven adaptive policy actualized through a Group Cognitive Stimulation Dialogue (GCSD) system. We first construct a dataset with over 500 hours of real-world CST conversations and 10,000+ simulated dialogues generated via our Principle-Guided Scenario Simulation strategy. Our GCSD system then integrates four core modules to overcome LLM limitations: (i) a multi-speaker context controller to resolve role confusion; (ii) dynamic participant cognitive state modeling for personalized interaction; (iii) a cognitive stimulation-focused attention loss to instill cognitive stimulation reasoning; and (iv) a multi-dimensional reward strategy to enhance response value. Experimental results demonstrate that GCSD significantly outperforms baseline models across various evaluation metrics. Future work will focus on long-term clinical validation to bridge the gap between computational performance and clinical efficacy.
Figures & tables
| Categories | Num. (Real) | Num. (Stimulation) |
|---|---|---|
| Training Dataset | ||
| Data Count | 10,502 | 9,429 |
| Total Tokens | 407,699 | 295,902 |
| Assistant Count | 160,619 | 119,370 |
| Assistant Tokens | 1,644 | 119,511 |
| Human/Elder Number | 9 | 7 |
| Models | ROUGE-L | BLEU-2 | BLEU-4 | BERTScore | Distinct-2 | Relevance | Empathy | Fluency |
|---|---|---|---|---|---|---|---|---|
| Simulated Dataset | ||||||||
| ERNIE | 17.24 | 8.32 | 7.38 | 65.35 | 53.92 | 3.05 | 3.20 | 2.90 |
| Doubao-Pro | 23.58 | 22.39 | 21.51 | 73.19 | 71.03 | 4.00 | 3.55 | 3.33 |
| GPT-4o | 21.78 | 20.38 | 20.05 | 72.46 | 67.83 | 3.67 | 3.65 | 3.45 |
| DeepSeek-671B | 21.67 | 22.13 | 22.09 | 77.29 | 73.79 | 3.59 | 3.45 | 3.36 |
| LLaMA-3.1-405B | 22.56 | 22.13 | 21.08 | 76.52 | 71.26 | 3.75 | 3.70 | 3.42 |
| Models | Win | Loss | Tie |
|---|---|---|---|
| GCSD-3b vs ERNIE | 75% | 10% | 15% |
| GCSD-3b vs GLM-4-Plus | 73% | 12% | 15% |
| GCSD-3b vs Doubao-Pro | 60% | 23% | 17% |
| GCSD-3b vs ChatGPT | 58% | 27% | 15% |
| GCSD-3b vs GPT-4o | 50% | 39% | 11% |
| GCSD-3b vs LLaMA-3.1-405B | 58% | 34% | 8% |
Conversational Agents
Conversational agents are AI systems that interact with people through multi-turn dialogue to answer questions, provide support, or complete tasks.
See all 287 papers