An Interactive LLM-Based Simulator for Dementia-Related Activities of Daily Living
Organizations: Worcester Polytechnic Institute Worcester, Massachusetts, USA · University of California Davis Sacramento, CA, USA · MGH Institute of Health Professionals Boston, MA, USA · University of New Hampshire Boston, MA, USA
Abstract
Effective dementia caregiving requires training and adaptive communication, but assistive AI and robotics are constrained by a lack of context-rich, privacy-sensitive data on how people living with Alzheimer's disease and related dementias (ADRD) behave during activities of daily living (ADLs). We introduce a web-based simulator that uses a large language model (gpt-5-mini) to generate multi-turn, severity- and care-setting-conditioned patient behaviors during ADL assistance, pairing utterances with lightweight behavioral cues (in parentheses). Users set dementia severity, care setting (and time in setting), and ADL; after each patient turn they rate realism (1-5) with optional critique, then respond as the caregiver via free text or by selecting/editing one of four strategy-scaffolded suggestions (Recognition, Negotiation, Facilitation, Validation). We ran an online formative expert-in-the-loop study (14 dementia-care experts, 18 sessions, 112 rated turns). Simulated behavior was judged moderately to highly plausible, with a typical session length of six turns. Experts wrote custom replies for 54.5 percent of turns; Recognition and Facilitation were the most-used suggested strategies. Thematic analysis of critiques produced a six-category failure-mode taxonomy, revealing recurring breakdowns in ADL grounding and care-setting consistency and guiding prompt/workflow refinements. The simulator and logged interactions enable an evidence-driven refinement loop toward validated patient-caregiver co-simulation and support data collection, caregiver training, and assistive AI and robot policy development.
Figures & tables
| Characteristic | Category | n (%) |
| Age range | 18–24 | 1 (7.1%) |
| 25–34 | 1 (7.1%) | |
| 35–44 | 6 (42.9%) | |
| 45–54 | 5 (35.7%) | |
| 55–64 | 1 (7.1%) | |
| 65+ | 0 (0.0%) |
| Failure mode | Definition | Example excerpt | Freq. | Design implication / mitigation |
| Stage mismatch | Comment suggests the response does not match the selected dementia stage (too coherent/able or too impaired/disoriented). | Expected more resistance; response seems closer to early-stage dementia. | 5 (25%) | Tighten stage constraints (memory/orientation/language) and cap planning/initiative; add guardrails for severe stages. |
| Task/ADL grounding error | Comment flags implausible ADL steps, sequencing, assumptions about task setup, or multi-step planning beyond expected ability. | Multi-step ADL planning (e.g., wiping + tucking napkin) may exceed moderate-stage capacity. | 9 (45%) | Refine ADL step plans and enforce step-local responses; add object-location context and prevent skipping without caregiver guidance. |
| Care-setting mismatch | Comment indicates the PLWD behavior depends on or contradicts the selected environment (e.g., home vs facility; where objects are stored). | Assisted-living workflows: medications are centralized (not stored with the resident). | 4 (20%) | Add setting-specific constraints (storage policies, routines) and use duration to modulate familiarity; avoid inconsistent assumptions. |
| Overcompliance / low resistance | Comment suggests the simulated PLWD is too agreeable/compliant and should show more refusal, anxiety, or resistance. | PLWD is too agreeable given selected challenges (distraction/anxiety/refusal). | 5 (25%) | Increase probability of hesitation/refusal in moderate/late stages and when challenges are present; require repeated cues before progress. |
| Language/utterance unnaturalness | Comment critiques phrasing (overly well-formed, too long/complex, inappropriate word choice) relative to expected communication ability. | Utterance is overly well-structured/verbose; clinicians suggested shorter, simpler phrasing. | 5 (25%) | Constrain to simpler phrasing; discourage formal grammar; avoid infantilizing terms; permit more nonverbal actions instead of naming objects. |
| Needs more prompting / support | Comment suggests the scenario should require repeated prompting, nudging, or more caregiver assistance across turns. | Even when plausible, progress often requires nudging and repeated reminding across turns. | 4 (20%) | Prompt the PLWD model to stall/ask for clarification; progress only with repeated caregiver prompts in moderate/late stages. |