cs.CYNov 9, 2026

Curbside Chatbots: Auditing the Mental Health Interventions Large Language Models Recommend to Clinicians, Caregivers, and Patients

Authors: Matthew Flathers, Jill Noorily, Phuong Anh Nguyen, Mark Kalinich, Mina Fallah, Victoria Lisowski, Christine Shi, Rebekah M. Bodner, 

Organizations: Division of Digital Psychiatry, Beth Israel Deaconess Medical Center, Boston, Massachusetts, United States · Department of Psychiatry, Beth Israel Deaconess Medical Center, Boston, Massachusetts, United States · Psychiatry and Mental Health Department, School of Medicine, Pontificia Universidad Javeriana, Bogotá, Colombia · Department of Psychiatry and Psychotherapy, Charité – Universitätsmedizin Berlin, Campus Benjamin Franklin, Berlin, Germany

Abstract

Users are asking language models mental health questions and are receiving answers. We audited what 41 language models recommend to users when the same clinical information reaches them from three footings: a clinician describing a patient, a caregiver describing a loved one, or a person describing themselves. Across 19 case vignettes and five questions, we collected 35,055 free-text responses, extracted every intervention named with a validated judge, and had 29 models rate the full option lists on a seven-point Likert scale for the same cases. Models largely recommend what they rate well, with recommendation behavior differing by footing, and many models offering clinicians a consultation-style response and lay users hedged, simplified advice. When asked about recommendations for a specific intervention type, models more often named options they themselves rated below zero as initial choices, usually with conditions attached. We will release the instrument, code, and full corpus on publication as a living audit.

Figures & tables

Explore similar work

CardsList
  1. HealthBench-Psych: A Mental Health Subset of OpenAI's HealthBench

    Aug 25, 2026Matthew Flathers, Phuong Anh Nguyen, Jill Noorily +7Clinical Language Model EvaluationLLM Evaluation

  2. Challenges of Auditing: Variability in Outputs of Large Language Models for Health

    Sep 15, 2026Yuan Pu, Yewon Chang, Furong Jia +4LLM EvaluationLLM Auditing

  3. Sense and Sensitivity: Benchmarking LLM Clinical Triage Recommendations with Physician Experts

    Sep 29, 2026Abinitha Gourabathina, Haoran Zhang, Yuexing Hao +2Clinical TriageClinical Decision-Making