EngageTriBoost: Predictive Modeling of User Engagement in Digital Mental Health Intervention Using Explainable Machine Learning
Organizations: Department of Informatics, Donald Bren School of Information, University of California, Irvine, California, United States · Department of Health Policy and Management, Fielding School of Public Health University of California, Los Angeles, Los Angeles, United States · Department of Psychiatry and Psychology, Medical school University of Michigan, Michigan, United States
Abstract
Mental health challenges among young adults, are on the rise, necessitating effective solutions such as digital mental health interventions (DMHIs). Despite their promise, DMHIs face significant adoption barriers, including low initial uptake and high dropout rates. This study leverages machine learning (ML) to analyze behavioral patterns of users of a DMHI, eBridge, designed to increase the utilization of professional mental health services among at-risk college students through motivational interviewing-based online counseling. Our ensemble model, EngageTriBoost, achieved up to 84% accuracy in predicting engagement, measured by sign-ins and counselor interactions. We then applied the Shapley Additive exPlanations (SHAP) analysis which provided clear, interpretable insights into key factors influencing user engagement such as emotional dysregulation and perceived stigma, highlighting their critical effect on DMHI adoption. This study demonstrates the power of explainable ML for better understanding user engagement with DMHI to improve their adoption and achievable impact on mental health outcomes.
User Modeling
User modeling represents people's interests, knowledge, goals, and changing behavior to personalize predictions and AI assistance.
See all 151 papers