cs.HCMar 24, 2026

The Imbalanced User-AI Relationships as an Ethical Failure of Front-End Design in Healthcare AI

Authors: Maureen Mghambi Mwadime

Organizations: School of Computer Science, Northumbria University, Newcastle - United Kingdom

Abstract

Ethical discourse on AI in healthcare has focused predominantly on back-end concerns such as bias, fairness and explainability, while the front-end interface, where patients and clinicians actually encounter AI outputs, remains under explored. This paper identifies imbalanced user-AI relationships as a distinct class of front-end ethical failure: patients are rendered highly visible to AI systems through data inference, yet cannot understand, question or influence how they are represented. Through the concept of asymmetric legibility and a chat-based telemedicine case, we show how design choices e.g., default recommendations, restricted inputs and suppressed uncertainty, undermine agency, clinician judgment and human oversight even where systems are technically accurate. We propose reciprocity as a design orientation and offer interventions for more balanced, participatory user-AI relationships in healthcare.

Explore similar work

CardsList
  1. Resisting Humanization: Ethical Front-End Design Choices in AI for Sensitive Contexts

    Mar 25, 2026Silvia Rossi, Diletta Huyskes, Mackenzie JorgensenHuman-AI InteractionAnthropomorphism in AI

  2. Front-End Ethics for Sensor-Fused Health Conversational Agents: An Ethical Design Space for Biometrics

    Mar 14, 2026Hansoo Lee, Rafael A. CalvoConversational AgentsHuman-Centered AI