cs.CYMar 24, 2026

Unilateral Relationship Revision Power in Human-AI Companion Interaction

Authors: Benjamin Lange

Organizations: Ludwig-Maximilians-Universität München Munich Center for Machine Learning

Abstract

When providers update AI companions, users report grief, betrayal, and loss. A growing literature asks whether the norms governing personal relationships extend to these interactions. So what, if anything, is morally significant about them? I argue that this debate has missed a prior structural question: who controls the relationship, and from where? Human-AI companion interaction is a triadic structure in which the provider exercises constitutive control over the AI. I identify three structural conditions of normatively robust dyads that the norms characteristic of personal relationships presuppose and show that AI companion interactions fail all three. This reveals what I call Unilateral Relationship Revision Power (URRP): the provider can rewrite how the AI interacts from a position where these revisions are not answerable within that interaction. I argue that it is pro tanto wrong to design interactions that cultivate the norms of personal relationships while exhibiting URRP, because the design produces expectations that the structure cannot sustain. URRP has three implications: i) normative hollowing, under which the interaction elicits commitment but no agent inside it bears the resulting obligations; ii) displaced vulnerability, under which the user's emotional exposure is governed by an agent not answerable to her within the interaction; and iii) structural irreconcilability, under which the interaction cultivates norms of reconciliation but no agent inside it can acknowledge or answer for the revision. I propose design principles that partially substitute for the internal constraints the triadic structure removes. A central and underexplored problem in relational AI ethics is therefore the structural arrangement of power over the human-AI interaction itself.

Explore similar work

CardsList
  1. How Do Users Negotiate Harmful Value Conflicts with AI Companions? A Study with Minion, a Technology Probe for In-Situ Human-AI Conflict Response

    Nov 11, 2024Qing Xiao, Xianzhe Fan, Xuhui Zhou +4AI CompanionsHuman-AI Interaction

  2. Frictionless Love: Associations Between AI Companion Roles and Behavioral Addiction

    Apr 21, 2026Vibhor Agarwal, Ke Zhou, Edyta Paulina Bogucka +1AI CompanionsHuman-AI Interaction