mlsanityData to 7 Oct 2026

Unilateral Relationship Revision Power in Human-AI Companion Interaction

arXiv 2603.23315 ↗First posted 24 Mar 2026cs.CY cs.AI cs.HCcited by 1

Not on the map. Why?

Abstract (arXiv)

When providers update AI companions, users report grief, betrayal, and loss. A growing literature asks whether the norms governing personal relationships extend to these interactions. So what, if anything, is morally significant about them? I argue that this debate has missed a prior structural question: who controls the relationship, and from where? Human-AI companion interaction is a triadic structure in which the provider exercises constitutive control over the AI. I identify three structural conditions of normatively robust dyads that the norms characteristic of personal relationships presuppose and show that AI companion interactions fail all three. This reveals what I call Unilateral Relationship Revision Power (URRP): the provider can rewrite how the AI interacts from a position where these revisions are not answerable within that interaction. I argue that it is pro tanto wrong to design interactions that cultivate the norms of personal relationships while exhibiting URRP, because the design produces expectations that the structure cannot sustain. URRP has three implications: i) normative hollowing, under which the interaction elicits commitment but no agent inside it bears the resulting obligations; ii) displaced vulnerability, under which the user's emotional exposure is governed by an agent not answerable to her within the interaction; and iii) structural irreconcilability, under which the interaction cultivates norms of reconciliation but no agent inside it can acknowledge or answer for the revision. I propose design principles that partially substitute for the internal constraints the triadic structure removes. A central and underexplored problem in relational AI ethics is therefore the structural arrangement of power over the human-AI interaction itself.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 12 of its 88 references that are in the map. First posted on arXiv 24 Mar 2026.

Builds on

12 of 88 references.

References · 12

  1. 2024The Ethics of Advanced AI Assistantscited by 103
  2. 2024The Dark Side of AI Companionship: A Taxonomy of Harmful Algorithmic Behaviors in Human-AI Relationshipscited by 61
  3. 2025Why human-AI relationships need socioaffective alignmentcited by 47
  4. 2025How AI and Human Behaviors Shape Psychosocial Effects of Extended Chatbot Use: A Longitudinal Randomized Controlled Studycited by 21
  5. 2023Chatbots as social companions: How people perceive consciousness, human likeness, and social health benefits in machinescited by 17
  6. 2024Lessons From an App Update at Replika AI: Identity Discontinuity in Human-AI Relationshipscited by 15
  7. 2025Emotional Manipulation by AI Companionscited by 14
  8. 2025A Longitudinal Randomized Control Study of Companion Chatbot Use: Anthropomorphism and Its Mediating Role on Social Impactscited by 10
  9. 2025Relational Norms for Human-AI Cooperationcited by 9
  10. 2025Harmful Traits of AI Companionscited by 6
  11. 2025We Need Accountability in Human-AI Agent Relationshipscited by 5
  12. 2024Smoke Screens and Scapegoats: The Reality of General Data Protection Regulation Compliance -- Privacy and Ethics in the Case of Replika AIcited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.