mlsanityData to 14 Oct 2026

When Assisting One Disempowers Another

arXiv 2511.04177 ↗First posted 6 Nov 2025cs.AI cs.MAcited by 1

Not on the map. Why?

Abstract (arXiv)

Personal AI agents are increasingly deployed in shared environments, where their actions affect not just the primary user they are assisting, but bystanders who never consented to being affected by the system. We show that a well-meaning AI assistant optimizing for one user's benefit can unintentionally erode a bystander's agency, a phenomenon we formalize as bystander disempowerment. We theoretically characterize the conditions under which disempowerment arises, showing it emerges when an assistant systematically selects actions that increase user empowerment at the bystander's expense. We empirically demonstrate this in Disempower-Grid, a parameterized suite of multi-agent gridworld environments, finding that between 27-96% of procedurally generated environments exhibit disempowerment, and that the presence of disempowerment depends strongly on assistant objective and capability, not just environmental structure.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 22 of its 31 references that are in the map. First posted on arXiv 6 Nov 2025.

Builds on

22 of 31 references.

References · 22

  1. 2016Concrete Problems in AI Safetycited by 1,642
  2. 2025Multi-Agent Risks from Advanced AIcited by 163
  3. 2015Variational Information Maximisation for Intrinsically Motivated Reinforcement Learningcited by 144
  4. 2023Harms from Increasingly Agentic Algorithmic Systemscited by 135
  5. 2019Optimal Policies Tend to Seek Powercited by 119
  6. 2013Empowerment -- an Introductioncited by 68
  7. 2023JaxMARL: Multi-Agent RL Environments and Algorithms in JAXcited by 63
  8. 2025Gradual Disempowerment: Systemic Existential Risks from Incremental AI Developmentcited by 46
  9. 2023Characterizing Manipulation from AI Systemscited by 43
  10. 2018Penalizing side effects using stepwise relative reachabilitycited by 38
  11. 2019Conservative Agency via Attainable Utility Preservationcited by 35
  12. 2020Avoiding Side Effects By Considering Future Taskscited by 32
10 more
  1. 2022Counterfactual harmcited by 29
  2. 2020AvE: Assistance via Empowermentcited by 27
  3. 2025The Coming Crisis of Multi-Agent Misalignment: AI Alignment Must Be a Dynamic and Social Processcited by 21
  4. 2022Parametrically Retargetable Decision-Makers Tend To Seek Powercited by 19
  5. 2024Learning to Assist Humans without Inferring Rewardscited by 13
  6. 2021Learning Altruistic Behaviours in Reinforcement Learning without External Rewardscited by 8
  7. 2025Intrinsically-Motivated Humans and Agents in Open-World Explorationcited by 8
  8. 2023A Variational Approach to Mutual Information-Based Coordination for Multi-Agent Reinforcement Learningcited by 5
  9. 2025Estimating the Empowerment of Language Model Agentscited by 3
  10. 2025In Search of a Lost Metric: Human Empowerment as a Pillar of Socially Conscious Navigationcited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.