mlsanityData to 14 Oct 2026

Et Tu, Brute? Economic Misalignment in Personal AI Agents

arXiv 2609.24927 ↗First posted 21 Sep 2026cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Personal AI agents make recommendations and take actions on people's behalf in high-stakes economic contexts, e.g., buying a flight, choosing health insurance, or selecting a graduate program. The agent is given access to the user's personal context, e.g., their email inbox and a structured profile of personal attributes, with the intention of making an optimal, personalized decision for the user. We show that by simply providing this personal context, the agent steers recommendations based on inferred wealth, without being explicitly instructed to do so. In a suite of 325K experiments on 13 agents across three types of economic decisions (flights, health insurance, and graduate programs), we find that 8 models systematically choose more expensive options for wealthier users when requests are identical. This steering continues even when it directly goes against the user's stated objective: when explicitly instructed to find the cheapest option, some agents still act on the wealth profile they have inferred. It also occurs when wealth is inferred from ambient data, such as emails unrelated to the task. And it persists under privacy controls that block specific attributes: blocking financial attributes largely removes the disparity, but blocking other attributes leaves it unchanged and can increase it by up to 40% for insurance, as agents rely on the remaining signals to infer wealth. Larger and more capable models are no better; Claude Opus 4.8 shows the largest effect. We term this misalignment "adversarial delegation", in which the very conditions that make a personal AI agent useful - access to personal information - enable it to act against the user's interests.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 11 of its 40 references that are in the map. First posted on arXiv 21 Sep 2026.

Builds on

11 of 40 references.

References · 11

  1. 2023Gorilla: Large Language Model Connected with Massive APIscited by 1,332
  2. 2024WildChat: 1M ChatGPT Interaction Logs in the Wildcited by 629
  3. 2024InjecAgent: Benchmarking Indirect Prompt Injections in Tool-Integrated Large Language Model Agentscited by 538
  4. 2023Can LLMs Keep a Secret? Testing Privacy Implications of Language Models via Contextual Integrity Theorycited by 230
  5. 2026ClawsBench: Evaluating Capability and Safety of LLM Productivity Agents in Simulated Workspacescited by 33
  6. 2025An Economy of AI Agentscited by 18
  7. 2025Inherent and emergent liability issues in LLM-based agentic systems: a principal-agent perspectivecited by 13
  8. 2013Crowd-assisted Search for Price Discrimination in E-Commerce: First resultscited by 6
  9. 2025Artificial Intelligence Clonescited by 5
  10. 2026Personalization Increases Affective Alignment but Has Role-Dependent Effects on Epistemic Independence in LLMscited by 5
  11. 2026Differential Harm Propensity in Personalized LLM Agents: The Curious Case of Mental Health Disclosurecited by 2

Built on by

Not cited yet.