mlsanityData to 7 Oct 2026

Dissociative Identity: Language Model Agents Lack Grounding for Reputation Mechanisms

arXiv 2605.30169 ↗First posted 28 May 2026cs.CY cs.AI cs.MAcited by 3

On the map: LLM agents and tool use → Social simulation and multi-agent debate

Abstract (arXiv)

As autonomous language model agents proliferate, forming an emerging agentic web with real-world consequences, what credibility signals can you use to decide whether to trust an unfamiliar agent in the wild and delegate to it? A natural governance intuition is to extend human identity verification and reputation mechanisms, from "Know Your Customer" and credit scores to "Know Your Agent" regimes. However, we argue that this analogy is fundamentally incomplete. Reputation mechanisms function both as social signals and as corrective feedback that sustain an equilibrium of trustworthy behavior, presuming a persistent identity associated with behavioral continuity, sanction sensitivity, and costly non-fungibility. Yet language model agents are ontologically dissociative: they are essentially an assemblage of mutable modules--foundation models, system prompts, tool-access policies, external memory, and, in some cases, a multi-agent system as a whole--any of which may change agent behavior--with a fluid persona that is also vulnerable to adversarial attack and may not internalize sanctions. Drawing on dissociative identity disorder jurisprudence, this dissociativity leaves agents without grounding for identifiability, predictability, credibility, and rehabilitability--the very properties that reputation mechanisms aim to sustain--thereby collapsing trust. We argue that identity-based, ex post, regulative, sanction-based governance, such as reputation, is structurally inapplicable to dissociative agents, and we suggest a shift to observability-based, ex ante, constitutive, protocol-based behavioral harnesses.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Social simulation and multi-agent debate, one of 16 directions in LLM agents and tool use. Builds on 56 of its 141 references that are in the map. First posted on arXiv 28 May 2026.

Builds on

56 of 141 references.

References · 56

  1. 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,383
  2. 2022Constitutional AI: Harmlessness from AI Feedbackcited by 2,950
  3. 2023Towards Understanding Sycophancy in Language Modelscited by 988
  4. 2022A Survey on In-context Learningcited by 717
  5. 2016Stealing Machine Learning Models via Prediction APIscited by 602
  6. 2024Sleeper Agents: Training Deceptive LLMs that Persist Through Safety Trainingcited by 478
  7. 2024Jailbreaking Leading Safety-Aligned LLMs with Simple Adaptive Attackscited by 450
  8. 2024Scaling Synthetic Data Creation with 1,000,000,000 Personascited by 397
  9. 2023Toxicity in ChatGPT: Analyzing Persona-assigned Language Modelscited by 356
  10. 2025Persona Vectors: Monitoring and Controlling Character Traits in Language Modelscited by 303
  11. 2023Role-Play with Large Language Modelscited by 290
  12. 2024Continual Learning of Large Language Models: A Comprehensive Surveycited by 228
38 more
  1. 2023Playing repeated games with Large Language Modelscited by 213
  2. 2025Emergent Misalignment: Narrow finetuning can produce broadly misaligned LLMscited by 158
  3. 2023Fundamental Limitations of Alignment in Large Language Modelscited by 152
  4. 2025Multi-Agent Risks from Advanced AIcited by 150
  5. 2023Large Language Models Understand and Can be Enhanced by Emotional Stimulicited by 143
  6. 2025Measuring AI Ability to Complete Long Software Taskscited by 142
  7. 2024Exploring Large Language Model based Intelligent Agents: Definitions, Methods, and Prospectscited by 130
  8. 2025Memory Injection Attacks on LLM Agents via Query-Only Interactioncited by 127
  9. 2024Collective Constitutional AI: Aligning a Language Model with Public Inputcited by 120
  10. 2024Large Language Models are Superpositions of All Characters: Attaining Arbitrary Role-play via Self-Alignmentcited by 104
  11. 2025A survey of agent interoperability protocols: Model Context Protocol (MCP), Agent Communication Protocol (ACP), Agent-to-Agent Protocol (A2A), and Agent Network Protocol (ANP)cited by 98
  12. 2023LMRL Gym: Benchmarks for Multi-Turn Reinforcement Learning with Language Modelscited by 84
  13. 2024Visibility into AI Agentscited by 77
  14. 2026The Assistant Axis: Situating and Stabilizing the Default Persona of Language Modelscited by 76
  15. 2022I Know What You Trained Last Summer: A Survey on Stealing Machine Learning Models and Defencescited by 75
  16. 2025Authenticated Delegation and Authorized AI Agentscited by 63
  17. 2025Agentic Web: Weaving the Next Web with AI Agentscited by 43
  18. 2024AI auditing: The Broken Bus on the Road to AI Accountabilitycited by 42
  19. 2025Consistently Simulating Human Personas with Multi-Turn Reinforcement Learningcited by 35
  20. 2024Towards AI Accountability Infrastructure: Gaps and Opportunities in AI Audit Toolingcited by 27
  21. 2026The 2025 AI Agent Index: Documenting Technical and Safety Features of Deployed Agentic AI Systemscited by 27
  22. 2026Agent Drift: Quantifying Behavioral Degradation in Multi-Agent LLM Systems Over Extended Interactionscited by 26
  23. 2025Mitigating Deceptive Alignment via Self-Monitoringcited by 25
  24. 2025The Coming Crisis of Multi-Agent Misalignment: AI Alignment Must Be a Dynamic and Social Processcited by 21
  25. 2025Beyond DNS: Unlocking the Internet of AI Agents via the NANDA Index and Verified AgentFactscited by 20
  26. 2025AI Agents with Decentralized Identifiers and Verifiable Credentialscited by 17
  27. 2024Can LLMs make trade-offs involving stipulated pain and pleasure states?cited by 16
  28. 2026Intelligent AI Delegationcited by 16
  29. 2025Beyond Single-Agent Safety: A Taxonomy of Risks in LLM-to-LLM Interactionscited by 10
  30. 2025Distributional AGI Safetycited by 8
  31. 2025BetaWeb: Towards a Blockchain-enabled Trustworthy Agentic Webcited by 7
  32. 2025Reputation as a Solution to Cooperation Collapse in LLM-based MASscited by 6
  33. 2025Understanding AI Trustworthiness: A Scoping Review of AIES & FAccT Articlescited by 6
  34. 2025Position: Stop Acting Like Language Model Agents Are Normal Agentscited by 5
  35. 2025Spore in the Wild: A Case Study of Spore.fun as an Open-Environment Evolution Experiment with Sovereign AI Agents on TEE-Secured Blockchainscited by 5
  36. 2025Agent Identity Evals: Measuring Agentic Identitycited by 5
  37. 2025Behavioral Fingerprinting of Large Language Modelscited by 5
  38. 2025Binding Agent ID: Unleashing the Power of AI Agents with accountability and credibilitycited by 5

50 most cited of 56 All 56 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Language model agents show in-group trust bias invisible to standard behavioural audits
  2. 2026LLMs Trust Their Own: Identity-Dependent Conformity in Multi-Agent Systems
  3. 2026The End of Trust: How Agentic AI Breaks Security Assumptions
  4. 2026Beyond Preset Identities: How Agents Form Stances and Boundaries in Generative Societies
  5. 2025Validating Generative Agent-Based Models of Social Norm Enforcement: From Replication to Novel Predictions
  6. 2024Privacy Leakage Overshadowed by Views of AI: A Study on Human Oversight of Privacy in Language Model Agent
  7. 2026Frame Entrepreneurs in an AI Agent Community: Concentrated Identity-Claim Production on Moltbook
  8. 2026Time, Identity and Consciousness in Language Model Agents