When Identity Overrides Incentives: Representational Choices as Governance Decisions in Multi-Agent LLM Systems
On the map: LLM agents and tool use → Social simulation and multi-agent debate
Abstract (arXiv)
Multi-agent systems built on large language models are increasingly deployed in strategic policy and governance settings, where agents representing stakeholders with conflicting interests must coordinate under shared constraints. These systems typically assign role-based personas to agents, describing their motivations and objectives. Whether agents with role-based identities follow explicit payoffs or their assigned roles in strategic decision-making remains untested. Here we show that assigning role-based personas suppresses payoff-aligned behavior in four-agent strategic games, shifting equilibrium attainment by up to 90 percentage points even when agents have complete payoff information. We test a 2x2 factorial design (persona presence x payoff visibility) across four models (Qwen-7B, Qwen-32B, Llama-8B, Mistral-7B), and 53 environmental policy scenarios with two equilibria: Tragedy of the Commons, where individual payoff dominates, and Green Transition, where collective payoff dominates. With personas present, all models reach near-zero Tragedy equilibrium in the Tragedy-dominant scenarios despite complete payoff information, and 100% of equilibria correspond to Green Transition. No model reaches Tragedy equilibrium by removing personas alone; only Qwen models reach 65-90% Tragedy equilibrium rates when personas are removed, and payoffs are made explicit. Three distinct behavioral profiles emerge: Qwen shifts equilibrium selection based on framing condition, Mistral increases response variance without reaching the Tragedy equilibrium, and Llama holds near-constant across all conditions. Representational choices in multi-agent LLM systems are governance decisions: persona assignment determines which equilibrium a simulation produces, independent of the underlying incentive structure.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Social simulation and multi-agent debate, one of 16 directions in LLM agents and tool use. Builds on 25 of its 58 references that are in the map. First posted on arXiv 15 Jan 2026.
Builds on
25 of 58 references.
Closest ancestors · 5
Same direction, newest first
- 2024How Well Can LLMs Negotiate? NegotiationArena Platform and Analysis8 Feb
- 2023Generative agent-based modeling with actions grounded in physical, social, or digital space using Concordia6 Dec
- 2023EconAgent: Large Language Model-Empowered Agents for Simulating Macroeconomic Activities16 Oct
- 2023Encouraging Divergent Thinking in Large Language Models through Multi-Agent Debate30 May
- 2023Generative Agents: Interactive Simulacra of Human Behavior7 Apr
Other references · 20
- 2021Training Verifiers to Solve Math Word Problemscited by 9,743
- 2023AgentBench: Evaluating LLMs as Agentscited by 1,211
- 2022Using Large Language Models to Simulate Multiple Humans and Replicate Human Subject Studiescited by 506
- 2025Multi-Agent Collaboration Mechanisms: A Survey of LLMscited by 424
- 2022Social Simulacra: Creating Populated Prototypes for Social Computing Systemscited by 300
- 2023Large Language Models Empowered Agent-based Modeling and Simulation: A Survey and Perspectivescited by 253
- 2023Playing repeated games with Large Language Modelscited by 213
- 2024Black-Box Access is Insufficient for Rigorous AI Auditscited by 123
- 2023Generative Language Models Exhibit Social Identity Biasescited by 107
- 2023Can Large Language Models Serve as Rational Players in Game Theory? A Systematic Analysiscited by 91
- 2024How Far Are We on the Decision-Making of LLMs? Evaluating LLMs' Gaming Ability in Multi-Agent Environmentscited by 66
- 2024Nicer Than Humans: How do Large Language Models Behave in the Prisoner's Dilemma?cited by 62
8 more
- 2023MAgIC: Investigation of Large Language Model Powered Multi-Agent in Cognition, Adaptability, Rationality and Collaborationcited by 56
- 2023Strategic Behavior of Large Language Models: Game Structure vs. Contextual Framingcited by 49
- 2025Position is Power: System Prompts as a Mechanism of Bias in Large Language Models (LLMs)cited by 19
- 2025Game Theory Meets Large Language Models: A Systematic Survey with Taxonomy and New Frontierscited by 14
- 2025LLM Strategic Reasoning: Agentic Study through Behavioral Game Theorycited by 14
- 2023Algorithms as Social-Ecological-Technological Systems: an Environmental Justice Lens on Algorithmic Auditscited by 12
- 2024Mapping the individual, social, and biospheric impacts of Foundation Modelscited by 8
- 2025Beyond Nash Equilibrium: Bounded Rationality of LLMs and humans in Strategic Decision-makingcited by 8
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Social Catalysts, Not Moral Agents: The Illusion of Alignment in LLM Societies
- 2026Payoff scaling shapes cooperation in LLM agents across languages
- 2026From Biased Chatbots to Biased Agents: Examining Role Assignment Effects on LLM Agent Robustness
- 2026Probing Outcome-Level Resemblance and Mechanism-Level Alignment in LLM Risk Decisions: Evidence from the St. Petersburg Game
- 2026Even More Deception: Objective Misalignment in Mixed-Motive LLM Multi-Agent Systems
- 2025Understanding LLM Agent Behaviours via Game Theory: Strategy Recognition, Biases and Multi-Agent Dynamics
- 2026Governance at the Boundary: How Agent Decomposition Degrades Policy Compliance
- 2025When Ethics and Payoffs Diverge: LLM Agents in Morally Charged Social Dilemmas