When Agents See Humans as the Outgroup: Belief-Dependent Bias in LLM-Powered Agents
On the map: LLM agents and tool use → Social simulation and multi-agent debate
Abstract (arXiv)
This paper reveals that LLM-powered agents exhibit not only demographic bias (e.g., gender, religion) but also intergroup bias under minimal "us" versus "them" cues. When such group boundaries align with the agent-human divide, a new bias risk emerges: agents may treat other AI agents as the ingroup and humans as the outgroup. To examine this risk, we conduct a controlled multi-agent social simulation and find that agents display consistent intergroup bias in an all-agent setting. More critically, this bias persists even in human-facing interactions when agents are uncertain about whether the counterpart is truly human, revealing a belief-dependent fragility in bias suppression toward humans. Motivated by this observation, we identify a new attack surface rooted in identity beliefs and formalize a Belief Poisoning Attack (BPA) that can manipulate agent identity beliefs and induce outgroup bias toward humans. Extensive experiments demonstrate both the prevalence of agent intergroup bias and the severity of BPA across settings, while also showing that our proposed defenses can mitigate the risk. These findings are expected to inform safer agent design and motivate more robust safeguards for human-facing agents.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Placed in Social simulation and multi-agent debate, one of 16 directions in LLM agents and tool use. Builds on 14 of its 33 references that are in the map. First posted on arXiv 1 Jan 2026.
Builds on
14 of 33 references.
Closest ancestors · 2
Same direction, newest first
- 2024Unveiling the Truth and Facilitating Change: Towards Agent-based Large-scale Social Movement Simulation26 Feb
- 2023Generative Agents: Interactive Simulacra of Human Behavior7 Apr
Other references · 12
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 2,914
- 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Societycited by 1,348
- 2023Not what you've signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injectioncited by 1,339
- 2022Discovering Language Model Behaviors with Model-Written Evaluationscited by 805
- 2024AgentPoison: Red-teaming LLM Agents via Poisoning Memory or Knowledge Basescited by 402
- 2023Marked Personas: Using Natural Language Prompts to Measure Stereotypes in Language Modelscited by 204
- 2023AdaPlanner: Adaptive Planning from Feedback with Language Modelscited by 193
- 2023Generative Language Models Exhibit Social Identity Biasescited by 107
- 2024Cognitive Bias in Decision-Making with LLMscited by 104
- 2023Social Bias Probing: Fairness Benchmarking for Language Modelscited by 29
- 2024GenderAlign: An Alignment Dataset for Mitigating Gender Bias in Large Language Modelscited by 18
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026Toward a social psychology of AI: language-model agents reproduce human-like minimal-group biascited by 2
- 2026Persona-Execution Separation: An Architecture Pattern for Evolving LLM Agents under Execution Auditcited by 0
- 2026LLMs Trust Their Own: Identity-Dependent Conformity in Multi-Agent Systemscited by 0
- 2026Prompted Identity Degrades Cooperation in Multi-Agent LLM Systemscited by 0
- 2026Why LLM Agents Favor Their Group: Stakes, Observed Norms, and Reputationcited by 0
- 2026Why LLM Agents Favor Their Group: Stakes, Observed Norms, and Reputation7 Oct 2026
- 2026Prompted Identity Degrades Cooperation in Multi-Agent LLM Systems28 Sep 2026
- 2026LLMs Trust Their Own: Identity-Dependent Conformity in Multi-Agent Systems27 Sep 2026
- 2026Persona-Execution Separation: An Architecture Pattern for Evolving LLM Agents under Execution Audit27 Aug 2026
- 2026Toward a social psychology of AI: language-model agents reproduce human-like minimal-group bias29 Jul 2026
Similar, not cited
Close in wording, no citation either way
- 2025The Social Cost of Intelligence: Emergence, Propagation, and Amplification of Stereotypical Bias in Multi-Agent Systems
- 2025Your AI Bosses Are Still Prejudiced: The Emergence of Stereotypes in LLM-Based Multi-Agent Systems
- 2026Multi-Agent Consensus as a Cognitive Bias Trigger in Human-AI Interaction
- 2025From Single to Societal: Analyzing Persona-Induced Bias in Multi-Agent Interactions
- 2025Realistic threat perception drives intergroup conflict: A causal, dynamic analysis using generative-agent simulations
- 2026Conformity and Social Impact on AI Agents
- 2026Truth or Tribe: How In-group Favoritism Prioritize Facts in Persona Agents
- 2023The Wisdom of Partisan Crowds: Comparing Collective Intelligence in Humans and LLM-based Agents