The Social Cost of Intelligence: Emergence, Propagation, and Amplification of Stereotypical Bias in Multi-Agent Systems
On the map: LLM agents and tool use → Social simulation and multi-agent debate
Abstract (arXiv)
Bias in large language models (LLMs) remains a persistent challenge, often leading to stereotyping and unfair treatment across social groups. While prior work has mainly focused on individual LLMs, the emergence of multi-agent systems (MAS), where multiple LLMs collaborate and communicate, introduces new and underexplored dynamics in how bias emerges, propagates, and amplifies. To systematically investigate these dynamics, we propose a simple evaluation framework with three agent-level metrics that quantify bias emergence, propagation, and amplification throughout multi-agent interaction. We evaluate MAS across three bias benchmarks under varying LLM backbones, social-group configurations, communication behaviors, and adversarial settings. Our results show that communication can trigger up to 70% new bias emergence, propagate bias across over 80% of agents, and amplify stereotypes by more than 3×. We further find that denser and competitive communication generally increases bias. Finally, we demonstrate that MAS are highly vulnerable to simple bias injection attacks, and existing defense strategies provide only limited protection. Our findings provide important insights into the fairness and robustness of multi-agent LLM systems.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Social simulation and multi-agent debate, one of 16 directions in LLM agents and tool use. Builds on 30 of its 44 references that are in the map. First posted on arXiv 13 Oct 2025.
Builds on
30 of 44 references.
Closest ancestors · 3
Same direction, newest first
- 2025Actions Speak Louder than Words: Agent Decisions Reveal Implicit Biases in Language Models29 Jan
- 2024Towards Implicit Bias Detection and Mitigation in Multi-Agent LLM Interactions3 Oct
- 2024Systematic Biases in LLM Simulations of Debates6 Feb
Other references · 27
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
- 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,906
- 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Societycited by 1,348
- 2016Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddingscited by 1,304
- 2020StereoSet: Measuring stereotypical bias in pretrained language modelscited by 911
- 2022Discovering Language Model Behaviors with Model-Written Evaluationscited by 805
- 2020CrowS-Pairs: A Challenge Dataset for Measuring Social Biases in Masked Language Modelscited by 703
- 2021BBQ: A Hand-Built Bias Benchmark for Question Answeringcited by 683
- 2018Gender Bias in Coreference Resolution: Evaluation and Debiasing Methodscited by 657
- 2020Null It Out: Guarding Protected Attributes by Iterative Nullspace Projectioncited by 442
- 2023SOTOPIA: Interactive Evaluation for Social Intelligence in Language Agentscited by 350
15 more
- 2023From Pretraining Data to Language Models to Downstream Tasks: Tracking the Trails of Political Biases Leading to Unfair NLP Modelscited by 257
- 2018Learning Gender-Neutral Word Embeddingscited by 169
- 2024PrivacyLens: Evaluating Privacy Norm Awareness of Language Models in Actioncited by 161
- 2022"I'm sorry to hear that": Finding New Biases in Language Models with a Holistic Descriptor Datasetcited by 160
- 2021RedditBias: A Real-World Resource for Bias Evaluation and Debiasing of Conversational Language Modelscited by 149
- 2024Watch Out for Your Agents! Investigating Backdoor Threats to LLM-Based Agentscited by 135
- 2021Debiasing Pre-trained Contextualised Embeddingscited by 107
- 2024Bias and Unfairness in Information Retrieval Systems: New Challenges in the LLM Eracited by 97
- 2024What Are Tools Anyway? A Survey from the Language Model Perspectivecited by 53
- 2024HAICOSYSTEM: An Ecosystem for Sandboxing Safety Risks in Human-AI Interactionscited by 42
- 2024Walking in Others' Shoes: How Perspective-Taking Guides Large Language Models in Reducing Toxicity and Biascited by 17
- 2025Mind the (Belief) Gap: Group Identity in the World of LLMscited by 12
- 2025Improving Table Understanding with LLMs and Entity-Oriented Searchcited by 3
- 2023PEFTDebias : Capturing debiasing information using PEFTscited by 2
- 2025Planning for Success: Exploring LLM Long-term Planning Capabilities in Table Understandingcited by 2
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2025Your AI Bosses Are Still Prejudiced: The Emergence of Stereotypes in LLM-Based Multi-Agent Systems
- 2026Examining Agents' Bias Amplification versus Suppression in Multi-Agent Systems
- 2025An Empirical Study of Group Conformity in Multi-Agent Systems
- 2026Bias Amplification in Multi-Agent Network: How Biased Agents Shape Opinions and Rhetoric
- 2026Emergence of Biased Consensus in Multi-Agent LLM Debates
- 2025Group size effects and collective misalignment in LLM multi-agent systems
- 2024Emergent social conventions and collective bias in LLM populations
- 2026Multi-Agent Consensus as a Cognitive Bias Trigger in Human-AI Interaction