Evolution of Social Norms in LLM Agents using Natural Language
On the map: LLM agents and tool use → Social simulation and multi-agent debate
Abstract (arXiv)
Recent advancements in Large Language Models (LLMs) have spurred a surge of interest in leveraging these models for game-theoretical simulations, where LLMs act as individual agents engaging in social interactions. This study explores the potential for LLM agents to spontaneously generate and adhere to normative strategies through natural language discourse, building upon the foundational work of Axelrod's metanorm games. Our experiments demonstrate that through dialogue, LLM agents can form complex social norms, such as metanorms-norms enforcing the punishment of those who do not punish cheating-purely through natural language interaction. The results affirm the effectiveness of using LLM agents for simulating social interactions and understanding the emergence and evolution of complex strategies and norms through natural language. Future work may extend these findings by incorporating a wider range of scenarios and agent characteristics, aiming to uncover more nuanced mechanisms behind social norm formation.
Key facts. Cited by 12 papers in the map (data through 7 Oct 2026). Placed in Social simulation and multi-agent debate, one of 16 directions in LLM agents and tool use. Builds on 6 of its 9 references that are in the map. First posted on arXiv 2 Sep 2024.
Builds on
6 of 9 references.
Closest ancestors · 2
Same direction, newest first
- 2024How Well Can LLMs Negotiate? NegotiationArena Platform and Analysis8 Feb
- 2023ALYMPICS: LLM Agents Meet Game Theory -- Exploring Strategic Decision-Making with AI Agents6 Nov
Other references · 4
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
- 2023Playing repeated games with Large Language Modelscited by 213
- 2023EvoPrompt: Connecting LLMs with Evolutionary Algorithms Yields Powerful Prompt Optimizerscited by 189
- 2023An evolutionary model of personality traits related to cooperative behavior using a large language modelcited by 18
Built on by
Citing papers per year: 2024: 1; 2025: 5; 2026: 6.
12 papers.
- 2024Emergent social conventions and collective bias in LLM populationscited by 115
- 2025Agentic Large Language Models, a surveycited by 105
- 2025Corrupted by Reasoning: Reasoning Language Models Become Free-Riders in Public Goods Gamescited by 20
- 2025The PIMMUR Principles: Ensuring Validity in Collective Behavior of LLM Societiescited by 12
- 2025SOTOPIA-S4: a user-friendly system for flexible, customizable, and large-scale social simulationcited by 10
- 2025Moloch's Bargain: Emergent Misalignment When LLMs Compete for Audiencescited by 7
- 2026Social Theory Should Be a Structural Prior for Agentic AI: A Formal Framework for Multi-Agent Social Systemscited by 4
- 2026Alignment as Iatrogenesis: Pastoral Power, Collective Pathology, and the Structural Limits of Monolingual Safety Evaluationcited by 2
- 2026Social Norm Reasoning in Multimodal Language Models: An Evaluationcited by 1
- 2026Group Selection Promotes Prosocial Prompts in Populations of LLM Agentscited by 0
- 2026Graph Feedback Controls Consensus and Clique Formation in Open-Weight Language-Model Populationscited by 0
- 2026The Hermon Moment: AI Self-Transcendence and Its Human Narrationcited by 0
- 2026The Hermon Moment: AI Self-Transcendence and Its Human Narration31 Aug 2026
- 2026Graph Feedback Controls Consensus and Clique Formation in Open-Weight Language-Model Populations13 Jul 2026
- 2026Group Selection Promotes Prosocial Prompts in Populations of LLM Agents22 Jun 2026
- 2026Social Theory Should Be a Structural Prior for Agentic AI: A Formal Framework for Multi-Agent Social Systems8 May 2026
- 2026Social Norm Reasoning in Multimodal Language Models: An Evaluation3 Mar 2026
- 2026Alignment as Iatrogenesis: Pastoral Power, Collective Pathology, and the Structural Limits of Monolingual Safety Evaluation17 Feb 2026
- 2025Moloch's Bargain: Emergent Misalignment When LLMs Compete for Audiences7 Oct 2025
- 2025The PIMMUR Principles: Ensuring Validity in Collective Behavior of LLM Societies22 Sep 2025
- 2025Corrupted by Reasoning: Reasoning Language Models Become Free-Riders in Public Goods Games29 Jun 2025
- 2025SOTOPIA-S4: a user-friendly system for flexible, customizable, and large-scale social simulation19 Apr 2025
- 2025Agentic Large Language Models, a survey29 Mar 2025
- 2024Emergent social conventions and collective bias in LLM populations11 Oct 2024
Similar, not cited
Close in wording, no citation either way
- 2025Evolution of Cooperation in LLM-Agent Societies: A Preliminary Study Using Different Punishment Strategies
- 2024Harnessing the power of LLMs for normative reasoning in MASs
- 2024Shall We Team Up: Exploring Spontaneous Cooperation of Competing LLM Agents
- 2024Are LLMs Socially Adaptive? Contrasting Belief Evolution in Large Language Models and Humans
- 2024LLM-Augmented Agent-Based Modelling for Social Simulations: Challenges and Opportunities
- 2025From the Fluency Fallacy to the Micro-to-Macro Validity Gap: Opportunities and Pitfalls of LLMs in Social Simulation
- 2024Norm Violation Detection in Multi-Agent Systems using Large Language Models: A Pilot Study
- 2024Is this the real life? Is this just fantasy? The Misleading Success of Simulating Social Interactions With LLMs