Evolution of Cooperation in LLM-Agent Societies: A Preliminary Study Using Different Punishment Strategies
On the map: LLM agents and tool use → Social simulation and multi-agent debate
Abstract (arXiv)
The evolution of cooperation has been extensively studied using abstract mathematical models and simulations. Recent advances in Large Language Models (LLMs) and the rise of LLM agents have demonstrated their ability to perform social reasoning, thus providing an opportunity to test the emergence of norms in more realistic agent-based simulations with human-like reasoning using natural language. In this research, we investigate whether the cooperation dynamics presented in Boyd and Richerson's model persist in a more realistic simulation of the Diner's Dilemma using LLM agents compared to the abstract mathematical nature in the work of Boyd and Richerson. Our findings indicate that agents follow the strategies defined in the Boyd and Richerson model, and explicit punishment mechanisms drive norm emergence, reinforcing cooperative behaviour even when the agent strategy configuration varies. Our results suggest that LLM-based Multi-Agent System simulations, in fact, can replicate the evolution of cooperation predicted by the traditional mathematical models. Moreover, our simulations extend beyond the mathematical models by integrating natural language-driven reasoning and a pairwise imitation method for strategy adoption, making them a more realistic testbed for cooperative behaviour in MASs.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Placed in Social simulation and multi-agent debate, one of 16 directions in LLM agents and tool use. Builds on 19 of its 42 references that are in the map. First posted on arXiv 28 Apr 2025.
Builds on
19 of 42 references.
Closest ancestors · 6
Same direction, newest first
- 2024Harnessing the power of LLMs for normative reasoning in MASs25 Mar
- 2024Norm Violation Detection in Multi-Agent Systems using Large Language Models: A Pilot Study25 Mar
- 2024Emergence of Social Norms in Generative Agent Societies: Principles and Architecture13 Mar
- 2023Do LLM Agents Exhibit Social Behavior?23 Dec
- 2023ALYMPICS: LLM Agents Meet Game Theory -- Exploring Strategic Decision-Making with AI Agents6 Nov
- 2023Generative Agents: Interactive Simulacra of Human Behavior7 Apr
Other references · 13
- 2023A Survey on Large Language Model based Autonomous Agentscited by 2,242
- 2020ALFWorld: Aligning Text and Embodied Environments for Interactive Learningcited by 1,205
- 2023AgentVerse: Facilitating Multi-Agent Collaboration and Exploring Emergent Behaviorscited by 598
- 2022ScienceWorld: Is your Agent Smarter than a 5th Grader?cited by 327
- 2023Playing repeated games with Large Language Modelscited by 217
- 2020Watch-And-Help: A Challenge for Social Perception and Human-AI Collaborationcited by 133
- 2023Can Large Language Models Serve as Rational Players in Game Theory? A Systematic Analysiscited by 92
- 2024Nicer Than Humans: How do Large Language Models Behave in the Prisoner's Dilemma?cited by 63
- 2024Can Language Models Serve as Text-Based World Simulators?cited by 52
- 2022Melting Pot 2.0cited by 40
- 2025Large language models for artificial general intelligence (AGI): A survey of foundational principles and approachescited by 18
- 2024Extracting Norms from Contracts Via ChatGPT: Opportunities and Challengescited by 2
Built on by
Citing papers per year: 2025: 3; 2026: 3.
6 papers.
- 2025LLM-Based Social Simulations Require a Boundarycited by 12
- 2025The Role of Social Learning and Collective Norm Formation in Fostering Cooperation in LLM Multi-Agent Systemscited by 9
- 2026Gender Dynamics and Homophily in a Social Network of LLM Agentscited by 5
- 2025ScheduleMe: Multi-Agent Calendar Assistantcited by 1
- 2026Social Norm Reasoning in Multimodal Language Models: An Evaluationcited by 1
- 2026Behavior is Not Enough: A Mechanism-Based Evaluation of Social Norm Emergence in LLM Societiescited by 1
- 2026Behavior is Not Enough: A Mechanism-Based Evaluation of Social Norm Emergence in LLM Societies22 Sep 2026
- 2026Social Norm Reasoning in Multimodal Language Models: An Evaluation3 Mar 2026
- 2026Gender Dynamics and Homophily in a Social Network of LLM Agents2 Feb 2026
- 2025The Role of Social Learning and Collective Norm Formation in Fostering Cooperation in LLM Multi-Agent Systems16 Oct 2025
- 2025ScheduleMe: Multi-Agent Calendar Assistant30 Sep 2025
- 2025LLM-Based Social Simulations Require a Boundary24 Jun 2025
Similar, not cited
Close in wording, no citation either way
- 2025Will Systems of LLM Agents Cooperate: An Investigation into a Social Dilemma
- 2024Shall We Team Up: Exploring Spontaneous Cooperation of Competing LLM Agents
- 2024Evolution of Social Norms in LLM Agents using Natural Language
- 2026Collective cooperation without individual fidelity in LLM agents
- 2026Payoff scaling shapes cooperation in LLM agents across languages
- 2024Cultural Evolution of Cooperation among LLM Agents
- 2024Static network structure cannot stabilize cooperation among Large Language Model agents
- 2024Cooperate or Collapse: Emergence of Sustainable Cooperation in a Society of LLM Agents