mlsanityData to 7 Oct 2026

Emergence of Reputation-Based Cooperation in LLM Agents

arXiv 2608.04507 ↗First posted 5 Aug 2026cs.MA cs.NEcited by 1

On the map: LLM agents and tool use → Social simulation and multi-agent debate

Abstract (arXiv)

Can cooperation among large language model (LLM) agents be evolutionarily stable against free-rider invasion? We study an indirect reciprocity donation game where LLM agents observe behavioral traces and donate on a continuous scale. Strategies, represented as natural language prompts, evolve through cultural transmission across generations. Across four LLM backends, robustness to free-rider invasion varies by more than an order of magnitude. The strongest predictor of this robustness is opponent endowment sensitivity, the degree to which agents discriminate between cooperative and uncooperative opponents, operationalizing the classical Image Scoring mechanism. By contrast, adherence to the Leading-Eight L1 norm does not predict robustness. Robustness depends on defector exclusion: while both cooperator reward and defector punishment vary across models, only the stringency of defector exclusion predicts resistance to free-rider invasion. These findings reveal that LLM agents are confined to Image Scoring-like discrimination and fail to develop the more robust Leading-Eight norms, highlighting a fundamental vulnerability in culturally evolved LLM cooperation and motivating bottom-up approaches to norm construction.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Social simulation and multi-agent debate, one of 16 directions in LLM agents and tool use. Builds on 12 of its 42 references that are in the map. First posted on arXiv 5 Aug 2026.

Builds on

12 of 42 references.

Closest ancestors · 1

Same direction, newest first

  1. 2024Cultural Evolution of Cooperation among LLM Agents13 Dec

Other references · 11

  1. 2022Training language models to follow instructions with human feedbackcited by 15,712
  2. 2022Constitutional AI: Harmlessness from AI Feedbackcited by 2,950
  3. 2023Playing repeated games with Large Language Modelscited by 213
  4. 2020Open Problems in Cooperative AIcited by 167
  5. 2023Can Large Language Models Serve as Rational Players in Game Theory? A Systematic Analysiscited by 91
  6. 2024Nicer Than Humans: How do Large Language Models Behave in the Prisoner's Dilemma?cited by 62
  7. 2023Strategic Behavior of Large Language Models: Game Structure vs. Contextual Framingcited by 49
  8. 2024A new sociology of humans and machinescited by 32
  9. 2024Economics Arena for Large Language Modelscited by 17
  10. 2024Cultural evolution in populations of Large Language Modelscited by 12
  11. 2023Evolutionary stability of cooperation in indirect reciprocity under noisy and private assessmentcited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026Payoff scaling shapes cooperation in LLM agents across languages
  2. 2026Collective cooperation without individual fidelity in LLM agents
  3. 2026Group Selection Promotes Prosocial Prompts in Populations of LLM Agents
  4. 2025Evolution of Cooperation in LLM-Agent Societies: A Preliminary Study Using Different Punishment Strategies
  5. 2024Static network structure cannot stabilize cooperation among Large Language Model agents
  6. 2025Will Systems of LLM Agents Cooperate: An Investigation into a Social Dilemma
  7. 2025Corrupted by Reasoning: Reasoning Language Models Become Free-Riders in Public Goods Games
  8. 2025When Trust Collides: Decoding Human-LLM Cooperation Dynamics through the Prisoner's Dilemma