Tapes Together Strong: The Co-evolution of Computation and Cooperation
On the map: LLM agents and tool use → Social simulation and multi-agent debate
Abstract (arXiv)
How does cooperation evolve in complex agentic systems? Prior work in evolutionary game theory studies why individuals are incentivized to cooperate by isolating social interactions from the physical costs of behavior, while artificial life models traditionally study emergent self-replication without formalizing the dilemma between acquiring resources and preserving the shared energy needed to reproduce. In contrast, we introduce Autopoietic Game Theory, a computational model where social interactions, replication mechanisms, and their associated computational costs are endogenous and simultaneously co-evolving. We study these dynamics using a computational substrate of randomly initialized programs in Z80 machine code, showing empirically, and motivating with a simplified theoretical model, that embedding a social dilemma directly into the physics of computation can favor the emergence of self-replicating, cooperative strategies. When resources are scarce, our analysis shows that defection can become self-limiting even in well-mixed populations: parasitic stealing destroys shared energy, slows execution, and can prevent reliable replication. Empirically, evolved programs suppress stealing across several Z80 environments, while spatial assortment further supports structural complexity and task performance. We further show that the framework can incorporate exogenous pressures, such as math tasks structured as sequential social dilemmas, when rewards are tied to computation budgets. These results suggest that coupling an agent's capacity for computation to its available energy transforms cooperation into a dominant scaffolding for building sustainable, self-organizing systems.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Social simulation and multi-agent debate, one of 16 directions in LLM agents and tool use. Builds on 10 of its 59 references that are in the map. First posted on arXiv 9 Sep 2026.
Builds on
10 of 59 references.
References · 10
- 2024Automated Design of Agentic Systemscited by 407
- 2017Multi-agent Reinforcement Learning in Sequential Social Dilemmascited by 209
- 2020Open Problems in Cooperative AIcited by 168
- 2020Emergent Reciprocity and Team Formation from Randomized Uncertain Social Preferencescited by 21
- 2025A Pragmatic View of AI Personhoodcited by 12
- 2025Embedded Universal Predictive Intelligence: a coherent framework for multi-agent learningcited by 9
- 2023Neural Amortized Inference for Nested Multi-agent Reasoningcited by 8
- 2025Evaluating LLMs in Open-Source Gamescited by 5
- 2026Drop the Hierarchy and Roles: How Self-Organizing LLM Agents Outperform Designed Structurescited by 3
- 2024Computational Life: How Well-formed, Self-replicating Programs Emerge from Simple Interactioncited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Dynamic Evolution of Complex Networks: A Reinforcement Learning Approach Applying Evolutionary Games to Community Structure
- 2026Co-Evolution in Agentic Systems: Toward Self-Directed Evolution Beyond Human Design
- 2024Static network structure cannot stabilize cooperation among Large Language Model agents
- 2025Super-additive Cooperation in Language Model Agents
- 2026The Energy Society: A Simulation Environment for Studying Agent Cooperation under Survival Pressure
- 2025Will Systems of LLM Agents Cooperate: An Investigation into a Social Dilemma
- 2026The Yerkes-Dodson Curve for AI Agents: Emergent Cooperation Under Environmental Pressure in Multi-Agent LLM Simulations
- 2026SAGE: A Quantitative Evaluation of Socialized Evolution in Agent Ecosystems