The Machine Psychology of Cooperation: Can GPT models operationalise prompts for altruism, cooperation, competitiveness and selfishness in economic games?
Not on the map. Why?
Abstract (arXiv)
We investigated the capability of the GPT-3.5 large language model (LLM) to operationalize natural language descriptions of cooperative, competitive, altruistic, and self-interested behavior in two social dilemmas: the repeated Prisoners Dilemma and the one-shot Dictator Game. Using a within-subject experimental design, we used a prompt to describe the task environment using a similar protocol to that used in experimental psychology studies with human subjects. We tested our research question by manipulating the part of our prompt which was used to create a simulated persona with different cooperative and competitive stances. We then assessed the resulting simulacras' level of cooperation in each social dilemma, taking into account the effect of different partner conditions for the repeated game. Our results provide evidence that LLMs can, to some extent, translate natural language descriptions of different cooperative stances into corresponding descriptions of appropriate task behaviour, particularly in the one-shot game. There is some evidence of behaviour resembling conditional reciprocity for the cooperative simulacra in the repeated game, and for the later version of the model there is evidence of altruistic behaviour. Our study has potential implications for using LLM chatbots in task environments that involve cooperation, e.g. using chatbots as mediators and facilitators in public-goods negotiations.
Key facts. Cited by 22 papers in the map (data through 7 Oct 2026). Builds on 24 of its 213 references that are in the map. First posted on arXiv 13 May 2023.
Builds on
24 of 213 references.
References · 24
- 2017Attention Is All You Needcited by 59,932
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
- 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,579
- 2019Fine-Tuning Language Models from Human Preferencescited by 2,124
- 2022Survey of Hallucination in Natural Language Generationcited by 2,056
- 2022Using Large Language Models to Simulate Multiple Humans and Replicate Human Subject Studiescited by 506
- 2020Artificial Intelligence, Values and Alignmentcited by 443
- 2022Using cognitive psychology to understand GPT-3cited by 389
- 2023Toxicity in ChatGPT: Analyzing Persona-assigned Language Modelscited by 356
12 more
- 2023ChatGPT: Jack of all trades, master of nonecited by 204
- 2022Talking About Large Language Modelscited by 174
- 2020Open Problems in Cooperative AIcited by 167
- 2022Thinking Fast and Slow in Large Language Modelscited by 136
- 2016The Off-Switch Gamecited by 97
- 2015A Primer on Neural Network Models for Natural Language Processingcited by 75
- 2022Do Large Language Models know what humans know?cited by 60
- 2023Perception, performance, and detectability of conversational artificial intelligence across 32 university coursescited by 12
- 2023ChatGPT: Vision and Challengescited by 11
- 2023Foundation Models for Natural Language Processing -- Pre-trained Language Models Integrating Mediacited by 8
- 2023Evidence of behavior consistent with self-interest and altruism in an artificially intelligent agentcited by 6
- 2022Measuring an artificial intelligence agent's trust in humans using machine incentivescited by 5
Built on by
Citing papers per year: 2023: 6; 2024: 4; 2025: 5; 2026: 7.
22 papers.
Sort:
By area:
- 2023The Rise and Potential of Large Language Model Based Agents: A Surveycited by 1,422
- 2024LLM as a Mastermind: A Survey of Strategic Reasoning with Large Language Modelscited by 97
- 2023Lyfe Agents: Generative agents for low-cost real-time social interactionscited by 49
- 2023Exploring the Sensitivity of LLMs' Decision-Making Capabilities: Insights from Prompt Variation and Hyperparameterscited by 32
- 2024TMGBench: A Systematic Game Benchmark for Evaluating Strategic Reasoning Abilities of LLMscited by 21
- 2023An evolutionary model of personality traits related to cooperative behavior using a large language modelcited by 18
- 2025Game Theory Meets Large Language Models: A Systematic Survey with Taxonomy and New Frontierscited by 14
- 2023Smart Agent-Based Modeling: On the Use of Large Language Models in Computer Simulationscited by 11
- 2024Computational Experiments Meet Large Language Model Based Agents: A Survey and Perspectivecited by 11
- 2025Beyond Static Responses: Multi-Agent LLM Systems as a New Paradigm for Social Science Researchcited by 9
- 2024Large Model Strategic Thinking, Small Model Efficiency: Transferring Theory of Mind in Large Language Modelscited by 7
- 2023Is There Any Social Principle for LLM-Based Agents?cited by 4
10 more
- 2025Psychometric Personality Shaping Modulates Capabilities and Safety in Language Modelscited by 4
- 2025Persona Alchemy: Designing, Evaluating, and Implementing Psychologically-Grounded LLM Agents for Diverse Stakeholder Representationcited by 2
- 2025Bias-Adjusted LLM Agents for Human-Like Decision-Making via Behavioral Economicscited by 2
- 2026Cooperative Profiles Predict Multi-Agent LLM Team Performance in AI for Science Workflowscited by 1
- 2026How memory can affect collective and cooperative behaviors in an LLM-Based Social Particle Swarmcited by 0
- 2026Symbolic Reasoning Frameworks Trigger Memory-Mediated Ecosystem Dynamics in Multi-Agent LLM Systemscited by 0
- 2026Causal Behavioral Evaluation of AI Agents at Scale via Automated Behavioral Sciencecited by 0
- 2026Assessing mentalization in humans and large language modelscited by 0
- 2026The Internal Anatomy of Strategic Choice in Large Language Modelscited by 0
- 2026Financial Fragility in Societies of LLM Agents: Coordination Failures and Stabilizing Mechanismscited by 0
- 2026Financial Fragility in Societies of LLM Agents: Coordination Failures and Stabilizing Mechanisms25 Sep 2026
- 2026The Internal Anatomy of Strategic Choice in Large Language Models7 Sep 2026
- 2026Assessing mentalization in humans and large language models26 Aug 2026
- 2026Causal Behavioral Evaluation of AI Agents at Scale via Automated Behavioral Science10 Aug 2026
- 2026Symbolic Reasoning Frameworks Trigger Memory-Mediated Ecosystem Dynamics in Multi-Agent LLM Systems22 May 2026
- 2026Cooperative Profiles Predict Multi-Agent LLM Team Performance in AI for Science Workflows22 Apr 2026
- 2026How memory can affect collective and cooperative behaviors in an LLM-Based Social Particle Swarm14 Apr 2026
- 2025Psychometric Personality Shaping Modulates Capabilities and Safety in Language Models19 Sep 2025
- 2025Bias-Adjusted LLM Agents for Human-Like Decision-Making via Behavioral Economics26 Aug 2025
- 2025Beyond Static Responses: Multi-Agent LLM Systems as a New Paradigm for Social Science Research2 Jun 2025
- 2025Persona Alchemy: Designing, Evaluating, and Implementing Psychologically-Grounded LLM Agents for Diverse Stakeholder Representation23 May 2025
- 2025Game Theory Meets Large Language Models: A Systematic Survey with Taxonomy and New Frontiers13 Feb 2025
10 more
- 2024TMGBench: A Systematic Game Benchmark for Evaluating Strategic Reasoning Abilities of LLMs14 Oct 2024
- 2024Large Model Strategic Thinking, Small Model Efficiency: Transferring Theory of Mind in Large Language Models5 Aug 2024
- 2024LLM as a Mastermind: A Survey of Strategic Reasoning with Large Language Models1 Apr 2024
- 2024Computational Experiments Meet Large Language Model Based Agents: A Survey and Perspective1 Feb 2024
- 2023Exploring the Sensitivity of LLMs' Decision-Making Capabilities: Insights from Prompt Variation and Hyperparameters29 Dec 2023
- 2023Smart Agent-Based Modeling: On the Use of Large Language Models in Computer Simulations10 Nov 2023
- 2023An evolutionary model of personality traits related to cooperative behavior using a large language model3 Oct 2023
- 2023Lyfe Agents: Generative agents for low-cost real-time social interactions3 Oct 2023
- 2023The Rise and Potential of Large Language Model Based Agents: A Survey14 Sep 2023
- 2023Is There Any Social Principle for LLM-Based Agents?22 Aug 2023
- 2023The Rise and Potential of Large Language Model Based Agents: A Surveycited by 1,422
- 2023Lyfe Agents: Generative agents for low-cost real-time social interactionscited by 49
- 2023Smart Agent-Based Modeling: On the Use of Large Language Models in Computer Simulationscited by 11
- 2024Computational Experiments Meet Large Language Model Based Agents: A Survey and Perspectivecited by 11
- 2025Beyond Static Responses: Multi-Agent LLM Systems as a New Paradigm for Social Science Researchcited by 9
- 2023Is There Any Social Principle for LLM-Based Agents?cited by 4
- 2025Persona Alchemy: Designing, Evaluating, and Implementing Psychologically-Grounded LLM Agents for Diverse Stakeholder Representationcited by 2
- 2025Bias-Adjusted LLM Agents for Human-Like Decision-Making via Behavioral Economicscited by 2
- 2026Financial Fragility in Societies of LLM Agents: Coordination Failures and Stabilizing Mechanismscited by 0
- 2026Financial Fragility in Societies of LLM Agents: Coordination Failures and Stabilizing Mechanisms25 Sep 2026
- 2025Bias-Adjusted LLM Agents for Human-Like Decision-Making via Behavioral Economics26 Aug 2025
- 2025Beyond Static Responses: Multi-Agent LLM Systems as a New Paradigm for Social Science Research2 Jun 2025
- 2025Persona Alchemy: Designing, Evaluating, and Implementing Psychologically-Grounded LLM Agents for Diverse Stakeholder Representation23 May 2025
- 2024Computational Experiments Meet Large Language Model Based Agents: A Survey and Perspective1 Feb 2024
- 2023Smart Agent-Based Modeling: On the Use of Large Language Models in Computer Simulations10 Nov 2023
- 2023Lyfe Agents: Generative agents for low-cost real-time social interactions3 Oct 2023
- 2023The Rise and Potential of Large Language Model Based Agents: A Survey14 Sep 2023
- 2023Is There Any Social Principle for LLM-Based Agents?22 Aug 2023
- 2024LLM as a Mastermind: A Survey of Strategic Reasoning with Large Language Modelscited by 97
- 2024TMGBench: A Systematic Game Benchmark for Evaluating Strategic Reasoning Abilities of LLMscited by 21
- 2024Large Model Strategic Thinking, Small Model Efficiency: Transferring Theory of Mind in Large Language Modelscited by 7
- 2026Cooperative Profiles Predict Multi-Agent LLM Team Performance in AI for Science Workflowscited by 1
- 2026Symbolic Reasoning Frameworks Trigger Memory-Mediated Ecosystem Dynamics in Multi-Agent LLM Systemscited by 0
- 2026Symbolic Reasoning Frameworks Trigger Memory-Mediated Ecosystem Dynamics in Multi-Agent LLM Systems22 May 2026
- 2026Cooperative Profiles Predict Multi-Agent LLM Team Performance in AI for Science Workflows22 Apr 2026
- 2024TMGBench: A Systematic Game Benchmark for Evaluating Strategic Reasoning Abilities of LLMs14 Oct 2024
- 2024Large Model Strategic Thinking, Small Model Efficiency: Transferring Theory of Mind in Large Language Models5 Aug 2024
- 2024LLM as a Mastermind: A Survey of Strategic Reasoning with Large Language Models1 Apr 2024
- 2023Exploring the Sensitivity of LLMs' Decision-Making Capabilities: Insights from Prompt Variation and Hyperparameterscited by 32
- 2023An evolutionary model of personality traits related to cooperative behavior using a large language modelcited by 18
- 2025Game Theory Meets Large Language Models: A Systematic Survey with Taxonomy and New Frontierscited by 14
- 2025Psychometric Personality Shaping Modulates Capabilities and Safety in Language Modelscited by 4
- 2026How memory can affect collective and cooperative behaviors in an LLM-Based Social Particle Swarmcited by 0
- 2026Causal Behavioral Evaluation of AI Agents at Scale via Automated Behavioral Sciencecited by 0
- 2026Assessing mentalization in humans and large language modelscited by 0
- 2026The Internal Anatomy of Strategic Choice in Large Language Modelscited by 0
- 2026The Internal Anatomy of Strategic Choice in Large Language Models7 Sep 2026
- 2026Assessing mentalization in humans and large language models26 Aug 2026
- 2026Causal Behavioral Evaluation of AI Agents at Scale via Automated Behavioral Science10 Aug 2026
- 2026How memory can affect collective and cooperative behaviors in an LLM-Based Social Particle Swarm14 Apr 2026
- 2025Psychometric Personality Shaping Modulates Capabilities and Safety in Language Models19 Sep 2025
- 2025Game Theory Meets Large Language Models: A Systematic Survey with Taxonomy and New Frontiers13 Feb 2025
- 2023Exploring the Sensitivity of LLMs' Decision-Making Capabilities: Insights from Prompt Variation and Hyperparameters29 Dec 2023
- 2023An evolutionary model of personality traits related to cooperative behavior using a large language model3 Oct 2023