When Trust Collides: Decoding Human-LLM Cooperation Dynamics through the Prisoner's Dilemma
Not on the map. Why?
Abstract (arXiv)
As large language models (LLMs) become increasingly capable of autonomous decision-making, they introduce new challenges and opportunities for human-AI cooperation in mixed-motive contexts. While prior research has primarily examined AI in assistive or cooperative roles, little is known about how humans interact with AI agents perceived as independent and strategic actors. This study investigates human cooperative attitudes and behaviors toward LLM agents by engaging 30 participants (15 males, 15 females) in repeated Prisoner's Dilemma games with agents differing in declared identity: purported human, rule-based AI, and LLM agent. Behavioral metrics, including cooperation rate, decision latency, unsolicited cooperative acts and trust restoration tolerance, were analyzed to assess the influence of agent identity and participant gender. Results revealed significant effects of declared agent identity on most cooperation-related behaviors, along with notable gender differences in decision latency. Furthermore, qualitative responses suggest that these behavioral differences were shaped by participants interpretations and expectations of the agents. These findings contribute to our understanding of human adaptation in competitive cooperation with autonomous agents and underscore the importance of agent framing in shaping effective and ethical human-AI interaction.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 12 of its 76 references that are in the map. First posted on arXiv 10 Mar 2025.
Builds on
12 of 76 references.
References · 12
- 2020Exploiting Cloze Questions for Few Shot Text Classification and Natural Language Inferencecited by 934
- 2020A Game Theoretic Framework for Model Based Reinforcement Learningcited by 72
- 2023Let the LLMs Talk: Simulating Human-to-Human Conversational QA via Zero-Shot LLM-to-LLM Interactionscited by 70
- 2024Large language models surpass human experts in predicting neuroscience resultscited by 69
- 2024Designing Heterogeneous LLM Agents for Financial Sentiment Analysiscited by 48
- 2024Understanding Large-Language Model (LLM)-powered Human-Robot Interactioncited by 43
- 2021Transitioning to human interaction with AI systems: New challenges and opportunities for HCI professionals to enable human-centered AIcited by 38
- 2024Believing Anthropomorphism: Examining the Role of Anthropomorphic Cues on Trust in Large Language Modelscited by 36
- 2023Improving Human-AI Collaboration With Descriptions of AI Behaviorcited by 35
- 2024Human vs. Machine: Behavioral Differences Between Expert Humans and Language Models in Wargame Simulationscited by 20
- 2023Black-Box Analysis: GPTs Across Time in Legal Textual Entailment Taskcited by 6
- 2015Parsimonious Mixed Modelscited by 3
Built on by
Citing papers per year: 2025: 1.
1 paper.
- 2025Self-Resource Allocation in Multi-Agent LLM Systemscited by 13
- 2025Self-Resource Allocation in Multi-Agent LLM Systems2 Apr 2025
Similar, not cited
Close in wording, no citation either way
- 2025Do LLMs trust AI regulation? Emerging behaviour of game-theoretic LLM agents
- 2025A closer look at how large language models trust humans: patterns and biases
- 2026Collective cooperation without individual fidelity in LLM agents
- 2024Can Large Language Model Agents Simulate Human Trust Behavior?
- 2026Do LLMs Take Care of Their Own? Similarity Signals Can Induce Cooperation
- 2026Payoff scaling shapes cooperation in LLM agents across languages
- 2023Do LLM Agents Exhibit Social Behavior?
- 2024Can Machines Think Like Humans? A Behavioral Evaluation of LLM Agents in Dictator Games