Understanding LLM Agent Behaviours via Game Theory: Strategy Recognition, Biases and Multi-Agent Dynamics
On the map: LLM agents and tool use → Social simulation and multi-agent debate
Abstract (arXiv)
As Large Language Models (LLMs) increasingly operate as autonomous decision-makers in interactive and multi-agent systems and human societies, understanding their strategic behaviour has profound implications for safety, coordination, and the design of AI-driven social and economic infrastructures. Assessing such behaviour requires methods that capture not only what LLMs output, but the underlying intentions that guide their decisions. In this work, we extend the FAIRGAME framework to systematically evaluate LLM behaviour in repeated social dilemmas through two complementary advances: a payoff-scaled Prisoners Dilemma isolating sensitivity to incentive magnitude, and an integrated multi-agent Public Goods Game with dynamic payoffs and multi-agent histories. These environments reveal consistent behavioural signatures across models and languages, including incentive-sensitive cooperation, cross-linguistic divergence and end-game alignment toward defection. To interpret these patterns, we train traditional supervised classification models on canonical repeated-game strategies and apply them to FAIRGAME trajectories, showing that LLMs exhibit systematic, model- and language-dependent behavioural intentions, with linguistic framing at times exerting effects as strong as architectural differences. Together, these findings provide a unified methodological foundation for auditing LLMs as strategic agents and reveal systematic cooperation biases with direct implications for AI governance, collective decision-making, and the design of safe multi-agent systems.
Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Placed in Social simulation and multi-agent debate, one of 16 directions in LLM agents and tool use. Builds on 12 of its 34 references that are in the map. First posted on arXiv 8 Dec 2025.
Builds on
12 of 34 references.
Closest ancestors · 3
Same direction, newest first
- 2025Strategic Communication and Language Bias in Multi-Agent LLM Coordination30 Jul
- 2025FAIRGAME: a Framework for AI Agents Bias Recognition using Game Theory19 Apr
- 2025Do LLMs trust AI regulation? Emerging behaviour of game-theoretic LLM agents11 Apr
Other references · 9
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2023A Multitask, Multilingual, Multimodal Evaluation of ChatGPT on Reasoning, Hallucination, and Interactivitycited by 888
- 2023Playing repeated games with Large Language Modelscited by 213
- 2025Multi-Agent Risks from Advanced AIcited by 150
- 2020When to (or not to) trust intelligent machines: Insights from an evolutionary game theory analysis of trust in repeated gamescited by 14
- 2025Media and responsible AI governance: a game-theoretic and LLM analysiscited by 11
- 2022Inferring Strategies from Observations in Long Iterated Prisoner's Dilemma Experimentscited by 6
- 2025Can Media Act as a Soft Regulator of Safe AI Development? A Game Theoretical Analysiscited by 3
- 2025Can LLMs effectively provide game-theoretic-based scenarios for cybersecurity?cited by 2
Built on by
Citing papers per year: 2026: 11.
11 papers.
- 2026Self-Improvement of Large Language Models: A Technical Overview and Future Outlookcited by 5
- 2026RvB: Automating AI System Hardening via Iterative Red-Blue Gamescited by 2
- 2026Coalition Formation in LLM Agent Networks: Stability Analysis and Convergence Guaranteescited by 2
- 2026Three AI-agents walk into a bar . . . . `Lord of the Flies' tribalism emerges among smart AI-Agentscited by 1
- 2026The Yerkes-Dodson Curve for AI Agents: Emergent Cooperation Under Environmental Pressure in Multi-Agent LLM Simulationscited by 0
- 2026Multi-Agent Strategic Games with LLMscited by 0
- 2026Is Lying an Emergent Behaviour in LLMs? Evidence from Gaslighting AI agents in a Sustainability Gamecited by 0
- 2026The Politician, the Liar, and the Obedient Worker: Emerging Behavior of LLM Agents in Hierarchical Gamescited by 0
- 2026Preference Reasoning under Indeterminacy in Large Language Modelscited by 0
- 2026Recursive Reasoning or Statistical Extrapolation? In-Context Learning in Multi-Agent Interdependent Decision-Makingcited by 0
- 2026Fair Like Us? Auditing LLM Alignment in Resource Allocationcited by 0
- 2026Recursive Reasoning or Statistical Extrapolation? In-Context Learning in Multi-Agent Interdependent Decision-Making16 Sep 2026
- 2026Fair Like Us? Auditing LLM Alignment in Resource Allocation31 Aug 2026
- 2026Preference Reasoning under Indeterminacy in Large Language Models19 Aug 2026
- 2026The Politician, the Liar, and the Obedient Worker: Emerging Behavior of LLM Agents in Hierarchical Games10 Aug 2026
- 2026Is Lying an Emergent Behaviour in LLMs? Evidence from Gaslighting AI agents in a Sustainability Game26 Jun 2026
- 2026Multi-Agent Strategic Games with LLMs5 May 2026
- 2026Coalition Formation in LLM Agent Networks: Stability Analysis and Convergence Guarantees15 Apr 2026
- 2026Self-Improvement of Large Language Models: A Technical Overview and Future Outlook26 Mar 2026
- 2026The Yerkes-Dodson Curve for AI Agents: Emergent Cooperation Under Environmental Pressure in Multi-Agent LLM Simulations7 Mar 2026
- 2026Three AI-agents walk into a bar . . . . `Lord of the Flies' tribalism emerges among smart AI-Agents26 Feb 2026
- 2026RvB: Automating AI System Hardening via Iterative Red-Blue Games27 Jan 2026
Similar, not cited
Close in wording, no citation either way
- 2026Payoff scaling shapes cooperation in LLM agents across languages
- 2026Evaluating Collective Behaviour of Hundreds of LLM Agents
- 2025Corrupted by Reasoning: Reasoning Language Models Become Free-Riders in Public Goods Games
- 2025Playing games with Large language models: Randomness and strategy
- 2025Will Systems of LLM Agents Cooperate: An Investigation into a Social Dilemma
- 2026Competition and Cooperation of LLM Agents in Games
- 2025Emergent Social Dynamics of LLM Agents in the El Farol Bar Problem
- 2025Humans expect rationality and cooperation from LLM opponents in strategic games