mlsanityData to 14 Oct 2026

FAIRGAME: a Framework for AI Agents Bias Recognition using Game Theory

arXiv 2504.14325 ↗First posted 19 Apr 2025cs.AIcited by 14

On the map: LLM agents and tool use → Social simulation and multi-agent debate

Abstract (arXiv)

Letting AI agents interact in multi-agent applications adds a layer of complexity to the interpretability and prediction of AI outcomes, with profound implications for their trustworthy adoption in research and society. Game theory offers powerful models to capture and interpret strategic interaction among agents, but requires the support of reproducible, standardized and user-friendly IT frameworks to enable comparison and interpretation of results. To this end, we present FAIRGAME, a Framework for AI Agents Bias Recognition using Game Theory. We describe its implementation and usage, and we employ it to uncover biased outcomes in popular games among AI agents, depending on the employed Large Language Model (LLM) and used language, as well as on the personality trait or strategic knowledge of the agents. Overall, FAIRGAME allows users to reliably and easily simulate their desired games and scenarios and compare the results across simulation campaigns and with game-theoretic predictions, enabling the systematic discovery of biases, the anticipation of emerging behavior out of strategic interplays, and empowering further research into strategic decision-making using LLM agents.

Key facts. Cited by 14 papers in the map (data through 14 Oct 2026). Placed in Social simulation and multi-agent debate, one of 16 directions in LLM agents and tool use. Builds on 27 of its 64 references that are in the map. First posted on arXiv 19 Apr 2025.

Builds on

27 of 64 references.

Closest ancestors · 8

Same direction, newest first

  1. 2025Do LLMs trust AI regulation? Emerging behaviour of game-theoretic LLM agents11 Apr
  2. 2025Personality-Driven Decision-Making in LLM-Based Autonomous Agents1 Apr
  3. 2025Inducing Personality in LLM-Based Honeypot Agents: Measuring the Effect on Human-Like Agenda Generation25 Mar
  4. 2025Will Systems of LLM Agents Cooperate: An Investigation into a Social Dilemma27 Jan
  5. 2024Overcoming the Machine Penalty with Imperfectly Fair AI Agents29 Sep
  6. 2024AFSPP: Agent Framework for Shaping Preference and Personality with Large Language Models5 Jan
  7. 2023ALYMPICS: LLM Agents Meet Game Theory -- Exploring Strategic Decision-Making with AI Agents6 Nov
  8. 2023Generative Agents: Interactive Simulacra of Human Behavior7 Apr

Other references · 19

  1. 2023Evaluating Object Hallucination in Large Vision-Language Modelscited by 1,729
  2. 2023Jailbreaking ChatGPT via Prompt Engineering: An Empirical Studycited by 498
  3. 2023HaluEval: A Large-Scale Hallucination Evaluation Benchmark for Large Language Modelscited by 341
  4. 2025Multi-Agent Risks from Advanced AIcited by 163
  5. 2023Fairness And Bias in Artificial Intelligence: A Brief Survey of Sources, Impacts, And Mitigation Strategiescited by 85
  6. 2024Nicer Than Humans: How do Large Language Models Behave in the Prisoner's Dilemma?cited by 63
  7. 2020When to (or not to) trust intelligent machines: Insights from an evolutionary game theory analysis of trust in repeated gamescited by 14
  8. 2024ChatGPT vs Gemini vs LLaMA on Multilingual Sentiment Analysiscited by 13
  9. 2025Towards Mechanistic Interpretability of Graph Transformers via Attention Graphscited by 13
  10. 2024Generative AI for Game Theory-based Mobile Networkingcited by 12
  11. 2025Media and responsible AI governance: a game-theoretic and LLM analysiscited by 12
  12. 2024Language-based game theory in the age of artificial intelligencecited by 10
7 more
  1. 2024Surprising gender biases in GPTcited by 8
  2. 2025Can We Govern the Agent-to-Agent Economy?cited by 7
  3. 2022Inferring Strategies from Observations in Long Iterated Prisoner's Dilemma Experimentscited by 6
  4. 2025Entropy-Lens: Uncovering Decision Strategies in LLMscited by 6
  5. 2024Large Language Models' Detection of Political Orientation in Newspaperscited by 5
  6. 2023Utility Fairness in Contextual Dynamic Pricing with Demand Learningcited by 4
  7. 2024RogueGPT: dis-ethical tuning transforms ChatGPT4 into a Rogue AI in 158 Wordscited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 4; 2026: 10.

14 papers.

Sort:

By area:

  1. 2025Understanding LLM Agent Behaviours via Game Theory: Strategy Recognition, Biases and Multi-Agent Dynamicscited by 11
  2. 2025Strategic Communication and Language Bias in Multi-Agent LLM Coordinationcited by 5
  3. 2026Gender Dynamics and Homophily in a Social Network of LLM Agentscited by 5
  4. 2025Can LLMs effectively provide game-theoretic-based scenarios for cybersecurity?cited by 4
  5. 2026Competition and Cooperation of LLM Agents in Gamescited by 3
  6. 2026When Numbers Start Talking: Implicit Numerical Coordination Among LLM-Based Agentscited by 2
  7. 2026Three AI-agents walk into a bar . . . . `Lord of the Flies' tribalism emerges among smart AI-Agentscited by 2
  8. 2026Coalition Formation in LLM Agent Networks: Stability Analysis and Convergence Guaranteescited by 2
  9. 2025The AI in the Mirror: LLM Self-Recognition in an Iterated Public Goods Gamecited by 1
  10. 2026Reasonably reasoning AI agents can avoid game-theoretic failures in zero-shot, provablycited by 1
  11. 2026Cooperative Profiles Predict Multi-Agent LLM Team Performance in AI for Science Workflowscited by 1
  12. 2026A Multi-Agent Framework for Medical AI: Leveraging Fine-Tuned GPT, LLaMA, and DeepSeek R1 for Evidence-Based and Bias-Aware Clinical Query Processingcited by 0
2 more
  1. 2026Humans Are More Diverse: Frontier LLMs Show Extreme Policies in Idealised AI Development Racescited by 0
  2. 2026When Numbers Start Talking: Numerical Signalling and Strategic Behaviour Among LLMscited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2026MINDGAMES: A Live Arena for Evaluating Social and Strategic Reasoning in Multi-Agent LLMs
  2. 2025Your AI Bosses Are Still Prejudiced: The Emergence of Stereotypes in LLM-Based Multi-Agent Systems
  3. 2025Fairness in Agentic AI: A Unified Framework for Ethical and Equitable Multi-Agent System
  4. 2025Approximating Human Strategic Reasoning with LLM-Enhanced Recursive Reasoners Leveraging Multi-agent Hypergames
  5. 2025LLM-Hanabi: Evaluating Multi-Agent Gameplays with Theory-of-Mind and Rationale Inference in Imperfect Information Collaboration Game
  6. 2026Evaluating Collective Behaviour of Hundreds of LLM Agents
  7. 2026Examining Agents' Bias Amplification versus Suppression in Multi-Agent Systems
  8. 2026AI Alignment through a Game-theoretic Lens: A Survey