mlsanityData to 14 Oct 2026

Human-Level Performance in No-Press Diplomacy via Equilibrium Search

arXiv 2010.02923 ↗First posted 6 Oct 2020cs.AI cs.GT cs.LGcited by 41

Not on the map. Why?

Abstract (arXiv)

Prior AI breakthroughs in complex games have focused on either the purely adversarial or purely cooperative settings. In contrast, Diplomacy is a game of shifting alliances that involves both cooperation and competition. For this reason, Diplomacy has proven to be a formidable research challenge. In this paper we describe an agent for the no-press variant of Diplomacy that combines supervised learning on human data with one-step lookahead search via regret minimization. Regret minimization techniques have been behind previous AI successes in adversarial games, most notably poker, but have not previously been shown to be successful in large-scale games involving cooperation. We show that our agent greatly exceeds the performance of past no-press Diplomacy bots, is unexploitable by expert humans, and ranks in the top 2% of human players when playing anonymous games on a popular Diplomacy website.

Key facts. Cited by 41 papers in the map (data through 14 Oct 2026). First posted on arXiv 6 Oct 2020.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2021: 9; 2022: 9; 2023: 3; 2024: 11; 2025: 5; 2026: 4.

41 papers.

Sort:

By area:

  1. 2022Discovering Latent Knowledge in Language Models Without Supervisioncited by 767
  2. 2024Agent Q: Advanced Reasoning and Learning for Autonomous AI Agentscited by 208
  3. 2024Tree Search for Language Model Agentscited by 151
  4. 2023Suspicion-Agent: Playing Imperfect Information Games with Theory of Mind Aware GPT-4cited by 68
  5. 2021DouZero: Mastering DouDizhu with Self-Play Deep Reinforcement Learningcited by 66
  6. 2021Modeling Strong and Human-Like Gameplay with KL-Regularized Searchcited by 50
  7. 2022Mastering the Game of No-Press Diplomacy via Human-Regularized Reinforcement Learning and Planningcited by 48
  8. 2024Evaluating Language Model Agency through Negotiationscited by 48
  9. 2021Evaluation of Human-AI Teams for Learned and Rule-Based Agents in Hanabicited by 40
  10. 2025Dynamic Search for Inference-Time Alignment in Diffusion Modelscited by 37
  11. 2024Richelieu: Self-Evolving LLM-Based Agents for AI Diplomacycited by 36
  12. 2021No-Press Diplomacy from Scratchcited by 31
29 more
  1. 2022ESCHER: Eschewing Importance Sampling in Games by Computing a History Value Function to Estimate Regretcited by 24
  2. 2022Any-Play: An Intrinsic Augmentation for Zero-Shot Coordinationcited by 23
  3. 2021Multi-Agent Training beyond Zero-Sum with Correlated Equilibrium Meta-Solverscited by 21
  4. 2024Evaluating and Enhancing LLMs Agent based on Theory of Mind in Guandan: A Multi-Player Cooperative Game under Imperfect Informationcited by 20
  5. 2021Solving Common-Payoff Games with Approximate Policy Iterationcited by 15
  6. 2022Conditional Imitation Learning for Multi-Agent Gamescited by 13
  7. 2023Evaluating Agents using Social Choice Theorycited by 11
  8. 2024Designing Skill-Compatible AI: Methodologies and Frameworks in Chesscited by 10
  9. 2024More Victories, Less Cooperation: Assessing Cicero's Diplomacy Playcited by 9
  10. 2021Normative Disagreement as a Challenge for Cooperative AIcited by 7
  11. 2025DipLLM: Fine-Tuning LLM for Strategic Decision-making in Diplomacycited by 4
  12. 2024Personalized Help for Optimizing Low-Skilled Users' Strategycited by 3
  13. 2025Should I Trust You? Detecting Deception in Negotiations using Counterfactual RLcited by 3
  14. 2021Temporal Induced Self-Play for Stochastic Bayesian Gamescited by 2
  15. 2022Developing, Evaluating and Scaling Learning Agents in Multi-Agent Environmentscited by 2
  16. 2022AutoReply: Detecting Nonsense in Dialogue Introspectively with Discriminative Repliescited by 2
  17. 2024NewsInterview: a Dataset and a Playground to Evaluate LLMs' Ground Gap via Informational Interviewscited by 2
  18. 2025Measuring Fine-Grained Negotiation Tactics of Humans and LLMs in Diplomacycited by 2
  19. 2021Learning to Play General-Sum Games Against Multiple Boundedly Rational Agentscited by 1
  20. 2022Function Approximation for Solving Stackelberg Equilibrium in Large Perfect Information Gamescited by 1
  21. 2025In Pursuit of Predictive Models of Human Preferences Toward AI Teammatescited by 1
  22. 2026Active Evaluation of General Agents: Problem Definition and Comparison of Baseline Algorithmscited by 1
  23. 2022Safe Subgame Resolving for Extensive Form Correlated Equilibriumcited by 0
  24. 2023Game-Theoretic Robust Reinforcement Learning Handles Temporally-Coupled Perturbationscited by 0
  25. 2024MARL-LNS: Cooperative Multi-agent Reinforcement Learning via Large Neighborhoods Searchcited by 0
  26. 2024Securing Equal Share: A Principled Approach for Learning Multiplayer Symmetric Gamescited by 0
  27. 2026Solving Parameter-Robust Avoid Problems with Unknown Feasibility using Reinforcement Learningcited by 0
  28. 2026AI Native Games: A Survey and Roadmapcited by 0
  29. 2026PokaiTrainer: Scaling Equilibrium Search to Competitive Pok'emon VGCcited by 0