mlsanityData to 7 Oct 2026

No Press Diplomacy: Modeling Multi-Agent Gameplay

arXiv 1909.02128 ↗First posted 4 Sep 2019cs.AI cs.LG cs.MAcited by 37

Not on the map. Why?

Abstract (arXiv)

Diplomacy is a seven-player non-stochastic, non-cooperative game, where agents acquire resources through a mix of teamwork and betrayal. Reliance on trust and coordination makes Diplomacy the first non-cooperative multi-agent benchmark for complex sequential social dilemmas in a rich environment. In this work, we focus on training an agent that learns to play the No Press version of Diplomacy where there is no dedicated communication channel between players. We present DipNet, a neural-network-based policy model for No Press Diplomacy. The model was trained on a new dataset of more than 150,000 human games. Our model is trained by supervised learning (SL) from expert trajectories, which is then used to initialize a reinforcement learning (RL) agent trained through self-play. Both the SL and RL agents demonstrate state-of-the-art No Press performance by beating popular rule-based bots.

Key facts. Cited by 37 papers in the map (data through 7 Oct 2026). First posted on arXiv 4 Sep 2019.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 5; 2022: 8; 2023: 5; 2024: 10; 2025: 7; 2026: 2.

37 papers.

Sort:

By area:

  1. 2022A Unified Approach to Reinforcement Learning, Quantal Response Equilibria, and Two-Player Zero-Sum Gamescited by 64
  2. 2023Strategic Reasoning with Language Modelscited by 64
  3. 2021Modeling Strong and Human-Like Gameplay with KL-Regularized Searchcited by 50
  4. 2022Mastering the Game of No-Press Diplomacy via Human-Regularized Reinforcement Learning and Planningcited by 47
  5. 2023Welfare Diplomacy: Benchmarking Language Model Cooperationcited by 43
  6. 2024Richelieu: Self-Evolving LLM-Based Agents for AI Diplomacycited by 36
  7. 2021No-Press Diplomacy from Scratchcited by 31
  8. 2022AI for Global Climate Cooperation: Modeling Global Climate Negotiations, Agreements, and Long-Term Cooperation in RICE-Ncited by 22
  9. 2022Conditional Imitation Learning for Multi-Agent Gamescited by 13
  10. 2024More Victories, Less Cooperation: Assessing Cicero's Diplomacy Playcited by 9
  11. 2023It Takes Two to Negotiate: Modeling Social Exchange in Online Multiplayer Gamescited by 8
  12. 2021Normative Disagreement as a Challenge for Cooperative AIcited by 7
25 more
  1. 2021Decision Making in Monopoly using a Hybrid Deep Reinforcement Learning Approachcited by 6
  2. 2024Exploration is Harder than Prediction: Cryptographically Separating Reinforcement Learning from Supervised Learningcited by 6
  3. 2024Human-Agent Cooperation in Games under Incomplete Information through Natural Language Communicationcited by 6
  4. 2021Model-based Reinforcement Learning for Service Mesh Fault Resiliency in a Web Application-levelcited by 5
  5. 2024Advancing Investment Frontiers: Industry-grade Deep Reinforcement Learning for Portfolio Optimizationcited by 4
  6. 2024Explaining Decisions of Agents in Mixed-Motive Gamescited by 4
  7. 2025DipLLM: Fine-Tuning LLM for Strategic Decision-making in Diplomacycited by 4
  8. 2023Guarantees for Self-Play in Multiplayer Games via Polymatrix Decomposabilitycited by 3
  9. 2024Personalized Help for Optimizing Low-Skilled Users' Strategycited by 3
  10. 2025Should I Trust You? Detecting Deception in Negotiations using Counterfactual RLcited by 3
  11. 2022Developing, Evaluating and Scaling Learning Agents in Multi-Agent Environmentscited by 2
  12. 2022AutoReply: Detecting Nonsense in Dialogue Introspectively with Discriminative Repliescited by 2
  13. 2023The Update-Equivalence Framework for Decision-Time Planningcited by 2
  14. 2024A Contextual Combinatorial Bandit Approach to Negotiationcited by 2
  15. 2024LLMs are Superior Feedback Providers: Bootstrapping Reasoning for Lie Detection with Self-Generated Feedbackcited by 2
  16. 2025PoliCon: Evaluating LLMs on Achieving Diverse Political Consensus Objectivescited by 2
  17. 2025Learning "Partner-Aware" Collaborators in Multi-Party Collaborationcited by 2
  18. 2025Measuring Fine-Grained Negotiation Tactics of Humans and LLMs in Diplomacycited by 2
  19. 2025Shall We Play a Game? Language Models for Open-ended Wargamescited by 1
  20. 2022Offsetting Unequal Competition through RL-assisted Incentive Schemescited by 0
  21. 2022Classifying Ambiguous Identities in Hidden-Role Stochastic Games with Multi-Agent Reinforcement Learningcited by 0
  22. 2024Learning to Coordinate without Communication under Incomplete Informationcited by 0
  23. 2025Terra Nova: A Comprehensive Challenge Environment for Intelligent Agentscited by 0
  24. 2026SidConArena: An Environment Evaluating Agents in Open-Ended,Positive-Sum Bargaining Gamecited by 0
  25. 2026SAGA: Scene-Aware, Goal-Evolving Agents for Long-Horizon Strategy Game Planningcited by 0