mlsanityData to 7 Oct 2026

Richelieu: Self-Evolving LLM-Based Agents for AI Diplomacy

arXiv 2407.06813 ↗First posted 9 Jul 2024cs.AI cs.MA cs.SIcited by 36

On the map: LLM agents and tool use → Reinforcement learning for LLM agents

also in 1 more
Abstract (arXiv)

Diplomacy is one of the most sophisticated activities in human society, involving complex interactions among multiple parties that require skills in social reasoning, negotiation, and long-term strategic planning. Previous AI agents have demonstrated their ability to handle multi-step games and large action spaces in multi-agent tasks. However, diplomacy involves a staggering magnitude of decision spaces, especially considering the negotiation stage required. While recent agents based on large language models (LLMs) have shown potential in various applications, they still struggle with extended planning periods in complex multi-agent settings. Leveraging recent technologies for LLM-based agents, we aim to explore AI's potential to create a human-like agent capable of executing comprehensive multi-agent missions by integrating three fundamental capabilities: 1) strategic planning with memory and reflection; 2) goal-oriented negotiation with social reasoning; and 3) augmenting memory through self-play games for self-evolution without human in the loop.

Key facts. Cited by 36 papers in the map (data through 7 Oct 2026). Placed in Reinforcement learning for LLM agents, one of 16 directions in LLM agents and tool use. Builds on 63 of its 89 references that are in the map. First posted on arXiv 9 Jul 2024.

Builds on

63 of 89 references.

Closest ancestors · 7

Same direction, newest first

  1. 2024LLM-based Multi-Agent Reinforcement Learning: Current and Future Directions17 May
  2. 2024Agent-Pro: Learning to Evolve via Policy-Level Reflection and Optimization27 Feb
  3. 2024CivRealm: A Learning and Reasoning Odyssey in Civilization for Decision-Making Agents19 Jan
  4. 2023JARVIS-1: Open-World Multi-task Agents with Memory-Augmented Multimodal Language Models10 Nov
  5. 2023Ghost in the Minecraft: Generally Capable Agents for Open-World Environments via Large Language Models with Text-based Knowledge and Memory25 May
  6. 2023Voyager: An Open-Ended Embodied Agent with Large Language Models25 May
  7. 2022MineDojo: Building Open-Ended Embodied Agents with Internet-Scale Knowledge17 Jun

Other references · 56

  1. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  2. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
  3. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
  4. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
  5. 2023A Survey on Large Language Model based Autonomous Agentscited by 2,203
  6. 2023HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Facecited by 1,173
  7. 2022Automatic Chain of Thought Prompting in Large Language Modelscited by 684
  8. 2024A Survey on the Memory Mechanism of Large Language Model based Agentscited by 622
  9. 2019Defending Against Neural Fake Newscited by 553
  10. 2023Multi-Agent Collaboration: Harnessing the Power of Intelligent LLM Agentscited by 329
  11. 2024Personal LLM Agents: Insights and Survey about the Capability, Efficiency and Securitycited by 257
  12. 2023Auto-GPT for Online Decision Making: Benchmarks and Additional Opinionscited by 250
38 more
  1. 2023GPT4Tools: Teaching Large Language Model to Use Tools via Self-instructioncited by 245
  2. 2023Exploring Large Language Models for Communication Games: An Empirical Study on Werewolfcited by 238
  3. 2023FinMem: A Performance-Enhanced LLM Trading Agent with Layered Memory and Character Designcited by 163
  4. 2024Hello Again! LLM-powered Personalized Agent for Long-term Dialoguecited by 121
  5. 2024Next-Generation Database Interfaces: A Survey of LLM-based Text-to-SQLcited by 118
  6. 2019Real or Fake? Learning to Discriminate Machine from Human Generated Textcited by 98
  7. 2024LLM as a Mastermind: A Survey of Strategic Reasoning with Large Language Modelscited by 97
  8. 2024How Well Can LLMs Negotiate? NegotiationArena Platform and Analysiscited by 93
  9. 2023Plug in the Safety Chip: Enforcing Constraints for LLM-driven Robot Agentscited by 67
  10. 2024The Benefits of a Concise Chain of Thought on Problem-Solving in Large Language Modelscited by 62
  11. 2021ToM2C: Target-oriented Multi-agent Communication and Cooperation with Theory of Mindcited by 57
  12. 2024AgentLite: A Lightweight Library for Building and Advancing Task-Oriented LLM Agent Systemcited by 53
  13. 2021Modeling Strong and Human-Like Gameplay with KL-Regularized Searchcited by 50
  14. 2024Towards Efficient LLM Grounding for Embodied Multi-Agent Collaborationcited by 45
  15. 2024Measuring Bargaining Abilities of LLMs: A Benchmark and A Buyer-Enhancement Methodcited by 44
  16. 2023Large Language Models Are Semi-Parametric Reinforcement Learning Agentscited by 42
  17. 2020Human-Level Performance in No-Press Diplomacy via Equilibrium Searchcited by 41
  18. 2024Macro Graph Neural Networks for Online Billion-Scale Recommender Systemscited by 40
  19. 2019No Press Diplomacy: Modeling Multi-Agent Gameplaycited by 37
  20. 2021No-Press Diplomacy from Scratchcited by 31
  21. 2022Let's Negotiate! A Survey of Negotiation Dialogue Systemscited by 31
  22. 2024INMS: Memory Sharing for Large Language Model based Agentscited by 31
  23. 2021Towards Distraction-Robust Active Visual Trackingcited by 30
  24. 2024"My agent understands me better": Integrating Dynamic Human-like Memory Recall and Consolidation in LLM-Based Agentscited by 29
  25. 2024LLM-Augmented Agent-Based Modelling for Social Simulations: Challenges and Opportunitiescited by 27
  26. 2020Learning to Play No-Press Diplomacy with Best Response Policy Iterationcited by 25
  27. 2023The SocialAI School: Insights from Developmental Psychology Towards Artificial Socio-Cultural Agentscited by 24
  28. 2023LARP: Language-Agent Role Play for Open-World Gamescited by 24
  29. 2024LLMs with Personalities in Multi-issue Negotiation Gamescited by 21
  30. 2024A social path to human-like artificial intelligencecited by 20
  31. 2020Learning Multi-Agent Coordination for Enhancing Target Coverage in Directional Sensor Networkscited by 19
  32. 2024Assistive Large Language Model Agents for Socially-Aware Negotiation Dialoguescited by 18
  33. 2024Empowering Large Language Models on Robotic Manipulation with Affordance Promptingcited by 17
  34. 2024Devil's Advocate: Anticipatory Reflection for LLM Agentscited by 17
  35. 2020Pose-Assisted Multi-Camera Collaboration for Active Object Trackingcited by 16
  36. 2023RSPT: Reconstruct Surroundings and Predict Trajectories for Generalizable Active Object Trackingcited by 16
  37. 2023Proactive Multi-Camera Collaboration For 3D Human Pose Estimationcited by 13
  38. 2024Modelling Political Coalition Negotiations Using LLM-based Agentscited by 13

50 most cited of 56 All 56 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 2; 2025: 22; 2026: 12.

36 papers.

Sort:

By area:

  1. 2025Towards Large Reasoning Models: A Survey of Reinforced Reasoning with Large Language Modelscited by 291
  2. 2025A Survey of Self-Evolving Agents: What, When, How, and Where to Evolve on the Path to Artificial Super Intelligencecited by 155
  3. 2024UnrealZoo: Enriching Photo-realistic Virtual Worlds for Embodied AIcited by 25
  4. 2025Among Us: A Sandbox for Measuring and Detecting Agentic Deceptioncited by 24
  5. 2024A Survey on Large Language Model-Based Social Agents in Game-Theoretic Scenarioscited by 23
  6. 2025Heterogeneous Swarms: Jointly Optimizing Model Roles and Weights for Multi-LLM Systemscited by 22
  7. 2025Game Theory Meets Large Language Models: A Systematic Survey with Taxonomy and New Frontierscited by 14
  8. 2026Does Socialization Emerge in AI Agent Society? A Case Study of Moltbookcited by 13
  9. 2025MetaMind: Modeling Human Social Thoughts with Metacognitive Multi-Agent Systemscited by 12
  10. 2025Generative AI in Transportation Planning: A Surveycited by 8
  11. 2025CoMet: Metaphor-Driven Covert Communication for Multi-Agent Language Gamescited by 6
  12. 2025Democratizing Diplomacy: A Harness for Evaluating Any Large Language Model on Full-Press Diplomacycited by 6
24 more
  1. 2026The Devil Behind Moltbook: Anthropic Safety is Always Vanishing in Self-Evolving AI Societiescited by 6
  2. 2025AI Agent Behavioral Sciencecited by 5
  3. 2025DipLLM: Fine-Tuning LLM for Strategic Decision-making in Diplomacycited by 4
  4. 2025Multi-level Value Alignment in Agentic AI Systems: Survey and Perspectivescited by 4
  5. 2025InfiAgent: Self-Evolving Pyramid Agent Framework for Infinite Scenarioscited by 4
  6. 2026Self-evolving LLM agents with in-distribution Optimizationcited by 3
  7. 2025Static Sandboxes Are Inadequate: Modeling Societal Complexity Requires Open-Ended Co-Evolution in LLM-Based Multi-Agent Simulationscited by 2
  8. 2026MERIT Feedback Elicits Better Bargaining in LLM Negotiatorscited by 2
  9. 2026PsychAgent: An Experience-Driven Lifelong Learning Agent for Self-Evolving Psychological Counselorcited by 2
  10. 2026Sell More, Play Less: Benchmarking LLM Realistic Selling Skillcited by 2
  11. 2025Enabling Autonomic Microservice Management through Self-Learning Agentscited by 1
  12. 2025Debiasing International Attitudes: LLM Agents for Simulating US-China Perception Changescited by 1
  13. 2025Shall We Play a Game? Language Models for Open-ended Wargamescited by 1
  14. 2025Constraints-of-Thought: A Framework for Constrained Reasoning in Language-Model-Guided Searchcited by 1
  15. 2025A Criminology of Machinescited by 1
  16. 2026Interaction Theater: A case of LLM Agents Interacting at Scalecited by 1
  17. 2026Superminds Test: Actively Evaluating Collective Intelligence of Agent Society via Probing Agentscited by 1
  18. 2025Recalibrating the Compass: Integrating Large Language Models into Classical Research Methodscited by 0
  19. 2025IndoorWorld: Integrating Physical Task Solving and Social Simulation in A Heterogeneous Multi-Agent Environmentcited by 0
  20. 2025ReCollab: Retrieval-Augmented LLMs for Cooperative Ad-hoc Teammate Modelingcited by 0
  21. 2026SOM: Structured Opponent Modeling for LLM-based Agents via Structural Causal Modelcited by 0
  22. 2026Modeling U.S. Attitudes Toward China via an Event-Steered Multi-Agent Simulatorcited by 0
  23. 2026Symbolic Reasoning Frameworks Trigger Memory-Mediated Ecosystem Dynamics in Multi-Agent LLM Systemscited by 0
  24. 2026Even More Deception: Objective Misalignment in Mixed-Motive LLM Multi-Agent Systemscited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025Multi-Agent Evolve: LLM Self-Improve through Co-evolution
  2. 2023Strategic Reasoning with Language Models
  3. 2023The Rise and Potential of Large Language Model Based Agents: A Survey
  4. 2025Grounding Natural Language for Multi-agent Decision-Making with Multi-agentic LLMs
  5. 2025Digital Player: Evaluating Large Language Models based Human-like Agent in Games
  6. 2026Evaluating Collective Behaviour of Hundreds of LLM Agents
  7. 2024Large Language Model based Multi-Agents: A Survey of Progress and Challenges
  8. 2024Exploring Large Language Model based Intelligent Agents: Definitions, Methods, and Prospects