mlsanityData to 14 Oct 2026

Deal or No Deal? End-to-End Learning for Negotiation Dialogues

arXiv 1706.05125 ↗First posted 16 Jun 2017cs.AI cs.CLcited by 209

Not on the map. Why?

Cited by 43 in LLM agents and tool use, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

Much of human dialogue occurs in semi-cooperative settings, where agents with different goals attempt to agree on common decisions. Negotiations require complex communication and reasoning skills, but success is easy to measure, making this an interesting task for AI. We gather a large dataset of human-human negotiations on a multi-issue bargaining task, where agents who cannot observe each other's reward functions must reach an agreement (or a deal) via natural language dialogue. For the first time, we show it is possible to train end-to-end models for negotiation, which must learn both linguistic and reasoning skills with no annotated dialogue states. We also introduce dialogue rollouts, in which the model plans ahead by simulating possible complete continuations of the conversation, and find that this technique dramatically improves performance. Our code and dataset are publicly available (https://github.com/facebookresearch/end-to-end-negotiator).

Key facts. Cited by 209 papers in the map (data through 14 Oct 2026). First posted on arXiv 16 Jun 2017.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2021: 26; 2022: 23; 2023: 34; 2024: 43; 2025: 32; 2026: 51.

209 papers.

Sort:

By area:

  1. 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,988
  2. 2021Ethical and social risks of harm from Language Modelscited by 966
  3. 2023SOTOPIA: Interactive Evaluation for Social Intelligence in Language Agentscited by 367
  4. 2024Is DPO Superior to PPO for LLM Alignment? A Comprehensive Studycited by 262
  5. 2023Reward Design with Language Modelscited by 261
  6. 2023Large Language Model Alignment: A Surveycited by 243
  7. 2024Two Tales of Persona in LLMs: A Survey of Role-Playing and Personalizationcited by 208
  8. 2023Improving Language Model Negotiation with Self-Play and In-Context Learning from AI Feedbackcited by 207
  9. 2023AI Deception: A Survey of Examples, Risks, and Potential Solutionscited by 188
  10. 2021Alignment of Language Agentscited by 168
  11. 2024WARM: On the Benefits of Weight Averaged Reward Modelscited by 147
  12. 2021Advances and Challenges in Conversational Recommender Systems: A Surveycited by 118
38 more
  1. 2021Truthful AI: Developing and governing AI that does not liecited by 113
  2. 2022Is Power-Seeking AI an Existential Risk?cited by 105
  3. 2024RLHF Deciphered: A Critical Analysis of Reinforcement Learning from Human Feedback for LLMscited by 90
  4. 2023Topical-Chat: Towards Knowledge-Grounded Open-Domain Conversationscited by 89
  5. 2023LMRL Gym: Benchmarks for Multi-Turn Reinforcement Learning with Language Modelscited by 88
  6. 2024Self-playing Adversarial Language Game Enhances LLM Reasoningcited by 83
  7. 2023Negative Object Presence Evaluation (NOPE) to Measure Object Hallucination in Vision-Language Modelscited by 80
  8. 2021Action-Based Conversations Dataset: A Corpus for Building More In-Depth Task-Oriented Dialogue Systemscited by 75
  9. 2024AutoKaggle: A Multi-Agent Framework for Autonomous Data Science Competitionscited by 70
  10. 2025NoveltyBench: Evaluating Language Models for Humanlike Diversitycited by 66
  11. 2023Strategic Reasoning with Language Modelscited by 64
  12. 2021CaSiNo: A Corpus of Campsite Negotiation Dialogues for Automatic Negotiation Systemscited by 62
  13. 2023Prompt-Based Monte-Carlo Tree Search for Goal-Oriented Dialogue Policy Planningcited by 61
  14. 2024Game-theoretic LLM: Agent Workflow for Negotiation Gamescited by 56
  15. 2024NegotiationToM: A Benchmark for Stress-testing Machine Theory of Mind on Negotiation Surroundingcited by 51
  16. 2021Modeling Strong and Human-Like Gameplay with KL-Regularized Searchcited by 50
  17. 2024Evaluating Language Model Agency through Negotiationscited by 48
  18. 2024Measuring Bargaining Abilities of LLMs: A Benchmark and A Buyer-Enhancement Methodcited by 48
  19. 2023Welfare Diplomacy: Benchmarking Language Model Cooperationcited by 45
  20. 2024WARP: On the Benefits of Weight Averaged Rewarded Policiescited by 45
  21. 2023Honesty Is the Best Policy: Defining and Mitigating AI Deceptioncited by 40
  22. 2022InstructDial: Improving Zero and Few-shot Generalization in Dialogue through Instruction Tuningcited by 39
  23. 2025Consistently Simulating Human Personas with Multi-Turn Reinforcement Learningcited by 39
  24. 2024LLMArena: Assessing Capabilities of Large Language Models in Dynamic Multi-Agent Environmentscited by 36
  25. 2022CHAI: A CHatbot AI for Task-Oriented Dialogue with Offline Reinforcement Learningcited by 34
  26. 2023Language Model Alignment with Elastic Resetcited by 34
  27. 2022The Ethical Need for Watermarks in Machine-Generated Languagecited by 32
  28. 2022Let's Negotiate! A Survey of Negotiation Dialogue Systemscited by 31
  29. 2022A Survey on Recent Advances and Challenges in Reinforcement Learning Methods for Task-Oriented Dialogue Policy Learningcited by 30
  30. 2022Reward Gaming in Conditional Text Generationcited by 30
  31. 2023Decision-Oriented Dialogue for Human-AI Collaborationcited by 29
  32. 2024Are LLMs Effective Negotiators? Systematic Evaluation of the Multifaceted Capabilities of LLMs in Negotiation Dialoguescited by 29
  33. 2021DeliData: A dataset for deliberation in multi-party problem solvingcited by 26
  34. 2024CMAT: A Multi-Agent Collaboration Tuning Framework for Enhancing Small Language Modelscited by 26
  35. 2024A Survey on Self-play Methods in Reinforcement Learningcited by 26
  36. 2021DialoGraph: Incorporating Interpretable Strategy-Graph Networks into Negotiation Dialoguescited by 25
  37. 2022Context-Aware Language Modeling for Goal-Oriented Dialogue Systemscited by 22
  38. 2024LLMs with Personalities in Multi-issue Negotiation Gamescited by 22

50 most cited of 209 All 209 (JSON)