mlsanityData to 14 Oct 2026

Decision-Oriented Dialogue for Human-AI Collaboration

arXiv 2305.20076 ↗First posted 31 May 2023cs.CL cs.AIcited by 29

Not on the map. Why?

Abstract (arXiv)

We describe a class of tasks called decision-oriented dialogues, in which AI assistants such as large language models (LMs) must collaborate with one or more humans via natural language to help them make complex decisions. We formalize three domains in which users face everyday decisions: (1) choosing an assignment of reviewers to conference papers, (2) planning a multi-step itinerary in a city, and (3) negotiating travel plans for a group of friends. In each of these settings, AI assistants and users have disparate abilities that they must combine to arrive at the best decision: assistants can access and process large amounts of information, while users have preferences and constraints external to the system. For each task, we build a dialogue environment where agents receive a reward based on the quality of the final decision they reach. We evaluate LMs in self-play and in collaboration with humans and find that they fall short compared to human assistants, achieving much lower rewards despite engaging in longer dialogues. We highlight a number of challenges models face in decision-oriented dialogues, ranging from goal-directed behavior to reasoning and optimization, and release our environments as a testbed for future work.

Key facts. Cited by 29 papers in the map (data through 14 Oct 2026). Builds on 31 of its 105 references that are in the map. First posted on arXiv 31 May 2023.

Builds on

31 of 105 references.

References · 31

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2022Training language models to follow instructions with human feedbackcited by 15,971
  3. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  4. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  5. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  6. 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,371
  7. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,326
  8. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
  9. 2022LaMDA: Language Models for Dialog Applicationscited by 1,220
  10. 2021Show Your Work: Scratchpads for Intermediate Computation with Language Modelscited by 886
  11. 2018MultiWOZ -- A Large-Scale Multi-Domain Wizard-of-Oz Dataset for Task-Oriented Dialogue Modellingcited by 766
  12. 2019On the Utility of Learning about Humans for Human-AI Coordinationcited by 349
19 more
  1. 2016Cooperative Inverse Reinforcement Learningcited by 300
  2. 2016Deep Reinforcement Learning for Dialogue Generationcited by 288
  3. 2018Human-level performance in first-person multiplayer games with population-based deep reinforcement learningcited by 264
  4. 2013The Complexity of Decentralized Control of Markov Decision Processescited by 231
  5. 2022Neural Theory-of-Mind? On the Limits of Social Intelligence in Large LMscited by 220
  6. 2017Deal or No Deal? End-to-End Learning for Negotiation Dialoguescited by 209
  7. 2019The Hanabi Challenge: A New Frontier for AI Researchcited by 197
  8. 2021Implicit Representations of Meaning in Neural Language Modelscited by 180
  9. 2020Open Problems in Cooperative AIcited by 168
  10. 2018Decoupling Strategy and Generation in Negotiation Dialoguescited by 162
  11. 2021Collaborating with Humans without Human Datacited by 142
  12. 2020Task-Oriented Dialogue as Dataflow Synthesiscited by 122
  13. 2020Reward-rational (implicit) choice: A unifying formalism for reward learningcited by 120
  14. 2019Executing Instructions in Situated Collaborative Interactionscited by 69
  15. 2017Learning Symmetric Collaborative Dialogue Agents with Dynamic Knowledge Graph Embeddingscited by 59
  16. 2022Inferring Rewards from Language in Contextcited by 50
  17. 2019A Natural Language Corpus of Common Grounding under Continuous and Partially-Observable Contextcited by 35
  18. 2022Pragmatics in Language Grounding: Phenomena, Tasks, and Modeling Approachescited by 12
  19. 2019Grounded Agreement Games: Emphasizing Conversational Grounding in Visual Dialogue Settingscited by 10

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 6; 2024: 10; 2025: 5; 2026: 8.

29 papers.

Sort:

By area:

  1. 2023A Survey on Large Language Model based Autonomous Agentscited by 2,242
  2. 2023The Rise and Potential of Large Language Model Based Agents: A Surveycited by 1,439
  3. 2024TravelPlanner: A Benchmark for Real-World Planning with Language Agentscited by 392
  4. 2024STaR-GATE: Teaching Language Models to Ask Clarifying Questionscited by 104
  5. 2024Towards Conversational Diagnostic AIcited by 79
  6. 2025Plan-Then-Execute: An Empirical Study of User Trust and Team Performance When Using LLM Agents As A Daily Assistantcited by 54
  7. 2024Measuring and Controlling Instruction (In)Stability in Language Model Dialogscited by 53
  8. 2023Grounding Gaps in Language Model Generationscited by 47
  9. 2024Bayesian Preference Elicitation with Language Modelscited by 34
  10. 2023An In-depth Survey of Large Language Model-based Artificial Intelligence Agentscited by 31
  11. 2024ChatShop: Interactive Information Seeking with Language Agentscited by 24
  12. 2024On Overcoming Miscalibrated Conversational Priors in LLM-based Chatbotscited by 24
17 more
  1. 2026Calibrate-Then-Act: Cost-Aware Exploration in LLM Agentscited by 17
  2. 2024Efficacy of Language Model Self-Play in Non-Zero-Sum Gamescited by 15
  3. 2024Dialogue Action Tokens: Steering Language Models in Goal-Directed Dialogue with a Multi-Turn Plannercited by 13
  4. 2026MT-PingEval: Evaluating Multi-Turn Collaboration with Private Information Gamescited by 8
  5. 2024Neuro-Symbolic AI for Military Applicationscited by 7
  6. 2023Agents meet OKR: An Object and Key Results Driven Agent System with Hierarchical Self-Collaboration and Self-Evaluationcited by 6
  7. 2025ADAPT: Actively Discovering and Adapting to Preferences for any Taskcited by 6
  8. 2025Learning Steerable Clarification Policies with Collaborative Self-playcited by 5
  9. 2023Is the U.S. Legal System Ready for AI's Challenges to Human Values?cited by 2
  10. 2025Making Sense of AI Limitations: How Individual Perceptions Shape Organizational Readiness for AI Adoptioncited by 2
  11. 2025MURMUR: Using cross-user chatter to break collaborative language agents in groupscited by 2
  12. 2026Simulating Human Memory with Language Modelscited by 2
  13. 2026Pro-AI Bias in Large Language Modelscited by 0
  14. 2026Thinking Is Not Telling: Information Disclosure in User-Service LLM Agentscited by 0
  15. 2026From Overload to Convergence: Supporting Multi-Issue Human-AI Negotiation with Bayesian Visualizationcited by 0
  16. 2026Pretrained Persona Mixture Models and Tandem Models for Human Simulationcited by 0
  17. 2026Echoes of Deeds: Moral History Can Shape and Steer LLM Behavioral Choicescited by 0