mlsanityData to 13 Oct 2026

Strength Lies in Differences! Improving Strategy Planning for Non-collaborative Dialogues via Diversified User Simulation

arXiv 2403.06769 ↗First posted 11 Mar 2024cs.CLcited by 21

Not on the map. Why?

Abstract (arXiv)

We investigate non-collaborative dialogue agents, which are expected to engage in strategic conversations with diverse users, for securing a mutual agreement that leans favorably towards the system's objectives. This poses two main challenges for existing dialogue agents: 1) The inability to integrate user-specific characteristics into the strategic planning, and 2) The difficulty of training strategic planners that can be generalized to diverse users. To address these challenges, we propose Trip to enhance the capability in tailored strategic planning, incorporating a user-aware strategic planning module and a population-based training paradigm. Through experiments on benchmark non-collaborative dialogue tasks, we demonstrate the effectiveness of Trip in catering to diverse users.

Key facts. Cited by 21 papers in the map (data through 13 Oct 2026). Builds on 30 of its 57 references that are in the map. First posted on arXiv 11 Mar 2024.

Builds on

30 of 57 references.

References · 30

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,304
  2. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,657
  3. 2023Towards Measuring the Representation of Subjective Global Opinions in Language Modelscited by 428
  4. 2023SOTOPIA: Interactive Evaluation for Social Intelligence in Language Agentscited by 357
  5. 2022Neural Theory-of-Mind? On the Limits of Social Intelligence in Large LMscited by 220
  6. 2019Persuasion for Good: Towards a Personalized Persuasive Dialogue System for Social Goodcited by 208
  7. 2017Deal or No Deal? End-to-End Learning for Negotiation Dialoguescited by 205
  8. 2023Improving Language Model Negotiation with Self-Play and In-Context Learning from AI Feedbackcited by 205
  9. 2018Decoupling Strategy and Generation in Negotiation Dialoguescited by 159
  10. 2023Language Agents with Reinforcement Learning for Strategic Play in the Werewolf Gamecited by 151
  11. 2023Prompting and Evaluating Large Language Models for Proactive Dialogues: Clarification, Target-guided, and Non-collaborationcited by 115
  12. 2024How Well Can LLMs Negotiate? NegotiationArena Platform and Analysiscited by 98
18 more
  1. 2023How FaR Are Large Language Models From Agents with Theory-of-Mind?cited by 76
  2. 2023Plug-and-Play Policy Planner for Large Language Model Powered Dialogue Agentscited by 76
  3. 2023A Survey on Proactive Dialogue Systems: Problems, Methods, and Prospectscited by 66
  4. 2023Boosting Theory-of-Mind Performance in Large Language Models via Promptingcited by 64
  5. 2023Prompt-Based Monte-Carlo Tree Search for Goal-Oriented Dialogue Policy Planningcited by 61
  6. 2019How to Build User Simulators to Train RL-based Dialog Systemscited by 45
  7. 2019MIC: Mining Interclass Characteristics for Improved Metric Learningcited by 41
  8. 2020Improving Dialog Systems for Negotiation with Personality Modelingcited by 37
  9. 2023Controllable Mixed-Initiative Dialogue Generation through Promptingcited by 32
  10. 2022Let's Negotiate! A Survey of Negotiation Dialogue Systemscited by 31
  11. 2023Ask an Expert: Leveraging Language Models to Improve Strategic Reasoning in Goal-Oriented Dialogue Modelscited by 30
  12. 2024Are LLMs Effective Negotiators? Systematic Evaluation of the Multifaceted Capabilities of LLMs in Negotiation Dialoguescited by 29
  13. 2021RESPER: Computationally Modelling Resisting Strategies in Persuasive Conversationscited by 18
  14. 2022Interacting with Non-Cooperative User: A New Paradigm for Proactive Dialogue Policycited by 17
  15. 2023Be Selfish, But Wisely: Investigating the Impact of Agent Personality in Mixed-Motive Human-Agent Interactionscited by 15
  16. 2022Social Influence Dialogue Systems: A Survey of Datasets and Models For Social Influence Taskscited by 14
  17. 2021LEGOEval: An Open-Source Toolkit for Dialogue System Evaluation via Crowdsourcingcited by 11
  18. 2023Enhancing Large Language Model Induced Task-Oriented Dialogue Systems Through Look-Forward Motivated Goalscited by 8

Built on by

Cited by year (2026 to 13 Oct)

Citing papers per year: 2024: 2; 2025: 10; 2026: 9.

21 papers.

Sort:

By area:

  1. 2024LLM as a Mastermind: A Survey of Strategic Reasoning with Large Language Modelscited by 98
  2. 2024Towards Human-centered Proactive Conversational Agentscited by 48
  3. 2025Know You First and Be You Better: Modeling Human-Like User Simulators via Implicit Profilescited by 40
  4. 2025Large Language Models for Planning: A Comprehensive and Systematic Surveycited by 39
  5. 2025SOTOPIA-Omega: Dynamic Strategy Injection Learning and Social Instruction Following Evaluation for Social Agentscited by 16
  6. 2025PRINCIPLES: Synthetic Strategy Memory for Proactive Dialogue Agentscited by 15
  7. 2025ProactiveEval: A Unified Evaluation Framework for Proactive Dialogue Agentscited by 9
  8. 2025Simulating Before Planning: Constructing Intrinsic User World Model for User-Tailored Dialogue Policy Planningcited by 7
  9. 2025How to Enable Effective Cooperation Between Humans and NLP Models: A Survey of Principles, Formalizations, and Beyondcited by 4
  10. 2025DialogXpert: Driving Intelligent and Emotion-Aware Conversations through Online Value-Based Reinforcement Learning with LLM Priorscited by 4
  11. 2026METRO: Towards Strategy Induction from Expert Dialogue Transcripts for Non-collaborative Dialoguescited by 2
  12. 2026Beyond Static Personas: Situational Personality Steering for Large Language Modelscited by 2
9 more
  1. 2026Dual Hierarchical Dialogue Policy Learning for Legal Inquisitive Conversational Agentscited by 2
  2. 2025A General Highly Accurate Online Planning Method Integrating Large Language Models into Nested Rollout Policy Adaptation for Dialogue Taskscited by 1
  3. 2026Enhancing Persuasive Dialogue Agents by Synthesizing Cross-Disciplinary Communication Strategiescited by 1
  4. 2025Effects of Theory of Mind and Prosocial Beliefs on Steering Human-Aligned Behaviors of LLMs in Ultimatum Gamescited by 0
  5. 2026CoSToM:Causal-oriented Steering for Intrinsic Theory-of-Mind Alignment in Large Language Modelscited by 0
  6. 2026UP-NRPA: User Portrait based Nested Rollout Policy Adaptation for Planning with Large Language Models in Goal-oriented Dialogue Systemscited by 0
  7. 2026Clarify User Expertise: Towards Proactive Conversational Agents Tailoring Responses to User Proficiencycited by 0
  8. 2026Towards Effective Structured Context Modeling for Conversational Recommender Systems via Dual-node Monte Carlo Tree Searchcited by 0
  9. 2026Proactive Dialogue Policy Optimization via Cognitive-State Transitioncited by 0