Towards a Progression-Aware Autonomous Dialogue Agent
On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks
Abstract (arXiv)
Recent advances in large-scale language modeling and generation have enabled the creation of dialogue agents that exhibit human-like responses in a wide range of conversational scenarios spanning a diverse set of tasks, from general chit-chat to focused goal-oriented discourse. While these agents excel at generating high-quality responses that are relevant to prior context, they suffer from a lack of awareness of the overall direction in which the conversation is headed, and the likelihood of task success inherent therein. Thus, we propose a framework in which dialogue agents can evaluate the progression of a conversation toward or away from desired outcomes, and use this signal to inform planning for subsequent responses. Our framework is composed of three key elements: (1) the notion of a "global" dialogue state (GDS) space, (2) a task-specific progression function (PF) computed in terms of a conversation's trajectory through this space, and (3) a planning mechanism based on dialogue rollouts by which an agent may use progression signals to select its next response.
Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 23 of its 54 references that are in the map. First posted on arXiv 7 May 2022.
Builds on
23 of 54 references.
References · 23
- 2017Attention Is All You Needcited by 59,932
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
- 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,530
- 2018UMAP: Uniform Manifold Approximation and Projection for Dimension Reductioncited by 2,841
- 2020MPNet: Masked and Permuted Pre-training for Language Understandingcited by 973
- 2019DialoGPT: Large-Scale Generative Pre-training for Conversational Response Generationcited by 842
- 2018MultiWOZ -- A Large-Scale Multi-Domain Wizard-of-Oz Dataset for Task-Oriented Dialogue Modellingcited by 760
- 2020Recipes for building an open-domain chatbotcited by 593
- 2020Towards a Human-like Open-Domain Chatbotcited by 467
- 2019Towards Scalable Multi-domain Conversational Agents: The Schema-Guided Dialogue Datasetcited by 426
11 more
- 2020TweetEval: Unified Benchmark and Comparative Evaluation for Tweet Classificationcited by 414
- 2021Beyond Goldfish Memory: Long-Term Open-Domain Conversationcited by 266
- 2019Persuasion for Good: Towards a Personalized Persuasive Dialogue System for Social Goodcited by 207
- 2017Deal or No Deal? End-to-End Learning for Negotiation Dialoguescited by 202
- 2020MultiWOZ 2.2 : A Dialogue Dataset with Additional Annotation Corrections and State Tracking Baselinescited by 201
- 2018Decoupling Strategy and Generation in Negotiation Dialoguescited by 156
- 2017Accelerated Hierarchical Density Clusteringcited by 100
- 2021GL-GIN: Fast and Accurate Non-Autoregressive Model for Joint Multiple Intent Detection and Slot Fillingcited by 33
- 2017Hierarchical Text Generation and Planning for Strategic Dialoguecited by 23
- 2020The Gutenberg Dialogue Datasetcited by 8
- 2019Towards End-to-End Learning for Efficient Dialogue Agent by Modeling Looking-ahead Abilitycited by 3
Built on by
Citing papers per year: 2023: 2; 2024: 2; 2025: 1; 2026: 2.
7 papers.
- 2023COOPER: Coordinating Specialized Agents towards a Complex Dialogue Goalcited by 18
- 2024The Imperative of Conversation Analysis in the Era of LLMs: A Survey of Tasks, Techniques, and Trendscited by 11
- 2024ORCHID: A Chinese Debate Corpus for Target-Independent Stance Detection and Argumentative Dialogue Summarizationcited by 6
- 2025PARL-MT: Learning to Call Functions in Multi-Turn Conversation with Progress Awarenesscited by 4
- 2023Towards a Neural Era in Dialogue Management for Collaboration: A Literature Surveycited by 3
- 2026Human Label Variation in Implicit Discourse Relation Recognitioncited by 0
- 2026Beyond Direct Answering: Aligning Educational LLMs as Socratic Guides via Heuristic Reinforcement Learningcited by 0
- 2026Beyond Direct Answering: Aligning Educational LLMs as Socratic Guides via Heuristic Reinforcement Learning25 Jul 2026
- 2026Human Label Variation in Implicit Discourse Relation Recognition26 Feb 2026
- 2025PARL-MT: Learning to Call Functions in Multi-Turn Conversation with Progress Awareness27 Sep 2025
- 2024ORCHID: A Chinese Debate Corpus for Target-Independent Stance Detection and Argumentative Dialogue Summarization17 Oct 2024
- 2024The Imperative of Conversation Analysis in the Era of LLMs: A Survey of Tasks, Techniques, and Trends21 Sep 2024
- 2023COOPER: Coordinating Specialized Agents towards a Complex Dialogue Goal19 Dec 2023
- 2023Towards a Neural Era in Dialogue Management for Collaboration: A Literature Survey18 Jul 2023
Similar, not cited
Close in wording, no citation either way
- 2026ATOD: An Evaluation Framework and Benchmark for Agentic Task-Oriented Dialogue Systems
- 2025A Desideratum for Conversational Agents: Capabilities, Challenges, and Future Directions
- 2026Context-Agent: Dynamic Discourse Trees for Non-Linear Dialogue
- 2025PRINCIPLES: Synthetic Strategy Memory for Proactive Dialogue Agents
- 2025From What to Respond to When to Respond: Timely Response Generation for Open-domain Dialogue Agents
- 2023Dialogue Agents 101: A Beginner's Guide to Critical Ingredients for Designing Effective Conversational Systems
- 2024Large Language Models as User-Agents for Evaluating Task-Oriented-Dialogue Systems
- 2024Interactive Dialogue Agents via Reinforcement Learning on Hindsight Regenerations