Beyond Task-Oriented and Chitchat Dialogues: Proactive and Transition-Aware Conversational Agents
On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks
also in 1 more
Abstract (arXiv)
Conversational agents have traditionally been developed for either task-oriented dialogue (TOD) or open-ended chitchat, with limited progress in unifying the two. Yet, real-world conversations naturally involve fluid transitions between these modes. To address this gap, we introduce TACT (TOD-And-Chitchat Transition), a dataset designed for transition-aware dialogue modeling that incorporates structurally diverse and integrated mode flows. TACT supports both user- and agent-driven mode switches, enabling robust modeling of complex conversational dynamics. To evaluate an agent's ability to initiate and recover from mode transitions, we propose two new metrics -- Switch and Recovery. Models trained on TACT outperform baselines in both intent detection and mode transition handling. Moreover, applying Direct Preference Optimization (DPO) to TACT-trained models yields additional gains, achieving 75.74% joint mode-intent accuracy and a 70.1% win rate against GPT-4o in human evaluation. These results demonstrate that pairing structurally diverse data with DPO enhances response quality and transition control, paving the way for more proactive and transition-aware conversational agents.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 26 of its 32 references that are in the map. First posted on arXiv 11 Nov 2025.
Builds on
26 of 32 references.
Closest ancestors · 1
Same direction, newest first
Other references · 25
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,944
- 2023G-Eval: NLG Evaluation using GPT-4 with Better Human Alignmentcited by 2,276
- 2022LaMDA: Language Models for Dialog Applicationscited by 1,220
- 2024Length-Controlled AlpacaEval: A Simple Way to Debias Automatic Evaluatorscited by 897
- 2025SFT Memorizes, RL Generalizes: A Comparative Study of Foundation Model Post-trainingcited by 672
- 2019Towards Scalable Multi-domain Conversational Agents: The Schema-Guided Dialogue Datasetcited by 434
- 2023NeMo Guardrails: A Toolkit for Controllable and Safe LLM Applications with Programmable Railscited by 365
- 2020A Simple Language Model for Task-Oriented Dialoguecited by 332
- 2024Self-Preference Bias in LLM-as-a-Judgecited by 258
- 2016A Network-based End-to-End Trainable Task-oriented Dialogue Systemcited by 252
- 2020MultiWOZ 2.2 : A Dialogue Dataset with Additional Annotation Corrections and State Tracking Baselinescited by 204
13 more
- 2020SLURP: A Spoken Language Understanding Resource Packagecited by 198
- 2024A Survey on Recent Advances in LLM-Based Multi-turn Dialogue Systemscited by 170
- 2019Benchmarking Natural Language Understanding Services for building Conversational Agentscited by 166
- 2025Preference Leakage: A Contamination Problem in LLM-as-a-judgecited by 125
- 2017Rasa: Open Source Language Understanding and Dialogue Managementcited by 67
- 2024Explaining Length Bias in LLM-Based Preference Evaluationscited by 49
- 2020Adding Chit-Chat to Enhance Task-Oriented Dialoguescited by 48
- 2021Fusing task-oriented and open-domain dialogues in conversational agentscited by 28
- 2024Bridging the Bosphorus: Advancing Turkish Large Language Models through Strategies for Low-Resource Language Adaptation and Benchmarkingcited by 10
- 2025TD-EVAL: Revisiting Task-Oriented Dialogue Evaluation by Combining Turn-Level Precision with Dialogue-Level Comparisonscited by 10
- 2024Injecting Salesperson's Dialogue Strategies in Large Language Models with Chain-of-Thought Reasoningcited by 9
- 2024Large Language Models Are Active Critics in NLG Evaluationcited by 6
- 2024Chitchat as Interference: Adding User Backstories to Task-Oriented Dialoguescited by 4
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2025A Desideratum for Conversational Agents: Capabilities, Challenges, and Future Directions
- 2025AgentChangeBench: A Multi-Dimensional Evaluation Framework for Goal-Shift Robustness in Conversational AI
- 2025SpeakRL: Synergizing Reasoning, Speaking, and Acting in Language Models with Reinforcement Learning
- 2026Context-Agent: Dynamic Discourse Trees for Non-Linear Dialogue
- 2026Unlocking Proactivity in Task-Oriented Dialogue
- 2025InfoQuest: Evaluating Multi-Turn Dialogue Agents for Open-Ended Conversations with Hidden Context
- 2023Dialogue Agents 101: A Beginner's Guide to Critical Ingredients for Designing Effective Conversational Systems
- 2026Proactive Dialogue Policy Optimization via Cognitive-State Transition