Conversational Tree Search: A New Hybrid Dialog Task
Not on the map. Why?
Abstract (arXiv)
Conversational interfaces provide a flexible and easy way for users to seek information that may otherwise be difficult or inconvenient to obtain. However, existing interfaces generally fall into one of two categories: FAQs, where users must have a concrete question in order to retrieve a general answer, or dialogs, where users must follow a predefined path but may receive a personalized answer. In this paper, we introduce Conversational Tree Search (CTS) as a new task that bridges the gap between FAQ-style information retrieval and task-oriented dialog, allowing domain-experts to define dialog trees which can then be converted to an efficient dialog policy that learns only to ask the questions necessary to navigate a user to their goal. We collect a dataset for the travel reimbursement domain and demonstrate a baseline as well as a novel deep Reinforcement Learning architecture for this task. Our results show that the new architecture combines the positive aspects of both the FAQ and dialog system used in the baseline and achieves higher goal completion while skipping unnecessary questions.
Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 20 of its 43 references that are in the map. First posted on arXiv 17 Mar 2023.
Builds on
20 of 43 references.
References · 20
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
- 2013Playing Atari with Deep Reinforcement Learningcited by 3,211
- 2015Deep Reinforcement Learning with Double Q-learningcited by 1,704
- 2021BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval Modelscited by 1,225
- 2017Hindsight Experience Replaycited by 1,096
- 2015Dueling Network Architectures for Deep Reinforcement Learningcited by 769
- 2018Neural Approaches to Conversational AIcited by 164
- 2020German's Next Language Modelcited by 144
- 2020Recent Advances and Challenges in Task-oriented Dialog Systemcited by 78
- 2020Munchausen Reinforcement Learningcited by 68
8 more
- 2020An Equivalence between Loss Functions and Non-Uniform Sampling in Experience Replaycited by 41
- 2017Hybrid Code Networks: practical and efficient end-to-end dialog control with supervised and reinforcement learningcited by 31
- 2018Large-scale Interactive Recommendation with Tree-structured Policy Gradientcited by 30
- 2020MIMICS: A Large-Scale Data Collection for Search Clarificationcited by 27
- 2021End-to-End Learning of Flowchart Grounded Task-Oriented Dialogscited by 19
- 2021Asking Clarifying Questions Based on Negative Feedback in Conversational Searchcited by 12
- 2020Conversation Learner -- A Machine Teaching Tool for Building Dialog Managers for Task-Oriented Dialog Systemscited by 9
- 2020Ranking Clarification Questions via Natural Language Inferencecited by 4
Built on by
Citing papers per year: 2023: 1; 2024: 4; 2025: 2.
7 papers.
- 2023Prompt-Based Monte-Carlo Tree Search for Goal-Oriented Dialogue Policy Planningcited by 60
- 2024Learning to Clarify: Multi-turn Conversations with Action-Based Contrastive Self-Trainingcited by 53
- 2024Planning Like Human: A Dual-process Framework for Dialogue Planningcited by 32
- 2025Planning of Heuristics: Strategic Planning on Large Language Models with Monte Carlo Tree Search for Automating Heuristic Optimizationcited by 13
- 2024Towards a Zero-Data, Controllable, Adaptive Dialog Systemcited by 4
- 2025DialogXpert: Driving Intelligent and Emotion-Aware Conversations through Online Value-Based Reinforcement Learning with LLM Priorscited by 4
- 2024Investigating the effect of Mental Models in User Interaction with an Adaptive Dialog Agentcited by 0
- 2025DialogXpert: Driving Intelligent and Emotion-Aware Conversations through Online Value-Based Reinforcement Learning with LLM Priors23 May 2025
- 2025Planning of Heuristics: Strategic Planning on Large Language Models with Monte Carlo Tree Search for Automating Heuristic Optimization17 Feb 2025
- 2024Investigating the effect of Mental Models in User Interaction with an Adaptive Dialog Agent26 Aug 2024
- 2024Planning Like Human: A Dual-process Framework for Dialogue Planning8 Jun 2024
- 2024Learning to Clarify: Multi-turn Conversations with Action-Based Contrastive Self-Training31 May 2024
- 2024Towards a Zero-Data, Controllable, Adaptive Dialog System26 Mar 2024
- 2023Prompt-Based Monte-Carlo Tree Search for Goal-Oriented Dialogue Policy Planning23 May 2023