An Interpretable Neuro-Symbolic Reasoning Framework for Task-Oriented Dialogue Generation
On the map: LLM reasoning → Reasoning benchmarks and evaluation
Abstract (arXiv)
We study the interpretability issue of task-oriented dialogue systems in this paper. Previously, most neural-based task-oriented dialogue systems employ an implicit reasoning strategy that makes the model predictions uninterpretable to humans. To obtain a transparent reasoning process, we introduce neuro-symbolic to perform explicit reasoning that justifies model decisions by reasoning chains. Since deriving reasoning chains requires multi-hop reasoning for task-oriented dialogues, existing neuro-symbolic approaches would induce error propagation due to the one-phase design. To overcome this, we propose a two-phase approach that consists of a hypothesis generator and a reasoner. We first obtain multiple hypotheses, i.e., potential operations to perform the desired task, through the hypothesis generator. Each hypothesis is then verified by the reasoner, and the valid one is selected to conduct the final prediction. The whole system is trained by exploiting raw textual dialogues without using any reasoning chain annotations. Experimental studies on two public benchmark datasets demonstrate that the proposed approach not only achieves better results, but also introduces an interpretable decision process.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Placed in Reasoning benchmarks and evaluation, one of 17 directions in LLM reasoning. Builds on 30 of its 40 references that are in the map. First posted on arXiv 11 Mar 2022.
Builds on
30 of 40 references.
References · 30
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2021On the Opportunities and Risks of Foundation Modelscited by 3,961
- 2016Categorical Reparameterization with Gumbel-Softmaxcited by 2,708
- 2017Towards A Rigorous Science of Interpretable Machine Learningcited by 1,400
- 2017Get To The Point: Summarization with Pointer-Generator Networkscited by 1,281
- 2019DialoGPT: Large-Scale Generative Pre-training for Conversational Response Generationcited by 842
- 2018MultiWOZ -- A Large-Scale Multi-Domain Wizard-of-Oz Dataset for Task-Oriented Dialogue Modellingcited by 760
- 2015Neural Module Networkscited by 375
- 2020A Simple Language Model for Task-Oriented Dialoguecited by 331
- 2018Neural-Symbolic VQA: Disentangling Reasoning from Vision and Language Understandingcited by 304
- 2019Transferable Multi-Domain State Generator for Task-Oriented Dialogue Systemscited by 215
18 more
- 2019TransferTransfo: A Transfer Learning Approach for Neural Network Based Conversational Agentscited by 188
- 2020TOD-BERT: Pre-trained Natural Language Understanding for Task-Oriented Dialoguecited by 185
- 2018Compositional Attention Networks for Machine Reasoningcited by 183
- 2017End-to-End Differentiable Provingcited by 159
- 2017Key-Value Retrieval Networks for Task-Oriented Dialoguecited by 137
- 2017Learning to Reason: End-to-End Module Networks for Visual Question Answeringcited by 125
- 2019Hello, It's GPT-2 -- How Can I Help You? Towards the Use of Pretrained Language Models for Task-Oriented Dialogue Systemscited by 110
- 2016Learning End-to-End Goal-Oriented Dialogcited by 104
- 2020Analyzing Differentiable Fuzzy Logic Operatorscited by 100
- 2019Task-Oriented Dialog Systems that Consider Multiple Appropriate Responses under the Same Contextcited by 99
- 2018Mem2Seq: Effectively Incorporating Knowledge Bases into End-to-End Task-Oriented Dialog Systemscited by 70
- 2020Learning Reasoning Strategies in End-to-End Differentiable Provingcited by 60
- 2019Global-to-local Memory Pointer Networks for Task-Oriented Dialoguecited by 47
- 2019Semantically Conditioned Dialog Response Generation via Hierarchical Disentangled Self-Attentioncited by 43
- 2019Probabilistic Neural-symbolic Models for Interpretable Visual Question Answeringcited by 38
- 2020Dynamic Fusion Network for Multi-Domain End-to-end Task-Oriented Dialogcited by 37
- 2020GraphDialog: Integrating Graph Knowledge into End-to-End Task-Oriented Dialogue Systemscited by 29
- 2020Semi-Supervised Dialogue Policy Learning via Stochastic Reward Estimationcited by 8
Built on by
Citing papers per year: 2022: 2; 2023: 1; 2024: 0; 2025: 0; 2026: 2.
5 papers.
- 2023Multimodal Procedural Planning via Dual Text-Image Promptingcited by 40
- 2022Neuro-Symbolic Procedural Planning with Commonsense Promptingcited by 28
- 2022Survey on Applications of Neurosymbolic Artificial Intelligencecited by 5
- 2026Neuro-Symbolic Artificial Intelligence: A Task-Directed Survey in the Black-Box Models Eracited by 1
- 2026One Model, Multiple Goals: Adaptive Multi-Objective Learning for E-commerce Dialogue Systemscited by 1
- 2026One Model, Multiple Goals: Adaptive Multi-Objective Learning for E-commerce Dialogue Systems8 Jun 2026
- 2026Neuro-Symbolic Artificial Intelligence: A Task-Directed Survey in the Black-Box Models Era3 Mar 2026
- 2023Multimodal Procedural Planning via Dual Text-Image Prompting2 May 2023
- 2022Survey on Applications of Neurosymbolic Artificial Intelligence8 Sep 2022
- 2022Neuro-Symbolic Procedural Planning with Commonsense Prompting6 Jun 2022
Similar, not cited
Close in wording, no citation either way
- 2022JARVIS: A Neuro-Symbolic Commonsense Reasoning Framework for Conversational Embodied Agents
- 2022Logical Reasoning for Task Oriented Dialogue Systems
- 2022Towards Large-Scale Interpretable Knowledge Graph Reasoning for Dialogue Systems
- 2025CoDial: Interpretable Task-Oriented Dialogue Systems Through Dialogue Flow Alignment
- 2023Dialogue Chain-of-Thought Distillation for Commonsense-aware Conversational Agents
- 2022Is Neuro-Symbolic AI Meeting its Promise in Natural Language Processing? A Structured Review
- 2026ReacTOD: Bounded Neuro-Symbolic Agentic NLU for Zero-Shot Dialogue State Tracking
- 2024Reliable Reasoning Beyond Natural Language