Beyond Domain APIs: Task-oriented Conversational Modeling with Unstructured Knowledge Access
Not on the map. Why?
Abstract (arXiv)
Most prior work on task-oriented dialogue systems are restricted to a limited coverage of domain APIs, while users oftentimes have domain related requests that are not covered by the APIs. In this paper, we propose to expand coverage of task-oriented dialogue systems by incorporating external unstructured knowledge sources. We define three sub-tasks: knowledge-seeking turn detection, knowledge selection, and knowledge-grounded response generation, which can be modeled individually or jointly. We introduce an augmented version of MultiWOZ 2.1, which includes new out-of-API-coverage turns and responses grounded on external knowledge sources. We present baselines for each sub-task using both conventional and neural approaches. Our experimental results demonstrate the need for further research in this direction to enable more informative conversational systems.
Key facts. Cited by 58 papers in the map (data through 7 Oct 2026). First posted on arXiv 5 Jun 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 22; 2022: 18; 2023: 12; 2024: 5; 2025: 0; 2026: 1.
58 papers.
Sort:
By area:
- 2023Check Your Facts and Try Again: Improving Large Language Models with External Knowledge and Automated Feedbackcited by 351
- 2023MathDial: A Dialogue Tutoring Dataset with Rich Pedagogical Properties Grounded in Math Reasoning Problemscited by 128
- 2022GODEL: Large-Scale Pre-Training for Goal-Directed Dialogcited by 50
- 2021PLATO-XL: Exploring the Large-scale Pre-training of Dialogue Generationcited by 37
- 2021Efficient Retrieval Augmented Generation from Unstructured Knowledge for Task-Oriented Dialogcited by 33
- 2023Opportunities and Challenges in Neural Dialog Tutoringcited by 33
- 2021"How Robust r u?": Evaluating Task-Oriented Dialogue Systems on Spoken Conversationscited by 30
- 2023Elastic Weight Removal for Faithful and Abstractive Dialogue Generationcited by 29
- 2021Fusing task-oriented and open-domain dialogues in conversational agentscited by 28
- 2024Adaptive Retrieval-Augmented Generation for Conversational Systemscited by 22
- 2021End-to-End Learning of Flowchart Grounded Task-Oriented Dialogscited by 19
- 2021Learning to Select External Knowledge with Multi-Scale Negative Samplingcited by 16
38 more
- 2021VISITRON: Visual Semantics-Aligned Interactively Trained Object-Navigatorcited by 13
- 2023SUQL: Conversational Search over Structured and Unstructured Data with Large Language Modelscited by 13
- 2022Where to Go for the Holidays: Towards Mixed-Type Dialogs for Clarification of User Goalscited by 12
- 2021TOD-DA: Towards Boosting the Robustness of Task-oriented Dialogue Modeling on Spoken Conversationscited by 11
- 2022KETOD: Knowledge-Enriched Task-Oriented Dialoguecited by 11
- 2021Beyond Domain APIs: Task-oriented Conversational Modeling with Unstructured Knowledge Access Track in DSTC9cited by 10
- 2022Towards Large-Scale Interpretable Knowledge Graph Reasoning for Dialogue Systemscited by 10
- 2022CGoDial: A Large-Scale Benchmark for Chinese Goal-oriented Dialog Evaluationcited by 9
- 2023textitDial BeInfo for Faithfulness: Improving Factuality of Information-Seeking Dialogue via Behavioural Fine-Tuningcited by 9
- 2021Can I Be of Further Assistance? Using Unstructured Knowledge Access to Improve Task-oriented Conversational Modelingcited by 8
- 2022UniGDD: A Unified Generative Framework for Goal-Oriented Document-Grounded Dialoguecited by 8
- 2022AARGH! End-to-end Retrieval-Generation for Task-Oriented Dialogcited by 8
- 2024Should We Fine-Tune or RAG? Evaluating Different Techniques to Adapt LLMs for Dialoguecited by 7
- 2021HyKnow: End-to-End Task-Oriented Dialog Modeling with Hybrid Knowledge Managementcited by 6
- 2022A Challenge on Semi-Supervised and Reinforced Task-Oriented Dialog Systemscited by 6
- 2023"What do others think?": Task-Oriented Conversational Modeling with Subjective Knowledgecited by 6
- 2021Adapting Document-Grounded Dialog Systems to Spoken Conversations using Data Augmentation and a Noisy Channel Modelcited by 5
- 2022OPERA: Harmonizing Task-Oriented Dialogs and Information Seeking Experiencecited by 5
- 2022Knowledge-grounded Dialog State Trackingcited by 5
- 2021Cascaded Span Extraction and Response Generation for Document-Grounded Dialogcited by 4
- 2023Task-oriented Document-Grounded Dialog Systems by HLTPR@RWTH for DSTC9 and DSTC10cited by 4
- 2023Revealing User Familiarity Bias in Task-Oriented Dialogue via Interactive Evaluationcited by 4
- 2021End-to-End Task-Oriented Dialog Modeling with Semi-Structured Knowledge Managementcited by 3
- 2021Challenging Instances are Worth Learning: Generating Valuable Negative Samples for Response Selection Trainingcited by 3
- 2021Towards Zero and Few-shot Knowledge-seeking Turn Detection in Task-orientated Dialogue Systemscited by 3
- 2021Variational Learning for Unsupervised Knowledge Grounded Dialogscited by 3
- 2022Controllable Factuality in Document-Grounded Dialog Systems Using a Noisy Channel Modelcited by 3
- 2022Topic-Aware Response Generation in Task-Oriented Dialogue with Unstructured Knowledge Accesscited by 3
- 2024Evaluating the Impact of Advanced LLM Techniques on AI-Lecture Tutors for a Robotics Coursecited by 3
- 2021A Knowledge-Grounded Dialog System Based on Pre-Trained Language Modelscited by 2
- 2024Controllable and Reliable Knowledge-Intensive Task-Oriented Conversational Agents with Declarative Genie Worksheetscited by 2
- 2021Unstructured Knowledge Access in Task-oriented Dialog Modeling using Language Inference, Knowledge Retrieval and Knowledge-Integrative Response Generationcited by 1
- 2021Reference-based Weak Supervision for Answer Sentence Selection using Web Datacited by 1
- 2021GKS: Graph-based Knowledge Selector for Task-oriented Dialog Systemcited by 1
- 2022Towards Generalized Models for Task-oriented Dialogue Modeling on Spoken Conversationscited by 1
- 2022Mind the Knowledge Gap: A Survey of Knowledge-enhanced Dialogue Systemscited by 1
- 2023Task Oriented Conversational Modelling With Subjective Knowledgecited by 1
- 2023Leveraging Few-Shot Data Augmentation and Waterfall Prompting for Response Generationcited by 1
50 most cited of 58 All 58 (JSON)
- 2026Progressive Training for Explainable Citation-Grounded Dialogue: Reducing Hallucination to Zero in English-Hindi LLMs19 Mar 2026
- 2024Unstructured Text Enhanced Open-domain Dialogue System: A Systematic Survey14 Nov 2024
- 2024Evaluating the Impact of Advanced LLM Techniques on AI-Lecture Tutors for a Robotics Course2 Aug 2024
- 2024Adaptive Retrieval-Augmented Generation for Conversational Systems31 Jul 2024
- 2024Controllable and Reliable Knowledge-Intensive Task-Oriented Conversational Agents with Declarative Genie Worksheets8 Jul 2024
- 2024Should We Fine-Tune or RAG? Evaluating Different Techniques to Adapt LLMs for Dialogue10 Jun 2024
- 2023SUQL: Conversational Search over Structured and Unstructured Data with Large Language Models16 Nov 2023
- 2023textitDial BeInfo for Faithfulness: Improving Factuality of Information-Seeking Dialogue via Behavioural Fine-Tuning16 Nov 2023
- 2023Salespeople vs SalesBot: Exploring the Role of Educational Value in Conversational Recommender Systems26 Oct 2023
- 2023Leveraging Few-Shot Data Augmentation and Waterfall Prompting for Response Generation2 Aug 2023
- 2023MathDial: A Dialogue Tutoring Dataset with Rich Pedagogical Properties Grounded in Math Reasoning Problems23 May 2023
- 2023Revealing User Familiarity Bias in Task-Oriented Dialogue via Interactive Evaluation23 May 2023
38 more
- 2023"What do others think?": Task-Oriented Conversational Modeling with Subjective Knowledge20 May 2023
- 2023Task-oriented Document-Grounded Dialog Systems by HLTPR@RWTH for DSTC9 and DSTC1014 Apr 2023
- 2023Task Oriented Conversational Modelling With Subjective Knowledge30 Mar 2023
- 2023Elastic Weight Removal for Faithful and Abstractive Dialogue Generation30 Mar 2023
- 2023Check Your Facts and Try Again: Improving Large Language Models with External Knowledge and Automated Feedback24 Feb 2023
- 2023Opportunities and Challenges in Neural Dialog Tutoring24 Jan 2023
- 2022Mind the Knowledge Gap: A Survey of Knowledge-enhanced Dialogue Systems19 Dec 2022
- 2022Topic-Aware Response Generation in Task-Oriented Dialogue with Unstructured Knowledge Access10 Dec 2022
- 2022CGoDial: A Large-Scale Benchmark for Chinese Goal-oriented Dialog Evaluation21 Nov 2022
- 2022From Knowledge Augmentation to Multi-tasking: Towards Human-like Dialogue Systems14 Nov 2022
- 2022Reranking Overgenerated Responses for End-to-End Task-Oriented Dialogue Systems7 Nov 2022
- 2022Controllable Factuality in Document-Grounded Dialog Systems Using a Noisy Channel Model31 Oct 2022
- 2022Joint Reasoning on Hybrid-knowledge sources for Task-Oriented Dialog13 Oct 2022
- 2022Knowledge-grounded Dialog State Tracking13 Oct 2022
- 2022AARGH! End-to-end Retrieval-Generation for Task-Oriented Dialog8 Sep 2022
- 2022External Knowledge Selection with Weighted Negative Sampling in Knowledge-grounded Task-oriented Dialogue Systems6 Sep 2022
- 2022A Challenge on Semi-Supervised and Reinforced Task-Oriented Dialog Systems6 Jul 2022
- 2022OPERA: Harmonizing Task-Oriented Dialogs and Information Seeking Experience24 Jun 2022
- 2022GODEL: Large-Scale Pre-Training for Goal-Directed Dialog22 Jun 2022
- 2022KETOD: Knowledge-Enriched Task-Oriented Dialogue11 May 2022
- 2022UniGDD: A Unified Generative Framework for Goal-Oriented Document-Grounded Dialogue16 Apr 2022
- 2022Where to Go for the Holidays: Towards Mixed-Type Dialogs for Clarification of User Goals15 Apr 2022
- 2022Towards Large-Scale Interpretable Knowledge Graph Reasoning for Dialogue Systems20 Mar 2022
- 2022Towards Generalized Models for Task-oriented Dialogue Modeling on Spoken Conversations8 Mar 2022
- 2021TOD-DA: Towards Boosting the Robustness of Task-oriented Dialogue Modeling on Spoken Conversations23 Dec 2021
- 2021Adapting Document-Grounded Dialog Systems to Spoken Conversations using Data Augmentation and a Noisy Channel Model16 Dec 2021
- 2021GKS: Graph-based Knowledge Selector for Task-oriented Dialog System7 Dec 2021
- 2021Variational Learning for Unsupervised Knowledge Grounded Dialogs23 Nov 2021
- 2021"How Robust r u?": Evaluating Task-Oriented Dialogue Systems on Spoken Conversations28 Sep 2021
- 2021PLATO-XL: Exploring the Large-scale Pre-training of Dialogue Generation20 Sep 2021
- 2021Towards Zero and Few-shot Knowledge-seeking Turn Detection in Task-orientated Dialogue Systems18 Sep 2021
- 2021Towards Handling Unconstrained User Preferences in Dialogue17 Sep 2021
- 2021End-to-End Learning of Flowchart Grounded Task-Oriented Dialogs15 Sep 2021
- 2021Challenging Instances are Worth Learning: Generating Valuable Negative Samples for Response Selection Training14 Sep 2021
- 2021Fusing task-oriented and open-domain dialogues in conversational agents9 Sep 2021
- 2021A Knowledge-Grounded Dialog System Based on Pre-Trained Language Models28 Jun 2021
- 2021End-to-End Task-Oriented Dialog Modeling with Semi-Structured Knowledge Management22 Jun 2021
- 2021Can I Be of Further Assistance? Using Unstructured Knowledge Access to Improve Task-oriented Conversational Modeling16 Jun 2021
50 newest of 58 All 58 (JSON)
- 2023Check Your Facts and Try Again: Improving Large Language Models with External Knowledge and Automated Feedbackcited by 351
- 2022GODEL: Large-Scale Pre-Training for Goal-Directed Dialogcited by 50
- 2021PLATO-XL: Exploring the Large-scale Pre-training of Dialogue Generationcited by 37
- 2023Opportunities and Challenges in Neural Dialog Tutoringcited by 33
- 2021"How Robust r u?": Evaluating Task-Oriented Dialogue Systems on Spoken Conversationscited by 30
- 2023Elastic Weight Removal for Faithful and Abstractive Dialogue Generationcited by 29
- 2021Fusing task-oriented and open-domain dialogues in conversational agentscited by 28
- 2021End-to-End Learning of Flowchart Grounded Task-Oriented Dialogscited by 19
- 2021Learning to Select External Knowledge with Multi-Scale Negative Samplingcited by 16
- 2021VISITRON: Visual Semantics-Aligned Interactively Trained Object-Navigatorcited by 13
- 2023SUQL: Conversational Search over Structured and Unstructured Data with Large Language Modelscited by 13
- 2022Where to Go for the Holidays: Towards Mixed-Type Dialogs for Clarification of User Goalscited by 12
12 most cited of 52 All 52 (JSON)
- 2026Progressive Training for Explainable Citation-Grounded Dialogue: Reducing Hallucination to Zero in English-Hindi LLMs19 Mar 2026
- 2024Unstructured Text Enhanced Open-domain Dialogue System: A Systematic Survey14 Nov 2024
- 2024Evaluating the Impact of Advanced LLM Techniques on AI-Lecture Tutors for a Robotics Course2 Aug 2024
- 2024Should We Fine-Tune or RAG? Evaluating Different Techniques to Adapt LLMs for Dialogue10 Jun 2024
- 2023SUQL: Conversational Search over Structured and Unstructured Data with Large Language Models16 Nov 2023
- 2023textitDial BeInfo for Faithfulness: Improving Factuality of Information-Seeking Dialogue via Behavioural Fine-Tuning16 Nov 2023
- 2023Salespeople vs SalesBot: Exploring the Role of Educational Value in Conversational Recommender Systems26 Oct 2023
- 2023Leveraging Few-Shot Data Augmentation and Waterfall Prompting for Response Generation2 Aug 2023
- 2023Revealing User Familiarity Bias in Task-Oriented Dialogue via Interactive Evaluation23 May 2023
- 2023"What do others think?": Task-Oriented Conversational Modeling with Subjective Knowledge20 May 2023
- 2023Task-oriented Document-Grounded Dialog Systems by HLTPR@RWTH for DSTC9 and DSTC1014 Apr 2023
- 2023Task Oriented Conversational Modelling With Subjective Knowledge30 Mar 2023
12 newest of 52 All 52 (JSON)