mlsanityData to 7 Oct 2026

Beyond Ontology in Dialogue State Tracking for Goal-Oriented Chatbot

arXiv 2410.22767 ↗First posted 30 Oct 2024cs.CL cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Goal-oriented chatbots are essential for automating user tasks, such as booking flights or making restaurant reservations. A key component of these systems is Dialogue State Tracking (DST), which interprets user intent and maintains the dialogue state. However, existing DST methods often rely on fixed ontologies and manually compiled slot values, limiting their adaptability to open-domain dialogues. We propose a novel approach that leverages instruction tuning and advanced prompt strategies to enhance DST performance, without relying on any predefined ontologies. Our method enables Large Language Model (LLM) to infer dialogue states through carefully designed prompts and includes an anti-hallucination mechanism to ensure accurate tracking in diverse conversation contexts. Additionally, we employ a Variational Graph Auto-Encoder (VGAE) to model and predict subsequent user intent. Our approach achieved state-of-the-art with a JGA of 42.57% outperforming existing ontology-less DST models, and performed well in open-domain real-world conversations. This work presents a significant advancement in creating more adaptive and accurate goal-oriented chatbots.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 46 of its 51 references that are in the map. First posted on arXiv 30 Oct 2024.

Builds on

46 of 51 references.

References · 46

  1. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  2. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  3. 2017Graph Attention Networkscited by 8,854
  4. 2017Inductive Representation Learning on Large Graphscited by 6,284
  5. 2018How Powerful are Graph Neural Networks?cited by 4,355
  6. 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,747
  7. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
  8. 2018Representation Learning on Graphs with Jumping Knowledge Networkscited by 875
  9. 2018Link Prediction Based on Graph Neural Networkscited by 829
  10. 2018Personalizing Dialogue Agents: I have a dog, do you have pets too?cited by 820
  11. 2018MultiWOZ -- A Large-Scale Multi-Domain Wizard-of-Oz Dataset for Task-Oriented Dialogue Modellingcited by 760
  12. 2023A Prompt Pattern Catalog to Enhance Prompt Engineering with ChatGPTcited by 612
34 more
  1. 2019Graph Transformer Networkscited by 520
  2. 2020Towards a Human-like Open-Domain Chatbotcited by 467
  3. 2019Towards Scalable Multi-domain Conversational Agents: The Schema-Guided Dialogue Datasetcited by 426
  4. 2020A Simple Language Model for Task-Oriented Dialoguecited by 331
  5. 2019Transferable Multi-Domain State Generator for Task-Oriented Dialogue Systemscited by 215
  6. 2019Challenges in Building Intelligent Open-domain Dialog Systemscited by 147
  7. 2016Neural Belief Tracker: Data-Driven Dialogue State Trackingcited by 142
  8. 2024Self-Discover: Large Language Models Self-Compose Reasoning Structurescited by 108
  9. 2021Dialogue State Tracking with a Language Model using Schema-Driven Promptingcited by 94
  10. 2021MultiWOZ 2.4: A Multi-Domain Task-Oriented Dialogue Dataset with Essential Annotation Corrections to Improve State Tracking Evaluationcited by 86
  11. 2019Find or Classify? Dual Strategy for Slot-Value Predictions on Multi-Domain Dialog State Trackingcited by 75
  12. 2021Few-Shot Bot: Prompt-Based Learning for Dialogue Systemscited by 64
  13. 2019SUMBT: Slot-Utterance Matching for Universal and Scalable Belief Trackingcited by 63
  14. 2019Dialog State Tracking: A Neural Reading Comprehension Approachcited by 62
  15. 2021Leveraging Slot Descriptions for Zero-Shot Cross-Domain Dialogue State Trackingcited by 61
  16. 2023The Curious Case of Hallucinatory (Un)answerability: Finding Truths in the Hidden States of Over-Confident Large Language Modelscited by 54
  17. 2021Zero-Shot Dialogue State Tracking via Cross-Task Transfercited by 52
  18. 2022In-Context Learning for Few-Shot Dialogue State Trackingcited by 47
  19. 2017Composite Task-Completion Dialogue Policy Learning via Hierarchical Deep Reinforcement Learningcited by 44
  20. 2019Multi-domain Dialogue State Tracking as Dynamic Knowledge Graph Enhanced Question Answeringcited by 39
  21. 2024Large Language Models as Zero-shot Dialogue State Tracker through Function Callingcited by 34
  22. 2020Efficient Context and Schema Fusion Networks for Multi-Domain Dialogue State Trackingcited by 27
  23. 2023Towards LLM-driven Dialogue State Trackingcited by 25
  24. 2019Scaling Multi-Domain Dialogue State Tracking via Query Reformulationcited by 20
  25. 2021Knowledge-Aware Graph-Enhanced GPT-2 for Dialogue State Trackingcited by 20
  26. 2022Dynamic Schema Graph Fusion Network for Multi-Domain Dialogue State Trackingcited by 18
  27. 2024SynthDST: Synthetic Data is All You Need for Few-Shot Dialog State Trackingcited by 17
  28. 2023Diverse Retrieval-Augmented In-Context Learning for Dialogue State Trackingcited by 10
  29. 2022DiSTRICT: Dialogue State Tracking with Retriever Driven In-Context Tuningcited by 9
  30. 2023Prompter: Zero-shot Adaptive Prefixes for Dialogue State Tracking Domain Adaptationcited by 7
  31. 2023S3-DST: Structured Open-Domain Dialogue Segmentation and State Tracking in the Era of LLMscited by 7
  32. 2023InstructTODS: Large Language Models for End-to-End Task-Oriented Dialogue Systemscited by 5
  33. 2023Semantic Parsing by Large Language Models for Intricate Updating Strategies of Zero-Shot Dialogue State Trackingcited by 5
  34. 2023UNO-DST: Leveraging Unlabelled Data in Zero-Shot Dialogue State Trackingcited by 1

Built on by

Not cited yet.