Neural Belief Tracker: Data-Driven Dialogue State Tracking
Not on the map. Why?
Abstract (arXiv)
One of the core components of modern spoken dialogue systems is the belief tracker, which estimates the user's goal at every step of the dialogue. However, most current approaches have difficulty scaling to larger, more complex dialogue domains. This is due to their dependency on either: a) Spoken Language Understanding models that require large amounts of annotated training data; or b) hand-crafted lexicons for capturing some of the linguistic variation in users' language. We propose a novel Neural Belief Tracking (NBT) framework which overcomes these problems by building on recent advances in representation learning. NBT models reason over pre-trained word vectors, learning to compose them into distributed representations of user utterances and dialogue context. Our evaluation on two datasets shows that this approach surpasses past limitations, matching the performance of state-of-the-art models which rely on hand-crafted semantic lexicons and outperforming them when such lexicons are not provided.
Key facts. Cited by 142 papers in the map (data through 7 Oct 2026). First posted on arXiv 12 Jun 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2018: 2; 2019: 0; 2020: 0; 2021: 43; 2022: 43; 2023: 20; 2024: 20; 2025: 5; 2026: 9.
142 papers.
Sort:
By area:
- 2024Two Tales of Persona in LLMs: A Survey of Role-Playing and Personalizationcited by 203
- 2024A Survey on Recent Advances in LLM-Based Multi-turn Dialogue Systemscited by 170
- 2021RedditBias: A Real-World Resource for Bias Evaluation and Debiasing of Conversational Language Modelscited by 149
- 2021Multi-Task Pre-Training for Plug-and-Play Task-Oriented Dialogue Systemcited by 139
- 2021Recent Advances in Deep Learning Based Dialogue Systems: A Systematic Surveycited by 130
- 2021GALAXY: A Generative Pre-trained Model for Task-Oriented Dialog with Semi-Supervised Learning and Explicit Policy Injectioncited by 102
- 2023When Large Language Models Meet Personalization: Perspectives of Challenges and Opportunitiescited by 89
- 2021MultiWOZ 2.4: A Multi-Domain Task-Oriented Dialogue Dataset with Essential Annotation Corrections to Improve State Tracking Evaluationcited by 86
- 2022DialFRED: Dialogue-Enabled Agents for Embodied Instruction Followingcited by 63
- 2021DuRecDial 2.0: A Bilingual Parallel Corpus for Conversational Recommendationcited by 46
- 2022Continual Prompt Tuning for Dialog State Trackingcited by 44
- 2022Controllable Dialogue Simulation with In-Context Learningcited by 42
38 more
- 2022InstructDial: Improving Zero and Few-shot Generalization in Dialogue through Instruction Tuningcited by 39
- 2023ChatGPT for Zero-shot Dialogue State Tracking: A Solution or an Opportunity?cited by 38
- 2021SGD-X: A Benchmark for Robust Generalization in Schema-Guided Dialogue Systemscited by 34
- 2022SPACE-3: Unified Dialog Model Pre-training for Task-Oriented Dialog Understanding and Generationcited by 34
- 2024Large Language Models as Zero-shot Dialogue State Tracker through Function Callingcited by 34
- 2021Zero-shot Generalization in Dialog State Tracking through Generative Question Answeringcited by 33
- 2021Semi-Supervised Variational Reasoning for Medical Dialogue Generationcited by 30
- 2022A Survey on Recent Advances and Challenges in Reinforcement Learning Methods for Task-Oriented Dialogue Policy Learningcited by 30
- 2022Multi2WOZ: A Robust Multilingual Dataset and Conversational Pretraining for Task-Oriented Dialogcited by 30
- 2022HybriDialogue: An Information-Seeking Dialogue Dataset Grounded on Tabular and Textual Datacited by 28
- 2022SPACE-2: Tree-Structured Semi-Supervised Contrastive Pre-training for Task-Oriented Dialog Understandingcited by 28
- 2021Slot Self-Attentive Dialogue State Trackingcited by 27
- 2024Can Large Language Models Understand Context?cited by 26
- 2024Enhancing Dialogue State Tracking Models through LLM-backed User-Agents Simulationcited by 24
- 2021Pretraining the Noisy Channel Model for Task-Oriented Dialoguecited by 23
- 2022"Do you follow me?": A Survey of Recent Approaches in Dialogue State Trackingcited by 22
- 2022GenTUS: Simulating User Behaviour and Language in Task-oriented Dialogues with Generative Transformerscited by 22
- 2022ConvLab-3: A Flexible Dialogue System Toolkit Based on a Unified Data Formatcited by 22
- 2018Deep Dyna-Q: Integrating Planning for Task-Completion Dialogue Policy Learningcited by 21
- 2021DS-TOD: Efficient Domain Specialization for Task Oriented Dialogcited by 21
- 2021Amendable Generation for Dialogue State Trackingcited by 21
- 2023DialogStudio: Towards Richest and Most Diverse Unified Dataset Collection for Conversational AIcited by 21
- 2021Effective Sequence-to-Sequence Dialogue State Trackingcited by 20
- 2021ReMeDi: Resources for Multi-domain, Multi-service, Medical Dialoguescited by 20
- 2022Learning Dialogue Representations from Consecutive Utterancescited by 17
- 2024SynthDST: Synthetic Data is All You Need for Few-Shot Dialog State Trackingcited by 17
- 2021Crossing the Conversational Chasm: A Primer on Natural Language Processing for Multilingual Task-Oriented Dialogue Systemscited by 16
- 2022MVP: Multi-task Supervised Pre-training for Natural Language Generationcited by 16
- 2022Robust Dialogue State Tracking with Weak Supervision and Sparse Datacited by 15
- 2021DVD: A Diagnostic Dataset for Multi-step Reasoning in Video Grounded Dialoguecited by 13
- 2021Variational Latent-State GPT for Semi-Supervised Task-Oriented Dialog Systemscited by 13
- 2022BotsTalk: Machine-sourced Framework for Automatic Curation of Large-scale Multi-skill Dialogue Datasetscited by 13
- 2024Common Ground Tracking in Multimodal Dialoguecited by 13
- 2018Switch-based Active Deep Dyna-Q: Efficient Adaptive Planning for Task-Completion Dialogue Policy Learningcited by 12
- 2021Jointly Improving Language Understanding and Generation with Quality-Weighted Weak Supervision of Automatic Labelingcited by 11
- 2021Cross-lingual Intermediate Fine-tuning improves Dialogue State Trackingcited by 11
- 2022ASSIST: Towards Label Noise-Robust Dialogue State Trackingcited by 11
- 2022KETOD: Knowledge-Enriched Task-Oriented Dialoguecited by 11
50 most cited of 142 All 142 (JSON)
- 2026KnowSim: Evaluating Information Calibration in LLM Assistants with User Simulators that Learn17 Aug 2026
- 2026Never the Number: Structural Abstention for AI Systems Whose Answers Are Consumed as Fact14 Aug 2026
- 2026Candidate Attended Dialogue State Tracking Using BERT17 Jul 2026
- 2026Bridging Talk and Thought: Understanding Dialogue Dynamics Across Collaborative Problem-Solving Contexts25 Jun 2026
- 2026Stateful Guardrails for Multi-Turn LLM Systems: A Conversational Risk Accumulation Framework3 Jun 2026
- 2026Uncertainty as a Planning Signal: Multi-Turn Decision Making for Goal-Oriented Conversation5 Apr 2026
- 2026From Stateless to Situated: Building a Psychological World for LLM-Based Agents26 Mar 2026
- 2026Dynamic Knowledge Fusion for Multi-Domain Dialogue State Tracking11 Mar 2026
- 2026ESAinsTOD: A Unified End-to-End Schema-Aware Instruction-Tuning Framework for Task-Oriented Dialog Modeling10 Mar 2026
- 2025Ego-EXTRA: video-language Egocentric Dataset for EXpert-TRAinee assistance15 Dec 2025
- 2025RECAP: REwriting Conversations for Intent Understanding in Agentic Planning29 Aug 2025
- 2025Reward-Driven Interaction: Enhancing Proactive Dialogue Agents through User Satisfaction Prediction24 May 2025
38 more
- 2025Know Your Mistakes: Towards Preventing Overreliance on Task-Oriented Conversational AI Through Accountability Modeling17 Jan 2025
- 2025Prior Lessons of Incremental Dialogue and Robot Action Management for the Age of Language Models1 Jan 2025
- 2024Beyond Ontology in Dialogue State Tracking for Goal-Oriented Chatbot30 Oct 2024
- 2024Dialog2Flow: Pre-training Soft-Contrastive Action-Driven Sentence Embeddings for Automatic Dialog Flow Extraction24 Oct 2024
- 2024A Survey of Ontology Expansion for Conversational Understanding19 Oct 2024
- 2024A Zero-Shot Open-Vocabulary Pipeline for Dialogue Understanding24 Sep 2024
- 2024Sparse Rewards Can Self-Train Dialogue Agents6 Sep 2024
- 2024Multi-Modal Video Dialog State Tracking in the Wild2 Jul 2024
- 2024Two Tales of Persona in LLMs: A Survey of Role-Playing and Personalization3 Jun 2024
- 2024Enhancing Dialogue State Tracking Models through LLM-backed User-Agents Simulation17 May 2024
- 2024Modeling Low-Resource Health Coaching Dialogues via Neuro-Symbolic Goal Summarization and Text-Units-Text Generation16 Apr 2024
- 2024Towards Enhancing Health Coaching Dialogue in Low-Resource Settings13 Apr 2024
- 2024Semantic Stealth: Adversarial Text Attacks on NLP Using Several Methods8 Apr 2024
- 2024DivTOD: Unleashing the Power of LLMs for Diversifying Task-Oriented Dialogue Representations31 Mar 2024
- 2024Common Ground Tracking in Multimodal Dialogue26 Mar 2024
- 2024Chain of Thought Explanation for Dialogue State Tracking7 Mar 2024
- 2024BootTOD: Bootstrap Task-oriented Dialogue Representations by Aligning Diverse Responses2 Mar 2024
- 2024A Survey on Recent Advances in LLM-Based Multi-turn Dialogue Systems28 Feb 2024
- 2024OLViT: Multi-Modal State Tracking via Attention-Based Embeddings for Video-Grounded Dialog20 Feb 2024
- 2024Large Language Models as Zero-shot Dialogue State Tracker through Function Calling16 Feb 2024
- 2024SynthDST: Synthetic Data is All You Need for Few-Shot Dialog State Tracking3 Feb 2024
- 2024Can Large Language Models Understand Context?1 Feb 2024
- 2023OmniDialog: An Omnipotent Pre-training Model for Task-Oriented Dialogue System28 Dec 2023
- 2023CESAR: Automatic Induction of Compositional Instructions for Multi-turn Dialogs29 Nov 2023
- 2023Injecting linguistic knowledge into BERT for Dialogue State Tracking27 Nov 2023
- 2023Prompt Pool based Class-Incremental Continual Learning for Dialog State Tracking17 Nov 2023
- 2023Multi-Step Dialogue Workflow Action Prediction16 Nov 2023
- 2023Schema Graph-Guided Prompt for Multi-Domain Dialogue State Tracking10 Nov 2023
- 2023UNO-DST: Leveraging Unlabelled Data in Zero-Shot Dialogue State Tracking16 Oct 2023
- 2023Contextual Data Augmentation for Task-Oriented Dialog Systems16 Oct 2023
- 2023Grounding Description-Driven Dialogue State Trackers with Knowledge-Seeking Turns23 Sep 2023
- 2023UniPCM: Universal Pre-trained Conversation Model with Task-aware Automatic Prompt20 Sep 2023
- 2023Few-Shot Adaptation for Parsing Contextual Utterances with LLMs18 Sep 2023
- 2023Intelligent Assistant Language Understanding On Device7 Aug 2023
- 2023When Large Language Models Meet Personalization: Perspectives of Challenges and Opportunities31 Jul 2023
- 2023DialogStudio: Towards Richest and Most Diverse Unified Dataset Collection for Conversational AI19 Jul 2023
- 2023Towards a Neural Era in Dialogue Management for Collaboration: A Literature Survey18 Jul 2023
- 2023SimpleMTOD: A Simple Language Model for Multimodal Task-Oriented Dialogue with Symbolic Scene Representation10 Jul 2023
50 newest of 142 All 142 (JSON)
- 2024Large Language Models as Zero-shot Dialogue State Tracker through Function Callingcited by 34
- 2024Enhancing Dialogue State Tracking Models through LLM-backed User-Agents Simulationcited by 24
- 2025RECAP: REwriting Conversations for Intent Understanding in Agentic Planningcited by 7
- 2024Sparse Rewards Can Self-Train Dialogue Agentscited by 6
- 2026From Stateless to Situated: Building a Psychological World for LLM-Based Agentscited by 1
- 2026From Stateless to Situated: Building a Psychological World for LLM-Based Agents26 Mar 2026
- 2025RECAP: REwriting Conversations for Intent Understanding in Agentic Planning29 Aug 2025
- 2024Sparse Rewards Can Self-Train Dialogue Agents6 Sep 2024
- 2024Enhancing Dialogue State Tracking Models through LLM-backed User-Agents Simulation17 May 2024
- 2024Large Language Models as Zero-shot Dialogue State Tracker through Function Calling16 Feb 2024
- 2024Chain of Thought Explanation for Dialogue State Trackingcited by 3
- 2024Chain of Thought Explanation for Dialogue State Tracking7 Mar 2024
- 2024Two Tales of Persona in LLMs: A Survey of Role-Playing and Personalizationcited by 203
- 2024A Survey on Recent Advances in LLM-Based Multi-turn Dialogue Systemscited by 170
- 2021RedditBias: A Real-World Resource for Bias Evaluation and Debiasing of Conversational Language Modelscited by 149
- 2021Multi-Task Pre-Training for Plug-and-Play Task-Oriented Dialogue Systemcited by 139
- 2021Recent Advances in Deep Learning Based Dialogue Systems: A Systematic Surveycited by 130
- 2021GALAXY: A Generative Pre-trained Model for Task-Oriented Dialog with Semi-Supervised Learning and Explicit Policy Injectioncited by 102
- 2023When Large Language Models Meet Personalization: Perspectives of Challenges and Opportunitiescited by 89
- 2021MultiWOZ 2.4: A Multi-Domain Task-Oriented Dialogue Dataset with Essential Annotation Corrections to Improve State Tracking Evaluationcited by 86
- 2022DialFRED: Dialogue-Enabled Agents for Embodied Instruction Followingcited by 63
- 2021DuRecDial 2.0: A Bilingual Parallel Corpus for Conversational Recommendationcited by 46
- 2022Continual Prompt Tuning for Dialog State Trackingcited by 44
- 2022Controllable Dialogue Simulation with In-Context Learningcited by 42
12 most cited of 131 All 131 (JSON)
- 2026KnowSim: Evaluating Information Calibration in LLM Assistants with User Simulators that Learn17 Aug 2026
- 2026Never the Number: Structural Abstention for AI Systems Whose Answers Are Consumed as Fact14 Aug 2026
- 2026Candidate Attended Dialogue State Tracking Using BERT17 Jul 2026
- 2026Bridging Talk and Thought: Understanding Dialogue Dynamics Across Collaborative Problem-Solving Contexts25 Jun 2026
- 2026Uncertainty as a Planning Signal: Multi-Turn Decision Making for Goal-Oriented Conversation5 Apr 2026
- 2026Dynamic Knowledge Fusion for Multi-Domain Dialogue State Tracking11 Mar 2026
- 2026ESAinsTOD: A Unified End-to-End Schema-Aware Instruction-Tuning Framework for Task-Oriented Dialog Modeling10 Mar 2026
- 2025Ego-EXTRA: video-language Egocentric Dataset for EXpert-TRAinee assistance15 Dec 2025
- 2025Reward-Driven Interaction: Enhancing Proactive Dialogue Agents through User Satisfaction Prediction24 May 2025
- 2025Know Your Mistakes: Towards Preventing Overreliance on Task-Oriented Conversational AI Through Accountability Modeling17 Jan 2025
- 2025Prior Lessons of Incremental Dialogue and Robot Action Management for the Age of Language Models1 Jan 2025
- 2024Beyond Ontology in Dialogue State Tracking for Goal-Oriented Chatbot30 Oct 2024
12 newest of 131 All 131 (JSON)