SUMBT: Slot-Utterance Matching for Universal and Scalable Belief Tracking
Not on the map. Why?
Abstract (arXiv)
In goal-oriented dialog systems, belief trackers estimate the probability distribution of slot-values at every dialog turn. Previous neural approaches have modeled domain- and slot-dependent belief trackers, and have difficulty in adding new slot-values, resulting in lack of flexibility of domain ontology configurations. In this paper, we propose a new approach to universal and scalable belief tracker, called slot-utterance matching belief tracker (SUMBT). The model learns the relations between domain-slot-types and slot-values appearing in utterances through attention mechanisms based on contextual semantic vectors. Furthermore, the model predicts slot-value labels in a non-parametric way. From our experiments on two dialog corpora, WOZ 2.0 and MultiWOZ, the proposed model showed performance improvement in comparison with slot-dependent methods and achieved the state-of-the-art joint accuracy.
Key facts. Cited by 63 papers in the map (data through 7 Oct 2026). First posted on arXiv 17 Jul 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 23; 2022: 20; 2023: 10; 2024: 5; 2025: 2; 2026: 3.
63 papers.
Sort:
By area:
- 2024A Survey on Recent Advances in LLM-Based Multi-turn Dialogue Systemscited by 170
- 2021Multi-Task Pre-Training for Plug-and-Play Task-Oriented Dialogue Systemcited by 139
- 2021MultiWOZ 2.4: A Multi-Domain Task-Oriented Dialogue Dataset with Essential Annotation Corrections to Improve State Tracking Evaluationcited by 86
- 2021Leveraging Slot Descriptions for Zero-Shot Cross-Domain Dialogue State Trackingcited by 61
- 2021Zero-Shot Dialogue State Tracking via Cross-Task Transfercited by 52
- 2022Continual Prompt Tuning for Dialog State Trackingcited by 44
- 2022Controllable Dialogue Simulation with In-Context Learningcited by 42
- 2021Preview, Attend and Review: Schema-Aware Curriculum Learning for Multi-Domain Dialog State Trackingcited by 35
- 2024Large Language Models as Zero-shot Dialogue State Tracker through Function Callingcited by 34
- 2021Zero-shot Generalization in Dialog State Tracking through Generative Question Answeringcited by 33
- 2021Slot Self-Attentive Dialogue State Trackingcited by 27
- 2023Towards LLM-driven Dialogue State Trackingcited by 25
38 more
- 2021Gradual Fine-Tuning for Low-Resource Domain Adaptationcited by 23
- 2023A Survey of the Evolution of Language Model-Based Dialogue Systems: Data, Task and Modelscited by 23
- 2022ConvLab-3: A Flexible Dialogue System Toolkit Based on a Unified Data Formatcited by 22
- 2021Effective Sequence-to-Sequence Dialogue State Trackingcited by 20
- 2022BORT: Back and Denoising Reconstruction for End-to-End Task-Oriented Dialogcited by 20
- 2021Few Shot Dialogue State Tracking using Meta-learningcited by 16
- 2021NeuralWOZ: Learning to Collect Task-Oriented Dialogue via Model-Based Simulationcited by 16
- 2022Show, Don't Tell: Demonstrations Outperform Descriptions for Schema-Guided Task-Oriented Dialoguecited by 16
- 2022Robust Dialogue State Tracking with Weak Supervision and Sparse Datacited by 15
- 2022Extrinsic Evaluation of Machine Translation Metricscited by 14
- 2021Cross-lingual Intermediate Fine-tuning improves Dialogue State Trackingcited by 11
- 2022ASSIST: Towards Label Noise-Robust Dialogue State Trackingcited by 11
- 2022Mars: Modeling Context & State Representations with Contrastive Learning for End-to-End Task-Oriented Dialogcited by 11
- 2021Contextual Semantic Parsing for Multilingual Task-Oriented Dialoguescited by 10
- 2023Divide, Conquer, and Combine: Mixture of Semantic-Independent Experts for Zero-Shot Dialogue State Trackingcited by 10
- 2021Uncertainty Measures in Neural Belief Tracking and the Effects on Dialogue Policy Performancecited by 8
- 2023Prompter: Zero-shot Adaptive Prefixes for Dialogue State Tracking Domain Adaptationcited by 7
- 2022LUNA: Learning Slot-Turn Alignment for Dialogue State Trackingcited by 6
- 2022Multimodal Dialogue State Trackingcited by 6
- 2021Comprehensive Study: How the Context Information of Different Granularity Affects Dialogue State Tracking?cited by 5
- 2021Dual Slot Selector via Local Reliability Verification for Dialogue State Trackingcited by 5
- 2022On Tracking Dialogue State by Inheriting Slot Values in Mentioned Slot Poolscited by 5
- 2022Instilling Type Knowledge in Language Models via Multi-Task QAcited by 5
- 2026Can Large Language Models Keep Up? Benchmarking Online Adaptation to Continual Knowledge Streamscited by 5
- 2022Mismatch between Multi-turn Dialogue and its Evaluation Metric in Dialogue State Trackingcited by 4
- 2022OPAL: Ontology-Aware Pretrained Language Model for End-to-End Task-Oriented Dialoguecited by 4
- 2023DialogVCS: Robust Natural Language Understanding in Dialogue System Upgradecited by 4
- 2023Diable: Efficient Dialogue State Tracking as Operations on Tablescited by 4
- 2022MoNET: Tackle State Momentum via Noise-Enhanced Training for Dialogue State Trackingcited by 3
- 2024Multi-Modal Video Dialog State Tracking in the Wildcited by 3
- 2021Oh My Mistake!: Toward Realistic Dialogue State Tracking including Turnback Utterancescited by 2
- 2022XQA-DST: Multi-Domain and Multi-Lingual Dialogue State Trackingcited by 2
- 2026Frictive Policy Optimization for LLMs: Epistemic Intervention, Risk-Sensitive Control, and Reflective Alignmentcited by 2
- 2021Joint System-Wise Optimization for Pipeline Goal-Oriented Dialog Systemcited by 1
- 2023Dialogue State Distillation Network with Inter-slot Contrastive Learning for Dialogue State Trackingcited by 1
- 2023Choice Fusion as Knowledge for Zero-Shot Dialogue State Trackingcited by 1
- 2024MoPE: Mixture of Prefix Experts for Zero-Shot Dialogue State Trackingcited by 1
- 2021Coreference Augmentation for Multi-Domain Task-Oriented Dialogue State Trackingcited by 0
50 most cited of 63 All 63 (JSON)
- 2026Candidate Attended Dialogue State Tracking Using BERT17 Jul 2026
- 2026Frictive Policy Optimization for LLMs: Epistemic Intervention, Risk-Sensitive Control, and Reflective Alignment28 Apr 2026
- 2026Can Large Language Models Keep Up? Benchmarking Online Adaptation to Continual Knowledge Streams8 Mar 2026
- 2025HiCoLoRA: Addressing Context-Prompt Misalignment via Hierarchical Collaborative LoRA for Zero-Shot DST24 Sep 2025
- 2025Know Your Mistakes: Towards Preventing Overreliance on Task-Oriented Conversational AI Through Accountability Modeling17 Jan 2025
- 2024Beyond Ontology in Dialogue State Tracking for Goal-Oriented Chatbot30 Oct 2024
- 2024Multi-Modal Video Dialog State Tracking in the Wild2 Jul 2024
- 2024MoPE: Mixture of Prefix Experts for Zero-Shot Dialogue State Tracking12 Apr 2024
- 2024A Survey on Recent Advances in LLM-Based Multi-turn Dialogue Systems28 Feb 2024
- 2024Large Language Models as Zero-shot Dialogue State Tracker through Function Calling16 Feb 2024
- 2023A Survey of the Evolution of Language Model-Based Dialogue Systems: Data, Task and Models28 Nov 2023
- 2023Injecting linguistic knowledge into BERT for Dialogue State Tracking27 Nov 2023
38 more
- 2023Towards LLM-driven Dialogue State Tracking23 Oct 2023
- 2023Prompter: Zero-shot Adaptive Prefixes for Dialogue State Tracking Domain Adaptation7 Jun 2023
- 2023Divide, Conquer, and Combine: Mixture of Semantic-Independent Experts for Zero-Shot Dialogue State Tracking1 Jun 2023
- 2023Diable: Efficient Dialogue State Tracking as Operations on Tables26 May 2023
- 2023DialogVCS: Robust Natural Language Understanding in Dialogue System Upgrade24 May 2023
- 2023Choice Fusion as Knowledge for Zero-Shot Dialogue State Tracking25 Feb 2023
- 2023Dialogue State Distillation Network with Inter-slot Contrastive Learning for Dialogue State Tracking16 Feb 2023
- 2023A Personalized Utterance Style (PUS) based Dialogue Strategy for Efficient Service Requirement Elicitation7 Jan 2023
- 2022Extrinsic Evaluation of Machine Translation Metrics20 Dec 2022
- 2022ConvLab-3: A Flexible Dialogue System Toolkit Based on a Unified Data Format30 Nov 2022
- 2022MoNET: Tackle State Momentum via Noise-Enhanced Training for Dialogue State Tracking10 Nov 2022
- 2022Mars: Modeling Context & State Representations with Contrastive Learning for End-to-End Task-Oriented Dialog17 Oct 2022
- 2022Controllable Dialogue Simulation with In-Context Learning9 Oct 2022
- 2022Schema Encoding for Transferable Dialogue State Tracking5 Oct 2022
- 2022OPAL: Ontology-Aware Pretrained Language Model for End-to-End Task-Oriented Dialogue10 Sep 2022
- 2022Multimodal Dialogue State Tracking16 Jun 2022
- 2022LUNA: Learning Slot-Turn Alignment for Dialogue State Tracking5 May 2022
- 2022BORT: Back and Denoising Reconstruction for End-to-End Task-Oriented Dialog5 May 2022
- 2022Instilling Type Knowledge in Language Models via Multi-Task QA28 Apr 2022
- 2022A Study on Prompt-based Few-Shot Learning Methods for Belief State Tracking in Task-oriented Dialog Systems18 Apr 2022
- 2022XQA-DST: Multi-Domain and Multi-Lingual Dialogue State Tracking12 Apr 2022
- 2022Show, Don't Tell: Demonstrations Outperform Descriptions for Schema-Guided Task-Oriented Dialogue8 Apr 2022
- 2022ViWOZ: A Multi-Domain Task-Oriented Dialogue Systems Dataset For Low-resource Language15 Mar 2022
- 2022Continual Prompt Tuning for Dialog State Tracking13 Mar 2022
- 2022Mismatch between Multi-turn Dialogue and its Evaluation Metric in Dialogue State Tracking7 Mar 2022
- 2022ASSIST: Towards Label Noise-Robust Dialogue State Tracking26 Feb 2022
- 2022On Tracking Dialogue State by Inheriting Slot Values in Mentioned Slot Pools15 Feb 2022
- 2022Robust Dialogue State Tracking with Weak Supervision and Sparse Data7 Feb 2022
- 2021Contextual Semantic Parsing for Multilingual Task-Oriented Dialogues4 Nov 2021
- 2021Multi-Task Pre-Training for Plug-and-Play Task-Oriented Dialogue System29 Sep 2021
- 2021Improving Dialogue State Tracking by Joint Slot Modeling29 Sep 2021
- 2021Cross-lingual Intermediate Fine-tuning improves Dialogue State Tracking28 Sep 2021
- 2021Zero-Shot Dialogue State Tracking via Cross-Task Transfer10 Sep 2021
- 2021Uncertainty Measures in Neural Belief Tracking and the Effects on Dialogue Policy Performance9 Sep 2021
- 2021Effective Sequence-to-Sequence Dialogue State Tracking31 Aug 2021
- 2021Oh My Mistake!: Toward Realistic Dialogue State Tracking including Turnback Utterances28 Aug 2021
- 2021Ontology-Enhanced Slot Filling25 Aug 2021
- 2021Dual Slot Selector via Local Reliability Verification for Dialogue State Tracking27 Jul 2021
50 newest of 63 All 63 (JSON)
- 2024A Survey on Recent Advances in LLM-Based Multi-turn Dialogue Systemscited by 170
- 2021Multi-Task Pre-Training for Plug-and-Play Task-Oriented Dialogue Systemcited by 139
- 2021MultiWOZ 2.4: A Multi-Domain Task-Oriented Dialogue Dataset with Essential Annotation Corrections to Improve State Tracking Evaluationcited by 86
- 2021Leveraging Slot Descriptions for Zero-Shot Cross-Domain Dialogue State Trackingcited by 61
- 2021Zero-Shot Dialogue State Tracking via Cross-Task Transfercited by 52
- 2022Continual Prompt Tuning for Dialog State Trackingcited by 44
- 2022Controllable Dialogue Simulation with In-Context Learningcited by 42
- 2021Preview, Attend and Review: Schema-Aware Curriculum Learning for Multi-Domain Dialog State Trackingcited by 35
- 2021Zero-shot Generalization in Dialog State Tracking through Generative Question Answeringcited by 33
- 2021Slot Self-Attentive Dialogue State Trackingcited by 27
- 2023Towards LLM-driven Dialogue State Trackingcited by 25
- 2021Gradual Fine-Tuning for Low-Resource Domain Adaptationcited by 23
12 most cited of 61 All 61 (JSON)
- 2026Candidate Attended Dialogue State Tracking Using BERT17 Jul 2026
- 2026Frictive Policy Optimization for LLMs: Epistemic Intervention, Risk-Sensitive Control, and Reflective Alignment28 Apr 2026
- 2026Can Large Language Models Keep Up? Benchmarking Online Adaptation to Continual Knowledge Streams8 Mar 2026
- 2025HiCoLoRA: Addressing Context-Prompt Misalignment via Hierarchical Collaborative LoRA for Zero-Shot DST24 Sep 2025
- 2025Know Your Mistakes: Towards Preventing Overreliance on Task-Oriented Conversational AI Through Accountability Modeling17 Jan 2025
- 2024Beyond Ontology in Dialogue State Tracking for Goal-Oriented Chatbot30 Oct 2024
- 2024Multi-Modal Video Dialog State Tracking in the Wild2 Jul 2024
- 2024MoPE: Mixture of Prefix Experts for Zero-Shot Dialogue State Tracking12 Apr 2024
- 2024A Survey on Recent Advances in LLM-Based Multi-turn Dialogue Systems28 Feb 2024
- 2023A Survey of the Evolution of Language Model-Based Dialogue Systems: Data, Task and Models28 Nov 2023
- 2023Injecting linguistic knowledge into BERT for Dialogue State Tracking27 Nov 2023
- 2023Towards LLM-driven Dialogue State Tracking23 Oct 2023
12 newest of 61 All 61 (JSON)