A Dynamic Graph Interactive Framework with Label-Semantic Injection for Spoken Language Understanding
Not on the map. Why?
Abstract (arXiv)
Multi-intent detection and slot filling joint models are gaining increasing traction since they are closer to complicated real-world scenarios. However, existing approaches (1) focus on identifying implicit correlations between utterances and one-hot encoded labels in both tasks while ignoring explicit label characteristics; (2) directly incorporate multi-intent information for each token, which could lead to incorrect slot prediction due to the introduction of irrelevant intent. In this paper, we propose a framework termed DGIF, which first leverages the semantic information of labels to give the model additional signals and enriched priors. Then, a multi-grain interactive graph is constructed to model correlations between intents and slots. Specifically, we propose a novel approach to construct the interactive graph based on the injection of label semantics, which can automatically update the graph to better alleviate error propagation. Experimental results show that our framework significantly outperforms existing approaches, obtaining a relative improvement of 13.7% over the previous best model on the MixATIS dataset in overall accuracy.
Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 17 of its 37 references that are in the map. First posted on arXiv 8 Nov 2022.
Builds on
17 of 37 references.
References · 17
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2017Graph Attention Networkscited by 8,854
- 2018Snips Voice Platform: an embedded Spoken Language Understanding system for private-by-design voice interfacescited by 376
- 2017A Structured Self-attentive Sentence Embeddingcited by 318
- 2019BERT for Joint Intent Classification and Slot Fillingcited by 195
- 2019A Stack-Propagation Framework with Token-Level Intent Detection for Spoken Language Understandingcited by 106
- 2019A Novel Bi-directional Interrelated Model for Joint Intent Detection and Slot Fillingcited by 85
- 2020A Co-Interactive Transformer for Joint Slot Filling and Intent Detectioncited by 61
- 2018A Bi-model based RNN Semantic Frame Parsing Model for Intent Detection and Slot Fillingcited by 53
- 2021A Survey on Spoken Language Understanding: Recent Advances and New Frontierscited by 53
- 2021GL-GIN: Fast and Accurate Non-Autoregressive Model for Joint Multiple Intent Detection and Slot Fillingcited by 33
5 more
- 2019Hierarchically-Refined Label Attention Network for Sequence Labelingcited by 25
- 2021Joint Multiple Intent Detection and Slot Filling via Self-distillationcited by 12
- 2020PIN: A Novel Parallel Interactive Network for Spoken Language Understandingcited by 11
- 2021Towards Joint Intent Detection and Slot Filling via Higher-order Attentioncited by 11
- 2021SLIM: Explicit Slot-Intent Mapping with BERT for Joint Multi-Intent Detection and Slot Fillingcited by 10
Built on by
Citing papers per year: 2022: 2; 2023: 6; 2024: 1.
9 papers.
- 2022Differentially Private Learning with Per-Sample Adaptive Clippingcited by 21
- 2023PoseRAC: Pose Saliency Transformer for Repetitive Action Countingcited by 17
- 2023Multimodal Prompt Learning for Product Title Generation with Extremely Limited Labelscited by 2
- 2023JPIS: A Joint Model for Profile-based Intent Detection and Slot Filling with Slot-to-Intent Attentioncited by 2
- 2022Feature-augmented Machine Reading Comprehension with Auxiliary Taskscited by 0
- 2023FTM: A Frame-level Timeline Modeling Method for Temporal Graph Representation Learningcited by 0
- 2023TLAG: An Informative Trigger and Label-Aware Knowledge Guided Model for Dialogue-based Relation Extractioncited by 0
- 2023I2KD-SLU: An Intra-Inter Knowledge Distillation Framework for Zero-Shot Cross-Lingual Spoken Language Understandingcited by 0
- 2024Modeling Output-Level Task Relatedness in Multi-Task Learning with Feedback Mechanismcited by 0
- 2024Modeling Output-Level Task Relatedness in Multi-Task Learning with Feedback Mechanism1 Apr 2024
- 2023JPIS: A Joint Model for Profile-based Intent Detection and Slot Filling with Slot-to-Intent Attention14 Dec 2023
- 2023I2KD-SLU: An Intra-Inter Knowledge Distillation Framework for Zero-Shot Cross-Lingual Spoken Language Understanding4 Oct 2023
- 2023Multimodal Prompt Learning for Product Title Generation with Extremely Limited Labels5 Jul 2023
- 2023TLAG: An Informative Trigger and Label-Aware Knowledge Guided Model for Dialogue-based Relation Extraction30 Mar 2023
- 2023PoseRAC: Pose Saliency Transformer for Repetitive Action Counting15 Mar 2023
- 2023FTM: A Frame-level Timeline Modeling Method for Temporal Graph Representation Learning23 Feb 2023
- 2022Differentially Private Learning with Per-Sample Adaptive Clipping1 Dec 2022
- 2022Feature-augmented Machine Reading Comprehension with Auxiliary Tasks17 Nov 2022