SlotRefine: A Fast Non-Autoregressive Model for Joint Intent Detection and Slot Filling
Not on the map. Why?
Abstract (arXiv)
Slot filling and intent detection are two main tasks in spoken language understanding (SLU) system. In this paper, we propose a novel non-autoregressive model named SlotRefine for joint intent detection and slot filling. Besides, we design a novel two-pass iteration mechanism to handle the uncoordinated slots problem caused by conditional independence of non-autoregressive model. Experiments demonstrate that our model significantly outperforms previous models in slot filling task, while considerably speeding up the decoding (up to X 10.77). In-depth analyses show that 1) pretraining schemes could further enhance our model; 2) two-pass mechanism indeed remedy the uncoordinated slots.
Key facts. Cited by 42 papers in the map (data through 7 Oct 2026). First posted on arXiv 6 Oct 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 9; 2022: 14; 2023: 12; 2024: 4; 2025: 2; 2026: 1.
42 papers.
Sort:
By area:
- 2022A Survey on Non-Autoregressive Generation for Neural Machine Translation and Beyondcited by 64
- 2021GL-GIN: Fast and Accurate Non-Autoregressive Model for Joint Multiple Intent Detection and Slot Fillingcited by 33
- 2025A Survey on Parallel Text Generation: From Parallel Decoding to Diffusion Language Modelscited by 27
- 2023CoF-CoT: Enhancing Large Language Models with Coarse-to-Fine Chain-of-Thought Prompting for Multi-domain NLU Taskscited by 18
- 2022Knowledge Graph Augmented Network Towards Multiview Representation Learning for Aspect-based Sentiment Analysiscited by 16
- 2024WisdoM: Improving Multimodal Sentiment Analysis by Fusing Contextual World Knowledgecited by 16
- 2022A Survey of Intent Classification and Slot-Filling Datasets for Task-Oriented Dialogcited by 14
- 2022Co-guiding Net: Achieving Mutual Guidances between Multiple Intent Detection and Slot Filling via Heterogeneous Semantics-Label Graphscited by 14
- 2021Bridge to Target Domain by Prototypical Contrastive Learning and Label Confusion: Re-explore Zero-Shot Learning for Slot Fillingcited by 13
- 2021The USYD-JD Speech Translation System for IWSLT 2021cited by 11
- 2023Bag of Tricks for Effective Language Model Pretraining and Downstream Adaptation: A Case Study on GLUEcited by 11
- 2022Group is better than individual: Exploiting Label Topologies and Label Relations for Joint Multiple Intent Detection and Slot Fillingcited by 10
30 more
- 2023Divide, Conquer, and Combine: Mixture of Semantic-Independent Experts for Zero-Shot Dialogue State Trackingcited by 10
- 2021Bridging the Gap Between Clean Data Training and Real-World Inference for Spoken Language Understandingcited by 9
- 2021Self-Guided Curriculum Learning for Neural Machine Translationcited by 9
- 2022NLU++: A Multi-Label, Slot-Rich, Generalisable Dataset for Natural Language Understanding in Task-Oriented Dialoguecited by 8
- 2023Generative Zero-Shot Prompt Learning for Cross-Domain Slot Filling with Inverse Promptingcited by 8
- 2023Relational Temporal Graph Reasoning for Dual-task Dialogue Language Understandingcited by 7
- 2021Learning to Bridge Metric Spaces: Few-shot Joint Learning of Intent Detection and Slot Fillingcited by 6
- 2026The Bitter Lesson of Diffusion Language Models for Agentic Workflows: A Comprehensive Reality Checkcited by 6
- 2021An Effective Non-Autoregressive Model for Spoken Language Understandingcited by 5
- 2021TopicRefine: Joint Topic Prediction and Dialogue Response Generation for Multi-turn End-to-End Dialogue Systemcited by 5
- 2023Prompt-Learning for Cross-Lingual Relation Extractioncited by 4
- 2023Slot Induction via Pre-trained Language Model Probing and Multi-level Contrastive Learningcited by 4
- 2025Know Your Intent: An Autonomous Multi-Perspective LLM Agent Framework for DeFi User Transaction Intent Miningcited by 4
- 2022Label-aware Multi-level Contrastive Learning for Cross-lingual Spoken Language Understandingcited by 3
- 2022A Fast Attention Network for Joint Intent Detection and Slot Filling on Edge Devicescited by 3
- 2022A Scope Sensitive and Result Attentive Model for Multi-Intent Spoken Language Understandingcited by 3
- 2023Task Conditioned BERT for Joint Intent Detection and Slot-fillingcited by 3
- 2022Capture Salient Historical Information: A Fast and Accurate Non-Autoregressive Model for Multi-turn Spoken Language Understandingcited by 2
- 2022Real-time Caller Intent Detection In Human-Human Customer Support Spoken Conversationscited by 2
- 2023OmniForce: On Human-Centered, Large Model Empowered and Cloud-Edge Collaborative AutoML Systemcited by 2
- 2023Adaptive End-to-End Metric Learning for Zero-Shot Cross-Domain Slot Fillingcited by 2
- 2023Co-guiding for Multi-intent Spoken Language Understandingcited by 2
- 2024A Two-Stage Prediction-Aware Contrastive Learning Framework for Multi-Intent NLUcited by 2
- 2021A Joint and Domain-Adaptive Approach to Spoken Language Understandingcited by 1
- 2023Template-assisted Contrastive Learning of Task-oriented Dialogue Sentence Embeddingscited by 1
- 2022Requirements Elicitation in Cognitive Service for Recommendationcited by 0
- 2022Enhancing Slot Tagging with Intent Features for Task Oriented Natural Language Understanding using BERTcited by 0
- 2022Multi-grained Label Refinement Network with Dependency Structures for Joint Intent Detection and Slot Fillingcited by 0
- 2024HC2L: Hybrid and Cooperative Contrastive Learning for Cross-lingual Spoken Language Understandingcited by 0
- 2024Towards Spoken Language Understanding via Multi-level Multi-grained Contrastive Learningcited by 0
- 2026The Bitter Lesson of Diffusion Language Models for Agentic Workflows: A Comprehensive Reality Check19 Jan 2026
- 2025Know Your Intent: An Autonomous Multi-Perspective LLM Agent Framework for DeFi User Transaction Intent Mining19 Nov 2025
- 2025A Survey on Parallel Text Generation: From Parallel Decoding to Diffusion Language Models12 Aug 2025
- 2024Towards Spoken Language Understanding via Multi-level Multi-grained Contrastive Learning31 May 2024
- 2024HC2L: Hybrid and Cooperative Contrastive Learning for Cross-lingual Spoken Language Understanding10 May 2024
- 2024A Two-Stage Prediction-Aware Contrastive Learning Framework for Multi-Intent NLU5 May 2024
- 2024WisdoM: Improving Multimodal Sentiment Analysis by Fusing Contextual World Knowledge12 Jan 2024
- 2023Co-guiding for Multi-intent Spoken Language Understanding22 Nov 2023
- 2023Adaptive End-to-End Metric Learning for Zero-Shot Cross-Domain Slot Filling23 Oct 2023
- 2023CoF-CoT: Enhancing Large Language Models with Coarse-to-Fine Chain-of-Thought Prompting for Multi-domain NLU Tasks23 Oct 2023
- 2023Task Conditioned BERT for Joint Intent Detection and Slot-filling11 Aug 2023
- 2023Slot Induction via Pre-trained Language Model Probing and Multi-level Contrastive Learning9 Aug 2023
30 more
- 2023Generative Zero-Shot Prompt Learning for Cross-Domain Slot Filling with Inverse Prompting6 Jul 2023
- 2023Relational Temporal Graph Reasoning for Dual-task Dialogue Language Understanding15 Jun 2023
- 2023Divide, Conquer, and Combine: Mixture of Semantic-Independent Experts for Zero-Shot Dialogue State Tracking1 Jun 2023
- 2023Template-assisted Contrastive Learning of Task-oriented Dialogue Sentence Embeddings23 May 2023
- 2023Prompt-Learning for Cross-Lingual Relation Extraction20 Apr 2023
- 2023OmniForce: On Human-Centered, Large Model Empowered and Cloud-Edge Collaborative AutoML System1 Mar 2023
- 2023Bag of Tricks for Effective Language Model Pretraining and Downstream Adaptation: A Case Study on GLUE18 Feb 2023
- 2022A Scope Sensitive and Result Attentive Model for Multi-Intent Spoken Language Understanding22 Nov 2022
- 2022Co-guiding Net: Achieving Mutual Guidances between Multiple Intent Detection and Slot Filling via Heterogeneous Semantics-Label Graphs19 Oct 2022
- 2022Group is better than individual: Exploiting Label Topologies and Label Relations for Joint Multiple Intent Detection and Slot Filling19 Oct 2022
- 2022Multi-grained Label Refinement Network with Dependency Structures for Joint Intent Detection and Slot Filling9 Sep 2022
- 2022Real-time Caller Intent Detection In Human-Human Customer Support Spoken Conversations14 Aug 2022
- 2022A Survey of Intent Classification and Slot-Filling Datasets for Task-Oriented Dialog26 Jul 2022
- 2022Capture Salient Historical Information: A Fast and Accurate Non-Autoregressive Model for Multi-turn Spoken Language Understanding24 Jun 2022
- 2022Enhancing Slot Tagging with Intent Features for Task Oriented Natural Language Understanding using BERT19 May 2022
- 2022A Fast Attention Network for Joint Intent Detection and Slot Filling on Edge Devices16 May 2022
- 2022Label-aware Multi-level Contrastive Learning for Cross-lingual Spoken Language Understanding7 May 2022
- 2022NLU++: A Multi-Label, Slot-Rich, Generalisable Dataset for Natural Language Understanding in Task-Oriented Dialogue27 Apr 2022
- 2022A Survey on Non-Autoregressive Generation for Neural Machine Translation and Beyond20 Apr 2022
- 2022Requirements Elicitation in Cognitive Service for Recommendation29 Mar 2022
- 2022Knowledge Graph Augmented Network Towards Multiview Representation Learning for Aspect-based Sentiment Analysis13 Jan 2022
- 2021Bridge to Target Domain by Prototypical Contrastive Learning and Label Confusion: Re-explore Zero-Shot Learning for Slot Filling7 Oct 2021
- 2021TopicRefine: Joint Topic Prediction and Dialogue Response Generation for Multi-turn End-to-End Dialogue System11 Sep 2021
- 2021An Effective Non-Autoregressive Model for Spoken Language Understanding16 Aug 2021
- 2021A Joint and Domain-Adaptive Approach to Spoken Language Understanding25 Jul 2021
- 2021The USYD-JD Speech Translation System for IWSLT 202124 Jul 2021
- 2021GL-GIN: Fast and Accurate Non-Autoregressive Model for Joint Multiple Intent Detection and Slot Filling3 Jun 2021
- 2021Learning to Bridge Metric Spaces: Few-shot Joint Learning of Intent Detection and Slot Filling25 May 2021
- 2021Self-Guided Curriculum Learning for Neural Machine Translation10 May 2021
- 2021Bridging the Gap Between Clean Data Training and Real-World Inference for Spoken Language Understanding13 Apr 2021
- 2022A Survey on Non-Autoregressive Generation for Neural Machine Translation and Beyondcited by 64
- 2021GL-GIN: Fast and Accurate Non-Autoregressive Model for Joint Multiple Intent Detection and Slot Fillingcited by 33
- 2022Knowledge Graph Augmented Network Towards Multiview Representation Learning for Aspect-based Sentiment Analysiscited by 16
- 2024WisdoM: Improving Multimodal Sentiment Analysis by Fusing Contextual World Knowledgecited by 16
- 2022A Survey of Intent Classification and Slot-Filling Datasets for Task-Oriented Dialogcited by 14
- 2022Co-guiding Net: Achieving Mutual Guidances between Multiple Intent Detection and Slot Filling via Heterogeneous Semantics-Label Graphscited by 14
- 2021Bridge to Target Domain by Prototypical Contrastive Learning and Label Confusion: Re-explore Zero-Shot Learning for Slot Fillingcited by 13
- 2021The USYD-JD Speech Translation System for IWSLT 2021cited by 11
- 2023Bag of Tricks for Effective Language Model Pretraining and Downstream Adaptation: A Case Study on GLUEcited by 11
- 2022Group is better than individual: Exploiting Label Topologies and Label Relations for Joint Multiple Intent Detection and Slot Fillingcited by 10
- 2021Bridging the Gap Between Clean Data Training and Real-World Inference for Spoken Language Understandingcited by 9
- 2021Self-Guided Curriculum Learning for Neural Machine Translationcited by 9
12 most cited of 37 All 37 (JSON)
- 2024Towards Spoken Language Understanding via Multi-level Multi-grained Contrastive Learning31 May 2024
- 2024HC2L: Hybrid and Cooperative Contrastive Learning for Cross-lingual Spoken Language Understanding10 May 2024
- 2024A Two-Stage Prediction-Aware Contrastive Learning Framework for Multi-Intent NLU5 May 2024
- 2024WisdoM: Improving Multimodal Sentiment Analysis by Fusing Contextual World Knowledge12 Jan 2024
- 2023Co-guiding for Multi-intent Spoken Language Understanding22 Nov 2023
- 2023Adaptive End-to-End Metric Learning for Zero-Shot Cross-Domain Slot Filling23 Oct 2023
- 2023Task Conditioned BERT for Joint Intent Detection and Slot-filling11 Aug 2023
- 2023Slot Induction via Pre-trained Language Model Probing and Multi-level Contrastive Learning9 Aug 2023
- 2023Generative Zero-Shot Prompt Learning for Cross-Domain Slot Filling with Inverse Prompting6 Jul 2023
- 2023Relational Temporal Graph Reasoning for Dual-task Dialogue Language Understanding15 Jun 2023
- 2023Template-assisted Contrastive Learning of Task-oriented Dialogue Sentence Embeddings23 May 2023
- 2023Prompt-Learning for Cross-Lingual Relation Extraction20 Apr 2023
12 newest of 37 All 37 (JSON)