mlsanityData to 7 Oct 2026

A survey of joint intent detection and slot-filling models in natural language understanding

arXiv 2101.08091 ↗First posted 20 Jan 2021cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Intent classification and slot filling are two critical tasks for natural language understanding. Traditionally the two tasks have been deemed to proceed independently. However, more recently, joint models for intent classification and slot filling have achieved state-of-the-art performance, and have proved that there exists a strong relationship between the two tasks. This article is a compilation of past work in natural language understanding, especially joint intent classification and slot filling. We observe three milestones in this research so far: Intent detection to identify the speaker's intention, slot filling to label each word token in the speech/text, and finally, joint intent classification and slot filling tasks. In this article, we describe trends, approaches, issues, data sets, evaluation metrics in intent classification and slot filling. We also discuss representative performance values, describe shared tasks, and provide pointers to future work, as given in prior works. To interpret the state-of-the-art trends, we provide multiple tables that describe and summarise past research along different dimensions, including the types of features, base approaches, and dataset domain used.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 47 of its 174 references that are in the map. First posted on arXiv 20 Jan 2021.

Builds on

47 of 174 references.

References · 47

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018Snips Voice Platform: an embedded Spoken Language Understanding system for private-by-design voice interfacescited by 376
  3. 2019BERT for Joint Intent Classification and Slot Fillingcited by 195
  4. 2016Attention-Based Recurrent Neural Network Models for Joint Intent Detection and Slot Fillingcited by 137
  5. 2019Structural Scaffolds for Citation Intent Classification in Scientific Publicationscited by 129
  6. 2019Survey on Evaluation Methods for Dialogue Systemscited by 126
  7. 2018Cross-Lingual Transfer Learning for Multilingual Task Oriented Dialogcited by 124
  8. 2019A Stack-Propagation Framework with Token-Level Intent Detection for Spoken Language Understandingcited by 106
  9. 2019A Novel Bi-directional Interrelated Model for Joint Intent Detection and Slot Fillingcited by 85
  10. 2020CoSDA-ML: Multi-Lingual Code-Switching Data Augmentation for Zero-Shot Cross-Lingual NLPcited by 79
  11. 2018Joint Slot Filling and Intent Detection via Capsule Neural Networkscited by 73
  12. 2019Deep Unknown Intent Detection with Margin Losscited by 66
35 more
  1. 2018Zero-shot User Intent Detection via Capsule Neural Networkscited by 54
  2. 2018A Bi-model based RNN Semantic Frame Parsing Model for Intent Detection and Slot Fillingcited by 53
  3. 2019CM-Net: A Novel Collaborative Memory Network for Spoken Language Understandingcited by 34
  4. 2015A Survey of Available Corpora for Building Data-Driven Dialogue Systemscited by 33
  5. 2020Learning to Classify Intents and Slot Labels Given a Handful of Examplescited by 31
  6. 2016Leveraging Sentence-level Information with Encoder LSTM for Semantic Slot Fillingcited by 25
  7. 2019Multi-lingual Intent Detection and Slot Filling in a Joint BERT-based Modelcited by 24
  8. 2019Zero-shot Cross-lingual Dialogue Systems with Transferable Latent Variablescited by 21
  9. 2016Joint Online Spoken Language Understanding and Language Modeling with Recurrent Neural Networkscited by 19
  10. 2018Joint Learning of Domain Classification and Out-of-Domain Detection with Dynamic Class Weighting for Satisficing False Acceptance Ratescited by 17
  11. 2018OneNet: Joint Domain, Intent, Slot Prediction for Spoken Language Understandingcited by 13
  12. 2019Almawave-SLU: A new dataset for SLU in Italiancited by 13
  13. 2019Multi-Task Networks With Universe, Group, and Task Feature Learningcited by 11
  14. 2019CASA-NLU: Context-Aware Self-Attentive Natural Language Understanding for Task-Oriented Chatbotscited by 10
  15. 2016Encoder-decoder with Focus-mechanism for Sequence Labelling Based Spoken Language Understandingcited by 9
  16. 2018Unsupervised Transfer Learning for Spoken Language Understanding in Intelligent Agentscited by 8
  17. 2019Natural Language Interactions in Autonomous Vehicles: Intent Detection and Slot Filling from Passenger Utterancescited by 8
  18. 2018Deep Cascade Multi-task Learning for Slot Filling in Online Shopping Assistantcited by 7
  19. 2019Simple, Fast, Accurate Intent Classification and Slot Labeling for Goal-Oriented Dialogue Systemscited by 7
  20. 2020Prior Knowledge Driven Label Embedding for Slot Filling in Natural Language Understandingcited by 7
  21. 2015Recurrent Neural Networks with External Memory for Language Understandingcited by 6
  22. 2016End-to-End Joint Learning of Natural Language Understanding and Dialogue Managercited by 6
  23. 2016Sequential Convolutional Neural Networks for Slot Filling in Spoken Language Understandingcited by 5
  24. 2017Jointly Trained Sequential Labeling and Classification by Sparse Attention Neural Networkscited by 5
  25. 2018Multi-Layer Ensembling Techniques for Multilingual Intent Classificationcited by 4
  26. 2018Coupled Representation Learning for Domains, Intents and Slots in Spoken Language Understandingcited by 4
  27. 2019A Self-Attention Joint Model for Spoken Language Understanding in Situational Dialog Applicationscited by 4
  28. 2020Parallel Intent and Slot Prediction using MLB Fusioncited by 4
  29. 2018Subword Semantic Hashing for Intent Classification on Small Datasetscited by 3
  30. 2019Iterative Delexicalization for Improved Spoken Language Understandingcited by 3
  31. 2019Improving Slot Filling by Utilizing Contextual Informationcited by 3
  32. 2019Cross-lingual transfer learning for spoken language understandingcited by 2
  33. 2018Robust Spoken Language Understanding via Paraphrasingcited by 1
  34. 2018Elastic CRFs for Open-ontology Slot Fillingcited by 1
  35. 2020AGIF: An Adaptive Graph-Interactive Framework for Joint Multiple Intent Detection and Slot Fillingcited by 1

Built on by

Not cited yet.