Diversity-grounded Channel Prototypical Learning for Out-of-Distribution Intent Detection
Not on the map. Why?
Abstract (arXiv)
In the realm of task-oriented dialogue systems, a robust intent detection mechanism must effectively handle malformed utterances encountered in real-world scenarios. This study presents a novel fine-tuning framework for large language models (LLMs) aimed at enhancing in-distribution (ID) intent classification and out-of-distribution (OOD) intent detection, which utilizes semantic matching with prototypes derived from ID class names. By harnessing the highly distinguishable representations of LLMs, we construct semantic prototypes for each ID class using a diversity-grounded prompt tuning approach. We rigorously test our framework in a challenging OOD context, where ID and OOD classes are semantically close yet distinct, referred to as near OOD detection. For a thorough assessment, we benchmark our method against the prevalent fine-tuning approaches. The experimental findings reveal that our method demonstrates superior performance in both few-shot ID intent classification and near-OOD intent detection tasks.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 23 of its 35 references that are in the map. First posted on arXiv 17 Sep 2024.
Builds on
23 of 35 references.
References · 23
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2015Distilling the Knowledge in a Neural Networkcited by 10,324
- 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,795
- 2022OPT: Open Pre-trained Transformer Language Modelscited by 3,512
- 2017Prototypical Networks for Few-shot Learningcited by 3,015
- 2018UMAP: Uniform Manifold Approximation and Projection for Dimension Reductioncited by 2,898
- 2019How Contextual are Contextualized Word Representations? Comparing the Geometry of BERT, ELMo, and GPT-2 Embeddingscited by 784
- 2020Efficient Intent Detection with Dual Sentence Encoderscited by 433
- 2019An Evaluation Dataset for Intent Classification and Out-of-Scope Predictioncited by 386
- 2020Pretrained Transformers Improve Out-of-Distribution Robustnesscited by 294
- 2021Exploring the Limits of Out-of-Distribution Detectioncited by 283
11 more
- 2019Representation Degeneration Problem in Training Natural Language Generation Modelscited by 255
- 2020Contrastive Training for Improved Out-of-Distribution Detectioncited by 186
- 2021Noisy Channel Language Model Prompting for Few-Shot Text Classificationcited by 165
- 2020Recent Advances and Challenges in Task-oriented Dialog Systemcited by 78
- 2021Contrastive Out-of-Distribution Detection for Pretrained Transformerscited by 71
- 2020Discriminative Nearest Neighbor Few-Shot Intent Detection by Transferring Natural Language Inferencecited by 47
- 2021Out-of-Scope Intent Detection with Self-Supervision and Discriminative Trainingcited by 42
- 2023Is Fine-tuning Needed? Pre-trained Language Models Are Near Perfect for Out-of-Domain Detectioncited by 29
- 2021Are Pretrained Transformers Robust in Intent Classification? A Missing Ingredient in Evaluation of Out-of-Scope Intent Detectioncited by 22
- 2022Fine-tuning Pre-trained Language Models for Few-shot Intent Detection: Supervised Pre-training and Isotropizationcited by 19
- 2024Continual Dialogue State Tracking via Reason-of-Select Distillationcited by 8
Built on by
Not cited yet.