OutFlip: Generating Out-of-Domain Samples for Unknown Intent Detection with Natural Language Attack
Not on the map. Why?
Abstract (arXiv)
Out-of-domain (OOD) input detection is vital in a task-oriented dialogue system since the acceptance of unsupported inputs could lead to an incorrect response of the system. This paper proposes OutFlip, a method to generate out-of-domain samples using only in-domain training dataset automatically. A white-box natural language attack method HotFlip is revised to generate out-of-domain samples instead of adversarial examples. Our evaluation results showed that integrating OutFlip-generated out-of-domain samples into the training dataset could significantly improve an intent classification model's out-of-domain detection performance.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 15 of its 26 references that are in the map. First posted on arXiv 12 May 2021.
Builds on
15 of 26 references.
References · 15
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,375
- 2016A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networkscited by 2,385
- 2014Convolutional Neural Networks for Sentence Classificationcited by 1,127
- 2019Is BERT Really Robust? A Strong Baseline for Natural Language Attack on Text Classification and Entailmentcited by 671
- 2020BERT-ATTACK: Adversarial Attack Against BERT Using BERTcited by 491
- 2018Do Deep Generative Models Know What They Don't Know?cited by 443
- 2018Generating Natural Language Adversarial Examplescited by 424
- 2019An Evaluation Dataset for Intent Classification and Out-of-Scope Predictioncited by 386
- 2018Snips Voice Platform: an embedded Spoken Language Understanding system for private-by-design voice interfacescited by 377
- 2017DOC: Deep Open Classification of Text Documentscited by 109
3 more
- 2019Deep Unknown Intent Detection with Margin Losscited by 66
- 2019Out-of-domain Detection for Natural Language Understanding in Dialog Systemscited by 62
- 2018Joint Learning of Domain Classification and Out-of-Domain Detection with Dynamic Class Weighting for Satisficing False Acceptance Ratescited by 17
Built on by
Citing papers per year: 2022: 1; 2023: 1.
2 papers.
- 2023A Survey on Out-of-Distribution Detection in NLPcited by 31
- 2022Estimating Soft Labels for Out-of-Domain Intent Detectioncited by 11
- 2023A Survey on Out-of-Distribution Detection in NLP5 May 2023
- 2022Estimating Soft Labels for Out-of-Domain Intent Detection10 Nov 2022