DROID: Dual Representation for Out-of-Scope Intent Detection
Not on the map. Why?
Abstract (arXiv)
Detecting out-of-scope (OOS) user utterances remains a key challenge in task-oriented dialogue systems and, more broadly, in open-set intent recognition. Existing approaches often depend on strong distributional assumptions or auxiliary calibration modules. We present DROID (Dual Representation for Out-of-Scope Intent Detection), a compact end-to-end framework that combines two complementary encoders -- the Universal Sentence Encoder (USE) for broad semantic generalization and a domain-adapted Transformer-based Denoising Autoencoder (TSDAE) for domain-specific contextual distinctions. Their fused representations are processed by a lightweight branched classifier with a single calibrated threshold that separates in-domain and OOS intents without post-hoc scoring. To enhance boundary learning under limited supervision, DROID incorporates both synthetic and open-domain outlier augmentation. Despite using only 1.5M trainable parameters, DROID consistently outperforms recent state-of-the-art baselines across multiple intent benchmarks, achieving macro-F1 improvements of 6--15% for known and 8--20% for OOS intents, with the most significant gains in low-resource settings. These results demonstrate that dual-encoder representations with simple calibration can yield robust, scalable, and reliable OOS detection for neural dialogue systems.
Key facts. No citing papers in the map yet (data through 13 Oct 2026). Builds on 24 of its 34 references that are in the map. First posted on arXiv 15 Oct 2025.
Builds on
24 of 34 references.
References · 24
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,304
- 2014Adam: A Method for Stochastic Optimizationcited by 37,093
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,107
- 2016A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networkscited by 2,371
- 2018Know What You Don't Know: Unanswerable Questions for SQuADcited by 1,546
- 2015Towards Open Set Deep Networkscited by 535
- 2018Universal Sentence Encodercited by 488
- 2020Efficient Intent Detection with Dual Sentence Encoderscited by 425
- 2019An Evaluation Dataset for Intent Classification and Out-of-Scope Predictioncited by 381
- 2021Adversarial Reciprocal Points Learning for Open Set Recognitioncited by 153
- 2021TSDAE: Using Transformer-based Sequential Denoising Auto-Encoder for Unsupervised Sentence Embedding Learningcited by 116
- 2017DOC: Deep Open Classification of Text Documentscited by 109
12 more
- 2019Deep Unknown Intent Detection with Margin Losscited by 66
- 2020Deep Open Intent Classification with Adaptive Decision Boundarycited by 56
- 2021Out-of-Scope Intent Detection with Self-Supervision and Discriminative Trainingcited by 42
- 2021Unsupervised Out-of-Domain Detection via Pre-trained Transformerscited by 31
- 2024Intent Detection in the Age of LLMscited by 25
- 2021TEXTOIR: An Integrated and Visualized Platform for Text Open Intent Recognitioncited by 24
- 2022Learning Discriminative Representations and Decision Boundaries for Open Intent Detectioncited by 15
- 2024Beyond the Known: Investigating LLMs Performance on Out-of-Domain Intent Detectioncited by 14
- 2024A new approach for fine-tuning sentence transformers for intent classification and out-of-scope detection taskscited by 4
- 2021LIDSNet: A Lightweight on-device Intent Detection model using Deep Siamese Networkcited by 3
- 2023Effective Open Intent Classification with K-center Contrastive Learning and Adjustable Decision Boundarycited by 3
- 2024Improved Out-of-Scope Intent Classification with Dual Encoding and Threshold-based Re-Classificationcited by 2
Built on by
Not cited yet.