mlsanityData to 7 Oct 2026

Open World Classification with Adaptive Negative Samples

arXiv 2303.05581 ↗First posted 9 Mar 2023cs.CL cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

Open world classification is a task in natural language processing with key practical relevance and impact. Since the open or em unknown category data only manifests in the inference phase, finding a model with a suitable decision boundary accommodating for the identification of known classes and discrimination of the open category is challenging. The performance of existing models is limited by the lack of effective open category data during the training stage or the lack of a good mechanism to learn appropriate decision boundaries. We propose an approach based on underlineadaptive underlinenegative underlinesamples (ANS) designed to generate effective synthetic open category samples in the training stage and without requiring any prior knowledge or external datasets. Empirically, we find a significant advantage in using auxiliary one-versus-rest binary classifiers, which effectively utilize the generated negative samples and avoid the complex threshold-seeking stage in previous works. Extensive experiments on three benchmark datasets show that ANS achieves significant improvements over state-of-the-art methods.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 25 of its 40 references that are in the map. First posted on arXiv 9 Mar 2023.

Builds on

25 of 40 references.

References · 25

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
  3. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
  4. 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,326
  5. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
  6. 2017On Calibration of Modern Neural Networkscited by 4,860
  7. 2021Convex optimizationcited by 2,479
  8. 2016A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networkscited by 2,362
  9. 2017Enhancing The Reliability of Out-of-distribution Image Detection in Neural Networkscited by 1,325
  10. 2018CosFace: Large Margin Cosine Loss for Deep Face Recognitioncited by 968
  11. 2015Towards Open Set Deep Networkscited by 533
  12. 2020Efficient Intent Detection with Dual Sentence Encoderscited by 419
13 more
  1. 2019An Evaluation Dataset for Intent Classification and Out-of-Scope Predictioncited by 378
  2. 2016Adversarial Training Methods for Semi-Supervised Text Classificationcited by 280
  3. 2019FreeLB: Enhanced Adversarial Training for Natural Language Understandingcited by 261
  4. 2014Towards Open World Recognitioncited by 226
  5. 2020DROCC: Deep Robust One-Class Classificationcited by 121
  6. 2017DOC: Deep Open Classification of Text Documentscited by 109
  7. 2019Deep Unknown Intent Detection with Margin Losscited by 66
  8. 2020Deep Open Intent Classification with Adaptive Decision Boundarycited by 56
  9. 2021Energy-Based Open-World Uncertainty Modeling for Confidence Calibrationcited by 46
  10. 2021Modeling Discriminative Representations for Out-of-Domain Detection with Supervised Contrastive Learningcited by 42
  11. 2021Out-of-Scope Intent Detection with Self-Supervision and Discriminative Trainingcited by 42
  12. 2021TEXTOIR: An Integrated and Visualized Platform for Text Open Intent Recognitioncited by 24
  13. 2020A Post-processing Method for Detecting Unknown Intent of Dialogue System via Pre-trained Deep Neural Network Classifiercited by 11

Built on by

Cited by year

Citing papers per year: 2024: 1.

1 paper.