mlsanityData to 14 Oct 2026

Out-Of-Distribution Detection In Unsupervised Continual Learning

arXiv 2204.05462 ↗First posted 12 Apr 2022cs.CVcited by 10

Not on the map. Why?

Abstract (arXiv)

Unsupervised continual learning aims to learn new tasks incrementally without requiring human annotations. However, most existing methods, especially those targeted on image classification, only work in a simplified scenario by assuming all new data belong to new tasks, which is not realistic if the class labels are not provided. Therefore, to perform unsupervised continual learning in real life applications, an out-of-distribution detector is required at beginning to identify whether each new data corresponds to a new task or already learned tasks, which still remains under-explored yet. In this work, we formulate the problem for Out-of-distribution Detection in Unsupervised Continual Learning (OOD-UCL) with the corresponding evaluation protocol. In addition, we propose a novel OOD detection method by correcting the output bias at first and then enhancing the output confidence for in-distribution data based on task discriminativeness, which can be applied directly without modifying the learning procedures and objectives of continual learning. Our method is evaluated on CIFAR-100 dataset by following the proposed evaluation protocol and we show improved performance compared with existing OOD detection methods under the unsupervised continual learning scenario.

Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Builds on 25 of its 35 references that are in the map. First posted on arXiv 12 Apr 2022.

Builds on

25 of 35 references.

References · 25

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2015Distilling the Knowledge in a Neural Networkcited by 10,324
  3. 2016Learning without Forgettingcited by 2,496
  4. 2016A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networkscited by 2,385
  5. 2016iCaRL: Incremental Classifier and Representation Learningcited by 2,333
  6. 2018A Simple Unified Framework for Detecting Out-of-Distribution Samples and Adversarial Attackscited by 1,485
  7. 2017Enhancing The Reliability of Out-of-distribution Image Detection in Neural Networkscited by 1,328
  8. 2020Energy-based Out-of-distribution Detectioncited by 1,299
  9. 2021Generalized Out-of-Distribution Detection: A Surveycited by 802
  10. 2019Large Scale Incremental Learningcited by 732
  11. 2018End-to-End Incremental Learningcited by 597
  12. 2017Regularizing Neural Networks by Penalizing Confident Output Distributionscited by 464
13 more
  1. 2020Class-incremental learning: survey and performance evaluation on image classificationcited by 449
  2. 2018Why ReLU networks yield high-confidence predictions far away from the training data and how to mitigate the problemcited by 323
  3. 2019Maintaining Discrimination and Fairness in Class Incremental Learningcited by 283
  4. 2019Continual Unsupervised Representation Learningcited by 147
  5. 2020Incremental Learning In Online Scenariocited by 71
  6. 2021Energy-Based Open-World Uncertainty Modeling for Confidence Calibrationcited by 46
  7. 2020Towards Maximizing the Representation Gap between In-Domain & Out-of-Distribution Examplescited by 40
  8. 2021Online Continual Learning For Visual Food Classificationcited by 39
  9. 2019Unsupervised Progressive Learning and the STAM Architecturecited by 30
  10. 2019Unified Probabilistic Deep Continual Learning through Generative Replay and Open Set Recognitioncited by 26
  11. 2021Unsupervised Continual Learning Via Pseudo Labelscited by 18
  12. 2022Exemplar-free Online Continual Learningcited by 18
  13. 2021Online Continual Learning Via Candidates Votingcited by 15

Built on by

Cited by year

Citing papers per year: 2023: 3; 2024: 2; 2025: 5.

10 papers.