Out-Of-Distribution Detection In Unsupervised Continual Learning
Not on the map. Why?
Abstract (arXiv)
Unsupervised continual learning aims to learn new tasks incrementally without requiring human annotations. However, most existing methods, especially those targeted on image classification, only work in a simplified scenario by assuming all new data belong to new tasks, which is not realistic if the class labels are not provided. Therefore, to perform unsupervised continual learning in real life applications, an out-of-distribution detector is required at beginning to identify whether each new data corresponds to a new task or already learned tasks, which still remains under-explored yet. In this work, we formulate the problem for Out-of-distribution Detection in Unsupervised Continual Learning (OOD-UCL) with the corresponding evaluation protocol. In addition, we propose a novel OOD detection method by correcting the output bias at first and then enhancing the output confidence for in-distribution data based on task discriminativeness, which can be applied directly without modifying the learning procedures and objectives of continual learning. Our method is evaluated on CIFAR-100 dataset by following the proposed evaluation protocol and we show improved performance compared with existing OOD detection methods under the unsupervised continual learning scenario.
Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Builds on 25 of its 35 references that are in the map. First posted on arXiv 12 Apr 2022.
Builds on
25 of 35 references.
References · 25
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2015Distilling the Knowledge in a Neural Networkcited by 10,324
- 2016Learning without Forgettingcited by 2,496
- 2016A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networkscited by 2,385
- 2016iCaRL: Incremental Classifier and Representation Learningcited by 2,333
- 2018A Simple Unified Framework for Detecting Out-of-Distribution Samples and Adversarial Attackscited by 1,485
- 2017Enhancing The Reliability of Out-of-distribution Image Detection in Neural Networkscited by 1,328
- 2020Energy-based Out-of-distribution Detectioncited by 1,299
- 2021Generalized Out-of-Distribution Detection: A Surveycited by 802
- 2019Large Scale Incremental Learningcited by 732
- 2018End-to-End Incremental Learningcited by 597
- 2017Regularizing Neural Networks by Penalizing Confident Output Distributionscited by 464
13 more
- 2020Class-incremental learning: survey and performance evaluation on image classificationcited by 449
- 2018Why ReLU networks yield high-confidence predictions far away from the training data and how to mitigate the problemcited by 323
- 2019Maintaining Discrimination and Fairness in Class Incremental Learningcited by 283
- 2019Continual Unsupervised Representation Learningcited by 147
- 2020Incremental Learning In Online Scenariocited by 71
- 2021Energy-Based Open-World Uncertainty Modeling for Confidence Calibrationcited by 46
- 2020Towards Maximizing the Representation Gap between In-Domain & Out-of-Distribution Examplescited by 40
- 2021Online Continual Learning For Visual Food Classificationcited by 39
- 2019Unsupervised Progressive Learning and the STAM Architecturecited by 30
- 2019Unified Probabilistic Deep Continual Learning through Generative Replay and Open Set Recognitioncited by 26
- 2021Unsupervised Continual Learning Via Pseudo Labelscited by 18
- 2022Exemplar-free Online Continual Learningcited by 18
- 2021Online Continual Learning Via Candidates Votingcited by 15
Built on by
Citing papers per year: 2023: 3; 2024: 2; 2025: 5.
10 papers.
- 2023A Survey on Out-of-Distribution Detection in NLPcited by 31
- 2024CLAP4CLIP: Continual Learning with Probabilistic Finetuning for Vision-Language Modelscited by 25
- 2024A Comprehensive Survey of Convolutions in Deep Learning: Applications, Challenges, and Future Trendscited by 16
- 2023NPCL: Neural Processes for Uncertainty-Aware Continual Learningcited by 14
- 2023Continual Evidential Deep Learning for Out-of-Distribution Detectioncited by 11
- 2025H2ST: Hierarchical Two-Sample Tests for Continual Out-of-Distribution Detectioncited by 4
- 2025Buffer-free Class-Incremental Learning with Out-of-Distribution Detectioncited by 2
- 2025Out-of-Distribution Detection for Continual Learning: Design Principles and Benchmarkingcited by 1
- 2025Out of Distribution Detection for Efficient Continual Learning in Quality Prediction for Arc Weldingcited by 0
- 2025Learning After Model Deploymentcited by 0
- 2025Out-of-Distribution Detection for Continual Learning: Design Principles and Benchmarking16 Dec 2025
- 2025Learning After Model Deployment20 Oct 2025
- 2025Out of Distribution Detection for Efficient Continual Learning in Quality Prediction for Arc Welding22 Aug 2025
- 2025Buffer-free Class-Incremental Learning with Out-of-Distribution Detection29 May 2025
- 2025H2ST: Hierarchical Two-Sample Tests for Continual Out-of-Distribution Detection19 Mar 2025
- 2024CLAP4CLIP: Continual Learning with Probabilistic Finetuning for Vision-Language Models28 Mar 2024
- 2024A Comprehensive Survey of Convolutions in Deep Learning: Applications, Challenges, and Future Trends23 Feb 2024
- 2023NPCL: Neural Processes for Uncertainty-Aware Continual Learning30 Oct 2023
- 2023Continual Evidential Deep Learning for Out-of-Distribution Detection6 Sep 2023
- 2023A Survey on Out-of-Distribution Detection in NLP5 May 2023