mlsanityData to 7 Oct 2026

Deep evolving semi-supervised anomaly detection

arXiv 2412.00860 ↗First posted 1 Dec 2024cs.LG cs.AI stat.MLcited by 0

Not on the map. Why?

Abstract (arXiv)

The aim of this paper is to formalise the task of continual semi-supervised anomaly detection (CSAD), with the aim of highlighting the importance of such a problem formulation which assumes as close to real-world conditions as possible. After an overview of the relevant definitions of continual semi-supervised learning, its components, anomaly detection extension, and the training protocols; the paper introduces a baseline model of a variational autoencoder (VAE) to work with semi-supervised data along with a continual learning method of deep generative replay with outlier rejection. The results show that such a use of extreme value theory (EVT) applied to anomaly detection can provide promising results even in comparison to an upper baseline of joint training. The results explore the effects of how much labelled and unlabelled data is present, of which class, and where it is located in the data stream. Outlier rejection shows promising initial results where it often surpasses a baseline method of Elastic Weight Consolidation (EWC). A baseline for CSAD is put forward along with the specific dataset setups used for reproducability and testability for other practitioners. Future research directions include other CSAD settings and further research into efficient continual hyperparameter tuning.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 25 of its 52 references that are in the map. First posted on arXiv 1 Dec 2024.

Builds on

25 of 52 references.

References · 25

  1. 2022Generative Adversarial Networkscited by 5,603
  2. 2016Overcoming catastrophic forgetting in neural networkscited by 4,718
  3. 2017Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithmscited by 4,283
  4. 2016Variational Inference: A Review for Statisticianscited by 1,466
  5. 2017Continual Learning with Deep Generative Replaycited by 1,152
  6. 2018Experience Replay for Continual Learningcited by 1,074
  7. 2019An Introduction to Variational Autoencoderscited by 997
  8. 2019AugMix: A Simple Data Processing Method to Improve Robustness and Uncertaintycited by 897
  9. 2016Ladder Variational Autoencoderscited by 315
  10. 2019Deep Semi-Supervised Anomaly Detectioncited by 290
  11. 2021Avalanche: an End-to-End Library for Continual Learningcited by 124
  12. 2020An Overview of Deep Semi-Supervised Learningcited by 121
13 more
  1. 2016Semi-Supervised Learning with Generative Adversarial Networkscited by 103
  2. 2021ORDisCo: Effective and Efficient Usage of Incremental Unlabeled Data for Semi-supervised Continual Learningcited by 68
  3. 2021Continuum: Simple Management of Complex Continual Learning Scenarioscited by 33
  4. 2019Unified Probabilistic Deep Continual Learning through Generative Replay and Open Set Recognitioncited by 26
  5. 2019Tutorial: Deriving the Standard Variational Autoencoder (VAE) Loss Functioncited by 26
  6. 2021Sequoia: A Software Framework to Unify Continual Learning Researchcited by 19
  7. 2019BooVAE: Boosting Approach for Continual Learning of VAEcited by 18
  8. 2022Beyond Supervised Continual Learning: a Reviewcited by 11
  9. 2020BinPlay: A Binary Latent Autoencoder for Generative Replay Continual Learningcited by 9
  10. 2020ARCADe: A Rapid Continual Anomaly Detectorcited by 7
  11. 2021Continual Learning for Unsupervised Anomaly Detection in Continuous Auditing of Financial Accounting Datacited by 7
  12. 2019Semi-Supervised Learning of Bearing Anomaly Detection via Deep Variational Autoencoderscited by 5
  13. 2021International Workshop on Continual Semi-Supervised Learning: Introduction, Benchmarks and Baselinescited by 3

Built on by

Not cited yet.