Hierarchical Semi-Supervised Contrastive Learning for Contamination-Resistant Anomaly Detection
Not on the map. Why?
Abstract (arXiv)
Anomaly detection aims at identifying deviant samples from the normal data distribution. Contrastive learning has provided a successful way to sample representation that enables effective discrimination on anomalies. However, when contaminated with unlabeled abnormal samples in training set under semi-supervised settings, current contrastive-based methods generally 1) ignore the comprehensive relation between training data, leading to suboptimal performance, and 2) require fine-tuning, resulting in low efficiency. To address the above two issues, in this paper, we propose a novel hierarchical semi-supervised contrastive learning (HSCL) framework, for contamination-resistant anomaly detection. Specifically, HSCL hierarchically regulates three complementary relations: sample-to-sample, sample-to-prototype, and normal-to-abnormal relations, enlarging the discrimination between normal and abnormal samples with a comprehensive exploration of the contaminated data. Besides, HSCL is an end-to-end learning approach that can efficiently learn discriminative representations without fine-tuning. HSCL achieves state-of-the-art performance in multiple scenarios, such as one-class classification and cross-dataset detection. Extensive ablation studies further verify the effectiveness of each considered relation. The code is available at https://github.com/GaoangW/HSCL.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 65 of its 83 references that are in the map. First posted on arXiv 24 Jul 2022.
Builds on
65 of 83 references.
References · 65
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,513
- 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 5,045
- 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,750
- 2014Going Deeper with Convolutionscited by 4,241
- 2020Unsupervised Learning of Visual Features by Contrasting Cluster Assignmentscited by 2,857
- 2020FixMatch: Simplifying Semi-Supervised Learning with Consistency and Confidencecited by 2,085
- 2017Accurate, Large Minibatch SGD: Training ImageNet in 1 Hourcited by 1,492
38 more
- 2016Context Encoders: Feature Learning by Inpaintingcited by 1,428
- 2019MixMatch: A Holistic Approach to Semi-Supervised Learningcited by 1,391
- 2017Enhancing The Reliability of Out-of-distribution Image Detection in Neural Networkscited by 1,328
- 2019Contrastive Multiview Codingcited by 1,301
- 2020Energy-based Out-of-distribution Detectioncited by 1,299
- 2019Self-Supervised Learning of Pretext-Invariant Representationscited by 808
- 2019Big Transfer (BiT): General Visual Representation Learningcited by 769
- 2020DivideMix: Learning with Noisy Labels as Semi-supervised Learningcited by 692
- 2019Memorizing Normality to Detect Anomaly: Memory-augmented Deep Autoencoder for Unsupervised Anomaly Detectioncited by 564
- 2021CutPaste: Self-Supervised Learning for Anomaly Detection and Localizationcited by 531
- 2021MetaFormer Is Actually What You Need for Visioncited by 524
- 2019Using Self-Supervised Learning Can Improve Model Robustness and Uncertaintycited by 514
- 2020Dense Contrastive Learning for Self-Supervised Visual Pre-Trainingcited by 512
- 2014Semi-Supervised Learning with Deep Generative Modelscited by 496
- 2020CSI: Novelty Detection via Contrastive Learning on Distributionally Shifted Instancescited by 441
- 2020Early-Learning Regularization Prevents Memorization of Noisy Labelscited by 416
- 2018GANomaly: Semi-Supervised Anomaly Detection via Adversarial Trainingcited by 409
- 2017Future Frame Prediction for Anomaly Detection -- A New Baselinecited by 391
- 2019Deep Semi-Supervised Anomaly Detectioncited by 291
- 2020Contrastive Clusteringcited by 265
- 2019Revisiting Self-Supervised Visual Representation Learningcited by 251
- 2021ViTAE: Vision Transformer Advanced by Exploring Intrinsic Inductive Biascited by 216
- 2020Classification-Based Anomaly Detection for General Datacited by 211
- 2019Probabilistic End-to-end Noise Correction for Learning with Noisy Labelscited by 210
- 2020SpeedNet: Learning the Speediness in Videoscited by 171
- 2020Learning and Evaluating Representations for Deep One-class Classificationcited by 133
- 2020Distilling Knowledge from Graph Convolutional Networkscited by 129
- 2021Multimodal Contrastive Training for Visual Representation Learningcited by 124
- 2018Adversarially Learned Anomaly Detectioncited by 115
- 2022Generative Cooperative Learning for Unsupervised Video Anomaly Detectioncited by 102
- 2021Shunted Self-Attention via Multi-Scale Token Aggregationcited by 90
- 2021Mean-Shifted Contrastive Loss for Anomaly Detectioncited by 88
- 2021Augmentation Strategies for Learning with Noisy Labelscited by 86
- 2020RSPNet: Relative Speed Perception for Unsupervised Video Representation Learningcited by 83
- 2020CLAWS: Clustering Assisted Weakly Supervised Learning with Normalcy Suppression for Anomalous Event Detectioncited by 79
- 2014Toward Supervised Anomaly Detectioncited by 73
- 2021Learning Normal Dynamics in Videos with Meta Prototype Networkcited by 71
- 2021Explainable Deep Few-shot Anomaly Detection with Deviation Networkscited by 69
50 most cited of 65 All 65 (JSON)
Built on by
Citing papers per year: 2023: 4; 2024: 1.
5 papers.
- 2023Hierarchical Semantic Contrast for Scene-aware Video Anomaly Detectioncited by 39
- 2024FUN-AD: Fully Unsupervised Learning for Anomaly Detection with Noisy Training Datacited by 8
- 2023No Free Lunch: The Hazards of Over-Expressive Representations in Anomaly Detectioncited by 7
- 2023Unilaterally Aggregated Contrastive Learning with Hierarchical Augmentation for Anomaly Detectioncited by 5
- 2023A Generic Machine Learning Framework for Fully-Unsupervised Anomaly Detection with Contaminated Datacited by 0
- 2024FUN-AD: Fully Unsupervised Learning for Anomaly Detection with Noisy Training Data25 Nov 2024
- 2023A Generic Machine Learning Framework for Fully-Unsupervised Anomaly Detection with Contaminated Data25 Aug 2023
- 2023Unilaterally Aggregated Contrastive Learning with Hierarchical Augmentation for Anomaly Detection20 Aug 2023
- 2023No Free Lunch: The Hazards of Over-Expressive Representations in Anomaly Detection12 Jun 2023
- 2023Hierarchical Semantic Contrast for Scene-aware Video Anomaly Detection23 Mar 2023