CL-Flow:Strengthening the Normalizing Flows by Contrastive Learning for Better Anomaly Detection
Not on the map. Why?
Abstract (arXiv)
In the anomaly detection field, the scarcity of anomalous samples has directed the current research emphasis towards unsupervised anomaly detection. While these unsupervised anomaly detection methods offer convenience, they also overlook the crucial prior information embedded within anomalous samples. Moreover, among numerous deep learning methods, supervised methods generally exhibit superior performance compared to unsupervised methods. Considering the reasons mentioned above, we propose a self-supervised anomaly detection approach that combines contrastive learning with 2D-Flow to achieve more precise detection outcomes and expedited inference processes. On one hand, we introduce a novel approach to anomaly synthesis, yielding anomalous samples in accordance with authentic industrial scenarios, alongside their surrogate annotations. On the other hand, having obtained a substantial number of anomalous samples, we enhance the 2D-Flow framework by incorporating contrastive learning, leveraging diverse proxy tasks to fine-tune the network. Our approach enables the network to learn more precise mapping relationships from self-generated labels while retaining the lightweight characteristics of the 2D-Flow. Compared to mainstream unsupervised approaches, our self-supervised method demonstrates superior detection accuracy, fewer additional model parameters, and faster inference speed. Furthermore, the entire training and inference process is end-to-end. Our approach showcases new state-of-the-art results, achieving a performance of 99.6% in image-level AUROC on the MVTecAD dataset and 96.8% in image-level AUROC on the BTAD dataset.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 35 of its 40 references that are in the map. First posted on arXiv 12 Nov 2023.
Builds on
35 of 40 references.
References · 35
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,513
- 2022Generative Adversarial Networkscited by 5,627
- 2020Training data-efficient image transformers & distillation through attentioncited by 4,586
- 2020Exploring Simple Siamese Representation Learningcited by 2,866
- 2015Variational Inference with Normalizing Flowscited by 2,170
- 2016Density estimation using Real NVPcited by 2,042
- 2018Glow: Generative Flow with Invertible 1x1 Convolutionscited by 1,545
- 2014NICE: Non-linear Independent Components Estimationcited by 1,058
23 more
- 2021Towards Total Recall in Industrial Anomaly Detectioncited by 776
- 2020PaDiM: a Patch Distribution Modeling Framework for Anomaly Detection and Localizationcited by 594
- 2017Unsupervised Anomaly Detection with Generative Adversarial Networks to Guide Marker Discoverycited by 566
- 2021DRAEM -- A discriminatively trained reconstruction embedding for surface anomaly detectioncited by 514
- 2019Uninformed Students: Student-Teacher Anomaly Detection with Discriminative Latent Embeddingscited by 386
- 2021CFLOW-AD: Real-Time Unsupervised Anomaly Detection with Localization via Conditional Normalizing Flowscited by 321
- 2020Sub-Image Anomaly Detection with Deep Pyramid Correspondencescited by 300
- 2018Improving Unsupervised Defect Segmentation by Applying Structural Similarity to Autoencoderscited by 264
- 2021FastFlow: Unsupervised Anomaly Detection and Localization via 2D Normalizing Flowscited by 227
- 2021VT-ADL: A Vision Transformer Network for Image Anomaly Detection and Localizationcited by 223
- 2020Patch SVDD: Patch-level SVDD for Anomaly Detection and Segmentationcited by 212
- 2020Same Same But DifferNet: Semi-Supervised Defect Detection with Normalizing Flowscited by 212
- 2018Adversarially Learned One-Class Classifier for Novelty Detectioncited by 202
- 2018Efficient GAN-Based Anomaly Detectioncited by 122
- 2021Fully Convolutional Cross-Scale-Flows for Image-based Defect Detectioncited by 117
- 2020Modeling the Distribution of Normal Data in Pre-Trained Deep Features for Anomaly Detectioncited by 115
- 2019Skip-GANomaly: Skip Connected and Adversarially Trained Encoder-Decoder Anomaly Detectioncited by 100
- 2018Generative Probabilistic Novelty Detection with Adversarial Autoencoderscited by 99
- 2023PyramidFlow: High-Resolution Defect Contrastive Localization using Pyramid Normalizing Flowcited by 74
- 2022Explicit Boundary Guided Semi-Push-Pull Contrastive Learning for Supervised Anomaly Detectioncited by 72
- 2022U-Flow: A U-shaped Normalizing Flow for Anomaly Detection with Unsupervised Thresholdcited by 16
- 2018Deep Generative Model using Unregularized Score for Anomaly Detection with Heterogeneous Complexitycited by 10
- 2022CAINNFlow: Convolutional block Attention modules and Invertible Neural Networks Flow for anomaly detection and localization taskscited by 8
Built on by
Not cited yet.