Focus Your Distribution: Coarse-to-Fine Non-Contrastive Learning for Anomaly Detection and Localization
Not on the map. Why?
Abstract (arXiv)
The essence of unsupervised anomaly detection is to learn the compact distribution of normal samples and detect outliers as anomalies in testing. Meanwhile, the anomalies in real-world are usually subtle and fine-grained in a high-resolution image especially for industrial applications. Towards this end, we propose a novel framework for unsupervised anomaly detection and localization. Our method aims at learning dense and compact distribution from normal images with a coarse-to-fine alignment process. The coarse alignment stage standardizes the pixel-wise position of objects in both image and feature levels. The fine alignment stage then densely maximizes the similarity of features among all corresponding locations in a batch. To facilitate the learning with only normal images, we propose a new pretext task called non-contrastive learning for the fine alignment stage. Non-contrastive learning extracts robust and discriminating normal image representations without making assumptions on abnormal samples, and it thus empowers our model to generalize to various anomalous scenarios. Extensive experiments on two typical industrial datasets of MVTec AD and BenTech AD demonstrate that our framework is effective in detecting various real-world defects and achieves a new state-of-the-art in industrial unsupervised anomaly detection.
Key facts. Cited by 32 papers in the map (data through 7 Oct 2026). Builds on 33 of its 44 references that are in the map. First posted on arXiv 9 Oct 2021.
Builds on
33 of 44 references.
References · 33
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
- 2019CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Featurescited by 2,875
- 2020Exploring Simple Siamese Representation Learningcited by 2,853
- 2017Improved Regularization of Convolutional Neural Networks with Cutoutcited by 1,623
- 2018Unsupervised Representation Learning by Predicting Image Rotationscited by 1,586
- 2015Spatial Transformer Networkscited by 1,423
- 2020Understanding Contrastive Representation Learning through Alignment and Uniformity on the Hyperspherecited by 1,393
- 2020PaDiM: a Patch Distribution Modeling Framework for Anomaly Detection and Localizationcited by 591
- 2018Real-world Anomaly Detection in Surveillance Videoscited by 570
- 2017Unsupervised Anomaly Detection with Generative Adversarial Networks to Guide Marker Discoverycited by 566
21 more
- 2019Memorizing Normality to Detect Anomaly: Memory-augmented Deep Autoencoder for Unsupervised Anomaly Detectioncited by 560
- 2021CutPaste: Self-Supervised Learning for Anomaly Detection and Localizationcited by 529
- 2019Using Self-Supervised Learning Can Improve Model Robustness and Uncertaintycited by 511
- 2019Likelihood Ratios for Out-of-Distribution Detectioncited by 451
- 2020CSI: Novelty Detection via Contrastive Learning on Distributionally Shifted Instancescited by 441
- 2020A Unifying Review of Deep and Shallow Anomaly Detectioncited by 423
- 2019Uninformed Students: Student-Teacher Anomaly Detection with Discriminative Latent Embeddingscited by 386
- 2020Sub-Image Anomaly Detection with Deep Pyramid Correspondencescited by 297
- 2018Deep Anomaly Detection Using Geometric Transformationscited by 269
- 2021VT-ADL: A Vision Transformer Network for Image Anomaly Detection and Localizationcited by 222
- 2020Patch SVDD: Patch-level SVDD for Anomaly Detection and Segmentationcited by 212
- 2020Classification-Based Anomaly Detection for General Datacited by 210
- 2018Adversarially Learned One-Class Classifier for Novelty Detectioncited by 202
- 2019OCGAN: One-class Novelty Detection Using GANs with Constrained Latent Representationscited by 199
- 2020PANDA: Adapting Pretrained Features for Anomaly Detection and Segmentationcited by 175
- 2020Learning and Evaluating Representations for Deep One-class Classificationcited by 133
- 2020Explainable Deep One-Class Classificationcited by 126
- 2020Modeling the Distribution of Normal Data in Pre-Trained Deep Features for Anomaly Detectioncited by 115
- 2020Deep Nearest Neighbor Anomaly Detectioncited by 103
- 2018Generative Probabilistic Novelty Detection with Adversarial Autoencoderscited by 99
- 2016Identifying and Categorizing Anomalies in Retinal Imaging Datacited by 18
Built on by
Citing papers per year: 2022: 13; 2023: 7; 2024: 8; 2025: 3; 2026: 1.
32 papers.
Sort:
By area:
- 2023Deep Industrial Image Anomaly Detection: A Surveycited by 147
- 2022Registration based Few-Shot Anomaly Detectioncited by 133
- 2022MemSeg: A semi-supervised method for image surface defect detection using differences and commonalitiescited by 68
- 2022Deep Learning for Unsupervised Anomaly Localization in Industrial Images: A Surveycited by 67
- 2022Prototypical Residual Networks for Anomaly Detection and Localizationcited by 56
- 2024SoftPatch: Unsupervised Anomaly Detection with Noisy Datacited by 55
- 2025Exploring Intrinsic Normal Prototypes within a Single Image for Universal Anomaly Detectioncited by 47
- 2023Target before Shooting: Accurate Anomaly Detection and Localization under One Millisecond via Cascade Patch Retrievalcited by 22
- 2022A Survey on Unsupervised Anomaly Detection Algorithms for Industrial Imagescited by 21
- 2022MIAD: A Maintenance Inspection Dataset for Unsupervised Anomaly Detectioncited by 19
- 2022Reconstruction from edge image combined with color and gradient difference for industrial surface anomaly detectioncited by 18
- 2022U-Flow: A U-shaped Normalizing Flow for Anomaly Detection with Unsupervised Thresholdcited by 16
20 more
- 2024Learning Feature Inversion for Multi-class Anomaly Detection under General-purpose COCO-AD Benchmarkcited by 15
- 2022Benchmarking Unsupervised Anomaly Detection and Localizationcited by 11
- 2023SLSG: Industrial Image Anomaly Detection by Learning Better Feature Embeddings and One-Class Classificationcited by 10
- 2022Siamese Transition Masked Autoencoders as Uniform Unsupervised Visual Anomaly Detectorcited by 9
- 2023REB: Reducing Biases in Representation for Industrial Anomaly Detectioncited by 9
- 2024ToCoAD: Two-Stage Contrastive Learning for Industrial Anomaly Detectioncited by 7
- 2024SoftPatch+: Fully Unsupervised Anomaly Classification and Segmentationcited by 7
- 2024Few-Shot Anomaly Detection via Category-Agnostic Registration Learningcited by 6
- 2026Failure Identification in Imitation Learning Via Statistical and Semantic Filteringcited by 6
- 2024DAS3D: Dual-modality Anomaly Synthesis for 3D Anomaly Detectioncited by 5
- 2022Self-Supervised Training with Autoencoders for Visual Anomaly Detectioncited by 3
- 2022Discriminative Feature Learning Framework with Gradient Preference for Anomaly Detectioncited by 2
- 2024SPACE: SPAtial-aware Consistency rEgularization for anomaly detection in Industrial applicationscited by 2
- 2023Noise-to-Norm Reconstruction for Industrial Anomaly Detection and Localizationcited by 1
- 2023FAIR: Frequency-aware Image Restoration for Industrial Visual Anomaly Detectioncited by 1
- 2023Dual-Branch Reconstruction Network for Industrial Anomaly Detection with RGB-D Datacited by 1
- 2025ADPretrain: Advancing Industrial Anomaly Detection via Anomaly Representation Pretrainingcited by 1
- 2022[Reproducibility Report] Explainable Deep One-Class Classificationcited by 0
- 2024MAPL: Memory Augmentation and Pseudo-Labeling for Semi-Supervised Anomaly Detectioncited by 0
- 2025Tailored Transformation Invariance for Industrial Anomaly Detectioncited by 0
- 2026Failure Identification in Imitation Learning Via Statistical and Semantic Filtering15 Apr 2026
- 2025ADPretrain: Advancing Industrial Anomaly Detection via Anomaly Representation Pretraining7 Nov 2025
- 2025Tailored Transformation Invariance for Industrial Anomaly Detection22 Sep 2025
- 2025Exploring Intrinsic Normal Prototypes within a Single Image for Universal Anomaly Detection4 Mar 2025
- 2024SoftPatch+: Fully Unsupervised Anomaly Classification and Segmentation30 Dec 2024
- 2024SPACE: SPAtial-aware Consistency rEgularization for anomaly detection in Industrial applications5 Nov 2024
- 2024DAS3D: Dual-modality Anomaly Synthesis for 3D Anomaly Detection13 Oct 2024
- 2024ToCoAD: Two-Stage Contrastive Learning for Industrial Anomaly Detection1 Jul 2024
- 2024Few-Shot Anomaly Detection via Category-Agnostic Registration Learning13 Jun 2024
- 2024MAPL: Memory Augmentation and Pseudo-Labeling for Semi-Supervised Anomaly Detection10 May 2024
- 2024Learning Feature Inversion for Multi-class Anomaly Detection under General-purpose COCO-AD Benchmark16 Apr 2024
- 2024SoftPatch: Unsupervised Anomaly Detection with Noisy Data21 Mar 2024
20 more
- 2023Dual-Branch Reconstruction Network for Industrial Anomaly Detection with RGB-D Data12 Nov 2023
- 2023FAIR: Frequency-aware Image Restoration for Industrial Visual Anomaly Detection13 Sep 2023
- 2023REB: Reducing Biases in Representation for Industrial Anomaly Detection24 Aug 2023
- 2023Target before Shooting: Accurate Anomaly Detection and Localization under One Millisecond via Cascade Patch Retrieval13 Aug 2023
- 2023Noise-to-Norm Reconstruction for Industrial Anomaly Detection and Localization6 Jul 2023
- 2023SLSG: Industrial Image Anomaly Detection by Learning Better Feature Embeddings and One-Class Classification30 Apr 2023
- 2023Deep Industrial Image Anomaly Detection: A Survey27 Jan 2023
- 2022Prototypical Residual Networks for Anomaly Detection and Localization5 Dec 2022
- 2022MIAD: A Maintenance Inspection Dataset for Unsupervised Anomaly Detection25 Nov 2022
- 2022U-Flow: A U-shaped Normalizing Flow for Anomaly Detection with Unsupervised Threshold22 Nov 2022
- 2022Siamese Transition Masked Autoencoders as Uniform Unsupervised Visual Anomaly Detector1 Nov 2022
- 2022Reconstruction from edge image combined with color and gradient difference for industrial surface anomaly detection26 Oct 2022
- 2022Deep Learning for Unsupervised Anomaly Localization in Industrial Images: A Survey21 Jul 2022
- 2022Registration based Few-Shot Anomaly Detection15 Jul 2022
- 2022Self-Supervised Training with Autoencoders for Visual Anomaly Detection23 Jun 2022
- 2022[Reproducibility Report] Explainable Deep One-Class Classification6 Jun 2022
- 2022Benchmarking Unsupervised Anomaly Detection and Localization30 May 2022
- 2022MemSeg: A semi-supervised method for image surface defect detection using differences and commonalities2 May 2022
- 2022A Survey on Unsupervised Anomaly Detection Algorithms for Industrial Images24 Apr 2022
- 2022Discriminative Feature Learning Framework with Gradient Preference for Anomaly Detection23 Apr 2022
- 2023Deep Industrial Image Anomaly Detection: A Surveycited by 147
- 2022Registration based Few-Shot Anomaly Detectioncited by 133
- 2022MemSeg: A semi-supervised method for image surface defect detection using differences and commonalitiescited by 68
- 2022Deep Learning for Unsupervised Anomaly Localization in Industrial Images: A Surveycited by 67
- 2022Prototypical Residual Networks for Anomaly Detection and Localizationcited by 56
- 2024SoftPatch: Unsupervised Anomaly Detection with Noisy Datacited by 55
- 2025Exploring Intrinsic Normal Prototypes within a Single Image for Universal Anomaly Detectioncited by 47
- 2023Target before Shooting: Accurate Anomaly Detection and Localization under One Millisecond via Cascade Patch Retrievalcited by 22
- 2022A Survey on Unsupervised Anomaly Detection Algorithms for Industrial Imagescited by 21
- 2022MIAD: A Maintenance Inspection Dataset for Unsupervised Anomaly Detectioncited by 19
- 2022Reconstruction from edge image combined with color and gradient difference for industrial surface anomaly detectioncited by 18
- 2022U-Flow: A U-shaped Normalizing Flow for Anomaly Detection with Unsupervised Thresholdcited by 16
12 most cited of 31 All 31 (JSON)
- 2025ADPretrain: Advancing Industrial Anomaly Detection via Anomaly Representation Pretraining7 Nov 2025
- 2025Tailored Transformation Invariance for Industrial Anomaly Detection22 Sep 2025
- 2025Exploring Intrinsic Normal Prototypes within a Single Image for Universal Anomaly Detection4 Mar 2025
- 2024SoftPatch+: Fully Unsupervised Anomaly Classification and Segmentation30 Dec 2024
- 2024SPACE: SPAtial-aware Consistency rEgularization for anomaly detection in Industrial applications5 Nov 2024
- 2024DAS3D: Dual-modality Anomaly Synthesis for 3D Anomaly Detection13 Oct 2024
- 2024ToCoAD: Two-Stage Contrastive Learning for Industrial Anomaly Detection1 Jul 2024
- 2024Few-Shot Anomaly Detection via Category-Agnostic Registration Learning13 Jun 2024
- 2024MAPL: Memory Augmentation and Pseudo-Labeling for Semi-Supervised Anomaly Detection10 May 2024
- 2024Learning Feature Inversion for Multi-class Anomaly Detection under General-purpose COCO-AD Benchmark16 Apr 2024
- 2024SoftPatch: Unsupervised Anomaly Detection with Noisy Data21 Mar 2024
- 2023Dual-Branch Reconstruction Network for Industrial Anomaly Detection with RGB-D Data12 Nov 2023
12 newest of 31 All 31 (JSON)