mlsanityData to 7 Oct 2026

Focus Your Distribution: Coarse-to-Fine Non-Contrastive Learning for Anomaly Detection and Localization

arXiv 2110.04538 ↗First posted 9 Oct 2021cs.CV cs.AIcited by 32

Not on the map. Why?

Abstract (arXiv)

The essence of unsupervised anomaly detection is to learn the compact distribution of normal samples and detect outliers as anomalies in testing. Meanwhile, the anomalies in real-world are usually subtle and fine-grained in a high-resolution image especially for industrial applications. Towards this end, we propose a novel framework for unsupervised anomaly detection and localization. Our method aims at learning dense and compact distribution from normal images with a coarse-to-fine alignment process. The coarse alignment stage standardizes the pixel-wise position of objects in both image and feature levels. The fine alignment stage then densely maximizes the similarity of features among all corresponding locations in a batch. To facilitate the learning with only normal images, we propose a new pretext task called non-contrastive learning for the fine alignment stage. Non-contrastive learning extracts robust and discriminating normal image representations without making assumptions on abnormal samples, and it thus empowers our model to generalize to various anomalous scenarios. Extensive experiments on two typical industrial datasets of MVTec AD and BenTech AD demonstrate that our framework is effective in detecting various real-world defects and achieves a new state-of-the-art in industrial unsupervised anomaly detection.

Key facts. Cited by 32 papers in the map (data through 7 Oct 2026). Builds on 33 of its 44 references that are in the map. First posted on arXiv 9 Oct 2021.

Builds on

33 of 44 references.

References · 33

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
  3. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
  4. 2019CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Featurescited by 2,875
  5. 2020Exploring Simple Siamese Representation Learningcited by 2,853
  6. 2017Improved Regularization of Convolutional Neural Networks with Cutoutcited by 1,623
  7. 2018Unsupervised Representation Learning by Predicting Image Rotationscited by 1,586
  8. 2015Spatial Transformer Networkscited by 1,423
  9. 2020Understanding Contrastive Representation Learning through Alignment and Uniformity on the Hyperspherecited by 1,393
  10. 2020PaDiM: a Patch Distribution Modeling Framework for Anomaly Detection and Localizationcited by 591
  11. 2018Real-world Anomaly Detection in Surveillance Videoscited by 570
  12. 2017Unsupervised Anomaly Detection with Generative Adversarial Networks to Guide Marker Discoverycited by 566
21 more
  1. 2019Memorizing Normality to Detect Anomaly: Memory-augmented Deep Autoencoder for Unsupervised Anomaly Detectioncited by 560
  2. 2021CutPaste: Self-Supervised Learning for Anomaly Detection and Localizationcited by 529
  3. 2019Using Self-Supervised Learning Can Improve Model Robustness and Uncertaintycited by 511
  4. 2019Likelihood Ratios for Out-of-Distribution Detectioncited by 451
  5. 2020CSI: Novelty Detection via Contrastive Learning on Distributionally Shifted Instancescited by 441
  6. 2020A Unifying Review of Deep and Shallow Anomaly Detectioncited by 423
  7. 2019Uninformed Students: Student-Teacher Anomaly Detection with Discriminative Latent Embeddingscited by 386
  8. 2020Sub-Image Anomaly Detection with Deep Pyramid Correspondencescited by 297
  9. 2018Deep Anomaly Detection Using Geometric Transformationscited by 269
  10. 2021VT-ADL: A Vision Transformer Network for Image Anomaly Detection and Localizationcited by 222
  11. 2020Patch SVDD: Patch-level SVDD for Anomaly Detection and Segmentationcited by 212
  12. 2020Classification-Based Anomaly Detection for General Datacited by 210
  13. 2018Adversarially Learned One-Class Classifier for Novelty Detectioncited by 202
  14. 2019OCGAN: One-class Novelty Detection Using GANs with Constrained Latent Representationscited by 199
  15. 2020PANDA: Adapting Pretrained Features for Anomaly Detection and Segmentationcited by 175
  16. 2020Learning and Evaluating Representations for Deep One-class Classificationcited by 133
  17. 2020Explainable Deep One-Class Classificationcited by 126
  18. 2020Modeling the Distribution of Normal Data in Pre-Trained Deep Features for Anomaly Detectioncited by 115
  19. 2020Deep Nearest Neighbor Anomaly Detectioncited by 103
  20. 2018Generative Probabilistic Novelty Detection with Adversarial Autoencoderscited by 99
  21. 2016Identifying and Categorizing Anomalies in Retinal Imaging Datacited by 18

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 13; 2023: 7; 2024: 8; 2025: 3; 2026: 1.

32 papers.

Sort:

By area:

  1. 2023Deep Industrial Image Anomaly Detection: A Surveycited by 147
  2. 2022Registration based Few-Shot Anomaly Detectioncited by 133
  3. 2022MemSeg: A semi-supervised method for image surface defect detection using differences and commonalitiescited by 68
  4. 2022Deep Learning for Unsupervised Anomaly Localization in Industrial Images: A Surveycited by 67
  5. 2022Prototypical Residual Networks for Anomaly Detection and Localizationcited by 56
  6. 2024SoftPatch: Unsupervised Anomaly Detection with Noisy Datacited by 55
  7. 2025Exploring Intrinsic Normal Prototypes within a Single Image for Universal Anomaly Detectioncited by 47
  8. 2023Target before Shooting: Accurate Anomaly Detection and Localization under One Millisecond via Cascade Patch Retrievalcited by 22
  9. 2022A Survey on Unsupervised Anomaly Detection Algorithms for Industrial Imagescited by 21
  10. 2022MIAD: A Maintenance Inspection Dataset for Unsupervised Anomaly Detectioncited by 19
  11. 2022Reconstruction from edge image combined with color and gradient difference for industrial surface anomaly detectioncited by 18
  12. 2022U-Flow: A U-shaped Normalizing Flow for Anomaly Detection with Unsupervised Thresholdcited by 16
20 more
  1. 2024Learning Feature Inversion for Multi-class Anomaly Detection under General-purpose COCO-AD Benchmarkcited by 15
  2. 2022Benchmarking Unsupervised Anomaly Detection and Localizationcited by 11
  3. 2023SLSG: Industrial Image Anomaly Detection by Learning Better Feature Embeddings and One-Class Classificationcited by 10
  4. 2022Siamese Transition Masked Autoencoders as Uniform Unsupervised Visual Anomaly Detectorcited by 9
  5. 2023REB: Reducing Biases in Representation for Industrial Anomaly Detectioncited by 9
  6. 2024ToCoAD: Two-Stage Contrastive Learning for Industrial Anomaly Detectioncited by 7
  7. 2024SoftPatch+: Fully Unsupervised Anomaly Classification and Segmentationcited by 7
  8. 2024Few-Shot Anomaly Detection via Category-Agnostic Registration Learningcited by 6
  9. 2026Failure Identification in Imitation Learning Via Statistical and Semantic Filteringcited by 6
  10. 2024DAS3D: Dual-modality Anomaly Synthesis for 3D Anomaly Detectioncited by 5
  11. 2022Self-Supervised Training with Autoencoders for Visual Anomaly Detectioncited by 3
  12. 2022Discriminative Feature Learning Framework with Gradient Preference for Anomaly Detectioncited by 2
  13. 2024SPACE: SPAtial-aware Consistency rEgularization for anomaly detection in Industrial applicationscited by 2
  14. 2023Noise-to-Norm Reconstruction for Industrial Anomaly Detection and Localizationcited by 1
  15. 2023FAIR: Frequency-aware Image Restoration for Industrial Visual Anomaly Detectioncited by 1
  16. 2023Dual-Branch Reconstruction Network for Industrial Anomaly Detection with RGB-D Datacited by 1
  17. 2025ADPretrain: Advancing Industrial Anomaly Detection via Anomaly Representation Pretrainingcited by 1
  18. 2022[Reproducibility Report] Explainable Deep One-Class Classificationcited by 0
  19. 2024MAPL: Memory Augmentation and Pseudo-Labeling for Semi-Supervised Anomaly Detectioncited by 0
  20. 2025Tailored Transformation Invariance for Industrial Anomaly Detectioncited by 0