Unsupervised Visual Defect Detection with Score-Based Generative Model
On the map: Diffusion models → Flow matching, time series and science
Abstract (arXiv)
Anomaly Detection (AD), as a critical problem, has been widely discussed. In this paper, we specialize in one specific problem, Visual Defect Detection (VDD), in many industrial applications. And in practice, defect image samples are very rare and difficult to collect. Thus, we focus on the unsupervised visual defect detection and localization tasks and propose a novel framework based on the recent score-based generative models, which synthesize the real image by iterative denoising through stochastic differential equations (SDEs). Our work is inspired by the fact that with noise injected into the original image, the defects may be changed into normal cases in the denoising process (i.e., reconstruction). First, based on the assumption that the anomalous data lie in the low probability density region of the normal data distribution, we explain a common phenomenon that occurs when reconstruction-based approaches are applied to VDD: normal pixels also change during the reconstruction process. Second, due to the differences in normal pixels between the reconstructed and original images, a time-dependent gradient value (i.e., score) of normal data distribution is utilized as a metric, rather than reconstruction loss, to gauge the defects. Third, a novel T scales approach is developed to dramatically reduce the required number of iterations, accelerating the inference process. These practices allow our model to generalize VDD in an unsupervised manner while maintaining reasonably good performance. We evaluate our method on several datasets to demonstrate its effectiveness.
Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Placed in Flow matching, time series and science, one of 14 directions in Diffusion models. Builds on 36 of its 50 references that are in the map. First posted on arXiv 29 Nov 2022.
Builds on
36 of 50 references.
References · 36
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,170
- 2016Density estimation using Real NVPcited by 2,029
- 2021Towards Total Recall in Industrial Anomaly Detectioncited by 772
- 2020PaDiM: a Patch Distribution Modeling Framework for Anomaly Detection and Localizationcited by 591
- 2017Unsupervised Anomaly Detection with Generative Adversarial Networks to Guide Marker Discoverycited by 566
- 2019Memorizing Normality to Detect Anomaly: Memory-augmented Deep Autoencoder for Unsupervised Anomaly Detectioncited by 560
- 2021CutPaste: Self-Supervised Learning for Anomaly Detection and Localizationcited by 529
- 2021DRAEM -- A discriminatively trained reconstruction embedding for surface anomaly detectioncited by 510
- 2021Label-Efficient Semantic Segmentation with Diffusion Modelscited by 495
- 2018GANomaly: Semi-Supervised Anomaly Detection via Adversarial Trainingcited by 409
24 more
- 2019Uninformed Students: Student-Teacher Anomaly Detection with Discriminative Latent Embeddingscited by 386
- 2021CFLOW-AD: Real-Time Unsupervised Anomaly Detection with Localization via Conditional Normalizing Flowscited by 320
- 2020Multiresolution Knowledge Distillation for Anomaly Detectioncited by 285
- 2022Diffusion Models for Medical Anomaly Detectioncited by 231
- 2021FastFlow: Unsupervised Anomaly Detection and Localization via 2D Normalizing Flowscited by 225
- 2021VT-ADL: A Vision Transformer Network for Image Anomaly Detection and Localizationcited by 222
- 2020Same Same But DifferNet: Semi-Supervised Defect Detection with Normalizing Flowscited by 212
- 2019OCGAN: One-class Novelty Detection Using GANs with Constrained Latent Representationscited by 199
- 2020PANDA: Adapting Pretrained Features for Anomaly Detection and Segmentationcited by 175
- 2018Latent Space Autoregression for Novelty Detectioncited by 149
- 2021Student-Teacher Feature Pyramid Matching for Anomaly Detectioncited by 145
- 2021Adversarial purification with Score-based generative modelscited by 132
- 2020Self-Supervision with Superpixels: Training Few-shot Medical Image Segmentation without Annotationcited by 128
- 2021Fully Convolutional Cross-Scale-Flows for Image-based Defect Detectioncited by 117
- 2019Skip-GANomaly: Skip Connected and Adversarially Trained Encoder-Decoder Anomaly Detectioncited by 100
- 2020Interacting particle solutions of Fokker-Planck equations through gradient-log-density estimationcited by 87
- 2021Divide-and-Assemble: Learning Block-wise Memory for Unsupervised Anomaly Detectioncited by 83
- 2022Omni-frequency Channel-selection Representations for Unsupervised Anomaly Detectioncited by 79
- 2021Recurrent Mask Refinement for Few-Shot Medical Image Segmentationcited by 63
- 2018Anomaly Detection with Generative Adversarial Networks for Multivariate Time Seriescited by 55
- 2020DFR: Deep Feature Reconstruction for Unsupervised Anomaly Segmentationcited by 53
- 2020ARAE: Adversarially Robust Training of Autoencoders Improves Novelty Detectioncited by 27
- 2021Reconstruction Student with Attention for Student-Teacher Pyramid Matchingcited by 20
- 2019Exploring Deep Anomaly Detection Methods Based on Capsule Netcited by 7
Built on by
Citing papers per year: 2023: 4; 2024: 2; 2025: 0; 2026: 1.
7 papers.
- 2023Deep Industrial Image Anomaly Detection: A Surveycited by 147
- 2023BMAD: Benchmarks for Medical Anomaly Detectioncited by 81
- 2023Exploring Plain ViT Reconstruction for Multi-class Unsupervised Anomaly Detectioncited by 47
- 2023Don't Play Favorites: Minority Guidance for Diffusion Modelscited by 37
- 2024Incomplete Multimodal Industrial Anomaly Detection via Cross-Modal Distillationcited by 6
- 2024Advancing Pre-trained Teacher: Towards Robust Feature Discrepancy for Anomaly Detectioncited by 2
- 2026CFR-Net:Collaborative Feature Refinement Network for Medical Image Anomaly Detectioncited by 0
- 2026CFR-Net:Collaborative Feature Refinement Network for Medical Image Anomaly Detection13 Jul 2026
- 2024Incomplete Multimodal Industrial Anomaly Detection via Cross-Modal Distillation22 May 2024
- 2024Advancing Pre-trained Teacher: Towards Robust Feature Discrepancy for Anomaly Detection3 May 2024
- 2023Exploring Plain ViT Reconstruction for Multi-class Unsupervised Anomaly Detection12 Dec 2023
- 2023BMAD: Benchmarks for Medical Anomaly Detection20 Jun 2023
- 2023Don't Play Favorites: Minority Guidance for Diffusion Models29 Jan 2023
- 2023Deep Industrial Image Anomaly Detection: A Survey27 Jan 2023
Similar, not cited
Close in wording, no citation either way
- 2023DiffusionAD: Norm-guided One-step Denoising Diffusion for Anomaly Detection
- 2025Zero-Shot Image Anomaly Detection Using Generative Foundation Models
- 2025Anomaly Detection by Effectively Leveraging Synthetic Images
- 2025Correcting Deviations from Normality: A Reformulated Diffusion Model for Multi-Class Unsupervised Anomaly Detection
- 2023Anomaly Detection with Conditioned Denoising Diffusion Models
- 2025Single-Step Reconstruction-Free Anomaly Detection and Segmentation via Diffusion Models
- 2024Background-Aware Defect Generation for Robust Industrial Anomaly Detection
- 2024GLAD: Towards Better Reconstruction with Global and Local Adaptive Diffusion Models for Unsupervised Anomaly Detection