mlsanityData to 7 Oct 2026

DDPM-MoCo: Advancing Industrial Surface Defect Generation and Detection with Generative and Contrastive Learning

arXiv 2407.03332 ↗First posted 9 May 2024cs.CV cs.AIcited by 10

On the map: Diffusion models → Flow matching, time series and science

Abstract (arXiv)

The task of industrial detection based on deep learning often involves solving two problems: (1) obtaining sufficient and effective data samples, (2) and using efficient and convenient model training methods. In this paper, we introduce a novel defect-generation method, named DDPM-MoCo, to address these issues. Firstly, we utilize the Denoising Diffusion Probabilistic Model (DDPM) to generate high-quality defect data samples, overcoming the problem of insufficient sample data for model learning. Furthermore, we utilize the unsupervised learning Momentum Contrast model (MoCo) with an enhanced batch contrastive loss function for training the model on unlabeled data, addressing the efficiency and consistency challenges in large-scale negative sample encoding during diffusion model training. The experimental results showcase an enhanced visual detection method for identifying defects on metal surfaces, covering the entire process, starting from generating unlabeled sample data for training the diffusion model, to utilizing the same labeled sample data for downstream detection tasks. This study offers valuable practical insights and application potential for visual detection in the metal processing industry.

Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Placed in Flow matching, time series and science, one of 14 directions in Diffusion models. Builds on 25 of its 40 references that are in the map. First posted on arXiv 9 May 2024.

Builds on

25 of 40 references.

References · 25

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  4. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  5. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
  6. 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
  7. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
  8. 2022Generative Adversarial Networkscited by 5,603
  9. 2020Improved Baselines with Momentum Contrastive Learningcited by 2,282
  10. 2015Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networkscited by 2,048
  11. 2018Unsupervised Feature Learning via Non-Parametric Instance-level Discriminationcited by 1,838
  12. 2017Improved Regularization of Convolutional Neural Networks with Cutoutcited by 1,623
13 more
  1. 2020Big Self-Supervised Models are Strong Semi-Supervised Learnerscited by 1,375
  2. 2018Learning deep representations by mutual information estimation and maximizationcited by 1,265
  3. 2020PaDiM: a Patch Distribution Modeling Framework for Anomaly Detection and Localizationcited by 591
  4. 2021CutPaste: Self-Supervised Learning for Anomaly Detection and Localizationcited by 529
  5. 2021DRAEM -- A discriminatively trained reconstruction embedding for surface anomaly detectioncited by 510
  6. 2020Propagate Yourself: Exploring Pixel-Level Consistency for Unsupervised Visual Representation Learningcited by 297
  7. 2020Same Same But DifferNet: Semi-Supervised Defect Detection with Normalizing Flowscited by 212
  8. 2022DeSTSeg: Segmentation Guided Denoising Student-Teacher for Anomaly Detectioncited by 153
  9. 2021Natural Synthetic Anomalies for Self-Supervised Anomaly Detection and Localizationcited by 116
  10. 2022MemSeg: A semi-supervised method for image surface defect detection using differences and commonalitiescited by 68
  11. 2022Prototypical Residual Networks for Anomaly Detection and Localizationcited by 56
  12. 2018Unsupervised Domain Adaptation for Automatic Estimation of Cardiothoracic Ratiocited by 16
  13. 2023ReSynthDetect: A Fundus Anomaly Detection Network with Reconstruction and Synthetic Featurescited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 1; 2025: 8; 2026: 1.

10 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Industrial Surface Defect Detection via Diffusion Generation and Asymmetric Student-Teacher Network
  2. 2025Enhancing Glass Defect Detection with Diffusion Models: Addressing Imbalanced Datasets in Manufacturing Quality Control
  3. 2024Bring the Power of Diffusion Model to Defect Detection
  4. 2024DefFiller: Mask-Conditioned Diffusion for Salient Steel Surface Defect Generation
  5. 2025Semi-Supervised Defect Detection via Conditional Diffusion and CLIP-Guided Noise Filtering
  6. 2024Defect Image Sample Generation With Diffusion Prior for Steel Surface Defect Recognition
  7. 2024Leveraging Latent Diffusion Models for Training-Free In-Distribution Data Augmentation for Surface Defect Detection
  8. 2025ExDD: Explicit Dual Distribution Learning for Surface Defect Detection via Diffusion Synthesis