DDPM-MoCo: Advancing Industrial Surface Defect Generation and Detection with Generative and Contrastive Learning
On the map: Diffusion models → Flow matching, time series and science
Abstract (arXiv)
The task of industrial detection based on deep learning often involves solving two problems: (1) obtaining sufficient and effective data samples, (2) and using efficient and convenient model training methods. In this paper, we introduce a novel defect-generation method, named DDPM-MoCo, to address these issues. Firstly, we utilize the Denoising Diffusion Probabilistic Model (DDPM) to generate high-quality defect data samples, overcoming the problem of insufficient sample data for model learning. Furthermore, we utilize the unsupervised learning Momentum Contrast model (MoCo) with an enhanced batch contrastive loss function for training the model on unlabeled data, addressing the efficiency and consistency challenges in large-scale negative sample encoding during diffusion model training. The experimental results showcase an enhanced visual detection method for identifying defects on metal surfaces, covering the entire process, starting from generating unlabeled sample data for training the diffusion model, to utilizing the same labeled sample data for downstream detection tasks. This study offers valuable practical insights and application potential for visual detection in the metal processing industry.
Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Placed in Flow matching, time series and science, one of 14 directions in Diffusion models. Builds on 25 of its 40 references that are in the map. First posted on arXiv 9 May 2024.
Builds on
25 of 40 references.
References · 25
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
- 2022Generative Adversarial Networkscited by 5,603
- 2020Improved Baselines with Momentum Contrastive Learningcited by 2,282
- 2015Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networkscited by 2,048
- 2018Unsupervised Feature Learning via Non-Parametric Instance-level Discriminationcited by 1,838
- 2017Improved Regularization of Convolutional Neural Networks with Cutoutcited by 1,623
13 more
- 2020Big Self-Supervised Models are Strong Semi-Supervised Learnerscited by 1,375
- 2018Learning deep representations by mutual information estimation and maximizationcited by 1,265
- 2020PaDiM: a Patch Distribution Modeling Framework for Anomaly Detection and Localizationcited by 591
- 2021CutPaste: Self-Supervised Learning for Anomaly Detection and Localizationcited by 529
- 2021DRAEM -- A discriminatively trained reconstruction embedding for surface anomaly detectioncited by 510
- 2020Propagate Yourself: Exploring Pixel-Level Consistency for Unsupervised Visual Representation Learningcited by 297
- 2020Same Same But DifferNet: Semi-Supervised Defect Detection with Normalizing Flowscited by 212
- 2022DeSTSeg: Segmentation Guided Denoising Student-Teacher for Anomaly Detectioncited by 153
- 2021Natural Synthetic Anomalies for Self-Supervised Anomaly Detection and Localizationcited by 116
- 2022MemSeg: A semi-supervised method for image surface defect detection using differences and commonalitiescited by 68
- 2022Prototypical Residual Networks for Anomaly Detection and Localizationcited by 56
- 2018Unsupervised Domain Adaptation for Automatic Estimation of Cardiothoracic Ratiocited by 16
- 2023ReSynthDetect: A Fundus Anomaly Detection Network with Reconstruction and Synthetic Featurescited by 2
Built on by
Citing papers per year: 2024: 1; 2025: 8; 2026: 1.
10 papers.
- 2025ForgetMe: Evaluating Selective Forgetting in Generative Modelscited by 11
- 2024FALCON: Feedback-driven Adaptive Long/short-term memory reinforced Coding Optimization systemcited by 8
- 2025USVTrack: USV-Based 4D Radar-Camera Tracking Dataset for Autonomous Driving in Inland Waterwayscited by 4
- 2025Robust Anomaly Detection in Network Traffic: Evaluating Machine Learning Models on CICIDS2017cited by 4
- 2025MARS: Memory-Enhanced Agents with Reflective Self-improvementcited by 2
- 2025Industrial Internet Robot Collaboration System and Edge Computing Optimizationcited by 2
- 2026Flow Mismatching: Unsupervised Anomaly Detection via Velocity Discrepancies in Flow Matching Modelscited by 2
- 2025TDRI: Two-Phase Dialogue Refinement and Co-Adaptation for Interactive Image Generationcited by 1
- 2025First-place Solution for Streetscape Shop Sign Recognition Competitioncited by 0
- 2025A Multimodal Deep Learning Framework for Early Diagnosis of Liver Cancer via Optimized BiLSTM-AM-VMD Architecturecited by 0
- 2026Flow Mismatching: Unsupervised Anomaly Detection via Velocity Discrepancies in Flow Matching Models21 May 2026
- 2025A Multimodal Deep Learning Framework for Early Diagnosis of Liver Cancer via Optimized BiLSTM-AM-VMD Architecture1 Sep 2025
- 2025Robust Anomaly Detection in Network Traffic: Evaluating Machine Learning Models on CICIDS201723 Jun 2025
- 2025USVTrack: USV-Based 4D Radar-Camera Tracking Dataset for Autonomous Driving in Inland Waterways23 Jun 2025
- 2025ForgetMe: Evaluating Selective Forgetting in Generative Models17 Apr 2025
- 2025Industrial Internet Robot Collaboration System and Edge Computing Optimization3 Apr 2025
- 2025MARS: Memory-Enhanced Agents with Reflective Self-improvement25 Mar 2025
- 2025TDRI: Two-Phase Dialogue Refinement and Co-Adaptation for Interactive Image Generation22 Mar 2025
- 2025First-place Solution for Streetscape Shop Sign Recognition Competition6 Jan 2025
- 2024FALCON: Feedback-driven Adaptive Long/short-term memory reinforced Coding Optimization system28 Oct 2024
Similar, not cited
Close in wording, no citation either way
- 2026Industrial Surface Defect Detection via Diffusion Generation and Asymmetric Student-Teacher Network
- 2025Enhancing Glass Defect Detection with Diffusion Models: Addressing Imbalanced Datasets in Manufacturing Quality Control
- 2024Bring the Power of Diffusion Model to Defect Detection
- 2024DefFiller: Mask-Conditioned Diffusion for Salient Steel Surface Defect Generation
- 2025Semi-Supervised Defect Detection via Conditional Diffusion and CLIP-Guided Noise Filtering
- 2024Defect Image Sample Generation With Diffusion Prior for Steel Surface Defect Recognition
- 2024Leveraging Latent Diffusion Models for Training-Free In-Distribution Data Augmentation for Surface Defect Detection
- 2025ExDD: Explicit Dual Distribution Learning for Surface Defect Detection via Diffusion Synthesis