Hybrid Synthetic Data Generation with Domain Randomization Enables Zero-Shot Vision-Based Part Inspection Under Extreme Class Imbalance
Not on the map. Why?
Abstract (arXiv)
Machine learning, particularly deep learning, is transforming industrial quality inspection. Yet, training robust machine learning models typically requires large volumes of high-quality labeled data, which are expensive, time-consuming, and labor-intensive to obtain in manufacturing. Moreover, defective samples are intrinsically rare, leading to severe class imbalance that degrades model performance. These data constraints hinder the widespread adoption of machine learning-based quality inspection methods in real production environments. Synthetic data generation (SDG) offers a promising solution by enabling the creation of large, balanced, and fully annotated datasets in an efficient, cost-effective, and scalable manner. This paper presents a hybrid SDG framework that integrates simulation-based rendering, domain randomization, and real background compositing to enable zero-shot learning for computer vision-based industrial part inspection without manual annotation. The SDG pipeline generates 12,960 labeled images in one hour by varying part geometry, lighting, and surface properties, and then compositing synthetic parts onto real image backgrounds. A two-stage architecture utilizing a YOLOv8n backbone for object detection and MobileNetV3-small for quality classification is trained exclusively on synthetic data and evaluated on 300 real industrial parts. The proposed approach achieves an [email protected] of 0.995 for detection, 96% classification accuracy, and 90.1% balanced accuracy. Comparative evaluation against few-shot real-data baseline approaches demonstrates significant improvement. The proposed SDG-based approach achieves 90-91% balanced accuracy under severe class imbalance, while the baselines reach only 50% accuracy. These results demonstrate that the proposed method enables annotation-free, scalable, and robust quality inspection for real-world manufacturing applications.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 10 of its 61 references that are in the map. First posted on arXiv 28 Nov 2025.
Builds on
10 of 61 references.
References · 10
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,626
- 2017Domain Randomization for Transferring Deep Neural Networks from Simulation to the Real Worldcited by 1,498
- 2022A Survey on Training Challenges in Generative Adversarial Networks for Biomedical Image Analysiscited by 24
- 2023Industrial Anomaly Detection with Domain Shift: A Real-world Dataset and Masked Multi-scale Reconstructioncited by 23
- 2022CAD2Render: A Modular Toolkit for GPU-accelerated Photorealistic Synthetic Data Generation for the Manufacturing Industrycited by 10
- 2024Towards Sim-to-Real Industrial Parts Classification with Synthetic Datasetcited by 7
- 2024Federated Transfer Learning with Task Personalization for Condition Monitoring in Ultrasonic Metal Weldingcited by 3
- 2025Physics-informed data-driven machine health monitoring for two-photon lithographycited by 2
- 2024Utilizing Generative Adversarial Networks for Image Data Augmentation and Classification of Semiconductor Wafer Dicing Induced Defectscited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.