Large-Scale Universal Defect Generation: Foundation Models and Datasets
Not on the map. Why?
Abstract (arXiv)
Existing defect/anomaly generation methods often rely on few-shot learning, which overfits to specific defect categories due to the lack of large-scale paired defect editing data. This issue is aggravated by substantial variations in defect scale and morphology, resulting in limited generalization, degraded realism, and category consistency. We address these challenges by introducing UDG, a large-scale dataset of 300K normal-abnormal-mask-caption quadruplets spanning diverse domains, and by presenting UniDG, a universal defect generation foundation model that supports both reference-based defect generation and text instruction-based defect editing without per-category fine-tuning. UniDG performs Defect-Context Editing via adaptive defect cropping and structured diptych input format, and fuses reference and target conditions through MM-DiT multimodal attention. A two-stage training strategy, Diversity-SFT followed by Consistency-RFT, further improves diversity while enhancing realism and reference consistency. Extensive experiments on MVTec-AD and VisA show that UniDG outperforms prior few-shot anomaly generation and image insertion/editing baselines in synthesis quality and downstream single- and multi-class anomaly detection/localization. Code will be available at https://github.com/RetoFan233/UniDG.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 34 of its 38 references that are in the map. First posted on arXiv 10 Apr 2026.
Builds on
34 of 38 references.
References · 34
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
- 2025Qwen3-VL Technical Reportcited by 2,534
- 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,231
- 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,442
22 more
- 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,439
- 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 960
- 2025Flow-GRPO: Training Flow Matching Models via Online RLcited by 605
- 2023AnyDoor: Zero-shot Object-level Image Customizationcited by 411
- 2022SPot-the-Difference Self-Supervised Pre-training for Anomaly Detection and Segmentationcited by 397
- 2025Z-Image: An Efficient Image Generation Foundation Model with Single-Stream Diffusion Transformercited by 247
- 2024Real-IAD: A Real-World Multi-View Dataset for Benchmarking Versatile Industrial Anomaly Detectioncited by 138
- 2023Prodigy: An Expeditiously Adaptive Parameter-Free Learnercited by 129
- 2023AnomalyDiffusion: Few-Shot Anomaly Image Generation with Diffusion Modelcited by 110
- 2023Few-Shot Defect Image Generation via Defect-Aware Feature Manipulationcited by 66
- 2025Insert Anything: Image Insertion via In-Context Editing in DiTcited by 61
- 2024MMAD: A Comprehensive Benchmark for Multimodal Large Language Models in Industrial Anomaly Detectioncited by 46
- 2024FreeEdit: Mask-free Reference-based Image Editing with Multi-modal Instructioncited by 35
- 2024Dual-Interrelated Diffusion Model for Few-Shot Anomaly Image Generationcited by 31
- 2025AdaptCLIP: Adapting CLIP for Universal Visual Anomaly Detectioncited by 28
- 2024SeaS: Few-shot Industrial Anomaly Image Generation with Separation and Sharing Fine-tuningcited by 26
- 2024MANTA: A Large-Scale Multi-View and Visual-Text Anomaly Detection Dataset for Tiny Objectscited by 26
- 2025DefectFill: Realistic Defect Generation with Inpainting Diffusion Model for Visual Inspectioncited by 12
- 20253CAD: A Large-Scale Real-World 3C Product Dataset for Unsupervised Anomalycited by 10
- 2025Anomagic: Crossmodal Prompt-driven Zero-shot Anomaly Generationcited by 8
- 2026ConsistentRFT: Reducing Visual Hallucinations in Flow-based Reinforcement Fine-Tuningcited by 5
- 2025Towards Fine-Grained Vision-Language Alignment for Few-Shot Anomaly Detectioncited by 3
Built on by
Not cited yet.