Knowledge-Embedded and Hypernetwork-Guided Few-Shot Substation Meter Defect Image Generation Method
On the map: Diffusion models → Flow matching, time series and science
Abstract (arXiv)
Substation meters play a critical role in monitoring and ensuring the stable operation of power grids, yet their detection of cracks and other physical defects is often hampered by a severe scarcity of annotated samples. To address this few-shot generation challenge, we propose a novel framework that integrates Knowledge Embedding and Hypernetwork-Guided Conditional Control into a Stable Diffusion pipeline, enabling realistic and controllable synthesis of defect images from limited data. First, we bridge the substantial domain gap between natural-image pre-trained models and industrial equipment by fine-tuning a Stable Diffusion backbone using DreamBooth-style knowledge embedding. This process encodes the unique structural and textural priors of substation meters, ensuring generated images retain authentic meter characteristics. Second, we introduce a geometric crack modeling module that parameterizes defect attributes--such as location, length, curvature, and branching pattern--to produce spatially constrained control maps. These maps provide precise, pixel-level guidance during generation. Third, we design a lightweight hypernetwork that dynamically modulates the denoising process of the diffusion model in response to the control maps and high-level defect descriptors, achieving a flexible balance between generation fidelity and controllability. Extensive experiments on a real-world substation meter dataset demonstrate that our method substantially outperforms existing augmentation and generation baselines. It reduces Frechet Inception Distance (FID) by 32.7%, increases diversity metrics, and--most importantly--boosts the mAP of a downstream defect detector by 15.3% when trained on augmented data. The framework offers a practical, high-quality data synthesis solution for industrial inspection systems where defect samples are rare.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Flow matching, time series and science, one of 14 directions in Diffusion models. Builds on 56 of its 80 references that are in the map. First posted on arXiv 14 Jan 2026.
Builds on
56 of 80 references.
References · 56
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2023GPT-4 Technical Reportcited by 18,396
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
- 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,852
- 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,212
- 2024From Local to Global: A Graph RAG Approach to Query-Focused Summarizationcited by 1,453
- 2023LongLLMLingua: Accelerating and Enhancing LLMs in Long Context Scenarios via Prompt Compressioncited by 453
- 2023Is ChatGPT a Good NLG Evaluator? A Preliminary Studycited by 422
- 2023Ragas: Automated Evaluation of Retrieval Augmented Generationcited by 418
38 more
- 2025Seed1.5-VL Technical Reportcited by 373
- 2024LightRAG: Simple and Fast Retrieval-Augmented Generationcited by 315
- 2024Long-context LLMs Struggle with Long In-context Learningcited by 286
- 2023Blind Image Quality Assessment via Vision-Language Correspondence: A Multitask Learning Perspectivecited by 280
- 2024Self-Preference Bias in LLM-as-a-Judgecited by 258
- 2024OCRBench v2: An Improved Benchmark for Evaluating Large Multimodal Models on Visual Text Localization and Reasoningcited by 173
- 2023DocPedia: Unleashing the Power of Large Multimodal Model in the Frequency Domain for Versatile Document Understandingcited by 106
- 2024MTVQA: Benchmarking Multilingual Text-Centric Visual Question Answeringcited by 93
- 2024Medical Graph RAG: Towards Safe Medical Large Language Model via Graph Retrieval-Augmented Generationcited by 90
- 2024Enhancing Code LLMs with Reinforcement Learning in Code Generation: A Surveycited by 83
- 2025Dolphin: Document Image Parsing via Heterogeneous Anchor Promptingcited by 79
- 2023UniDoc: A Universal Large Multimodal Model for Simultaneous Text Detection, Recognition, Spotting and Understandingcited by 74
- 2024Late Chunking: Contextual Chunk Embeddings Using Long-Context Embedding Modelscited by 73
- 2024TabPedia: Towards Comprehensive Visual Table Understanding with Concept Synergycited by 71
- 2023SPTS v2: Single-Point Scene Text Spottingcited by 66
- 2022Few Could Be Better Than All: Feature Sampling and Grouping for Scene Text Detectioncited by 65
- 2024Attentive Eraser: Unleashing Diffusion Model's Object Removal Potential via Self-Attention Redirection Guidancecited by 63
- 2024TextSquare: Scaling up Text-Centric Visual Instruction Tuningcited by 62
- 2024A Bounding Box is Worth One Token: Interleaving Layout and Text in a Large Language Model for Document Understandingcited by 57
- 2024Harmonizing Visual Text Comprehension and Generationcited by 54
- 2023Multi-modal In-Context Learning Makes an Ego-evolving Scene Text Recognizercited by 53
- 2023Enhancing Knowledge Graph Construction Using Large Language Modelscited by 44
- 2024ParGo: Bridging Vision-Language with Partial and Global Viewscited by 40
- 2025Vision as LoRAcited by 37
- 2025Prolonged Reasoning Is Not All You Need: Certainty-Based Adaptive Routing for Efficient LLM/MLLM Reasoningcited by 35
- 2024Hermes 3 Technical Reportcited by 34
- 2022Optimal Boxes: Boosting End-to-End Scene Text Recognition by Adjusting Annotated Bounding Boxes via Reinforcement Learningcited by 33
- 2024MCTBench: Multimodal Cognition towards Text-Rich Visual Scenes Benchmarkcited by 26
- 2025WildDoc: How Far Are We from Achieving Comprehensive and Robust Document Understanding in the Wild?cited by 26
- 2025Advancing Sequential Numerical Prediction in Autoregressive Modelscited by 26
- 2025Evaluating Supervised Learning Models for Fraud Detection: A Comparative Study of Classical and Deep Architectures on Imbalanced Transaction Datacited by 20
- 2025SETransformer: A Hybrid Attention-Based Architecture for Robust Human Activity Recognitioncited by 19
- 2025Benchmarking Vision-Language Models on Chinese Ancient Documents: From OCR to Knowledge Reasoningcited by 19
- 2025CME-CAD: Heterogeneous Collaborative Multi-Expert Reinforcement Learning for CAD Code Generationcited by 19
- 2024Fine-Tuning Vision-Language Model for Automated Engineering Drawing Information Extractioncited by 18
- 2025Resolving Evidence Sparsity: Agentic Context Engineering for Long-Document Understandingcited by 18
- 2023Real-Time Idling Vehicles Detection using Combined Audio-Visual Deep Learningcited by 17
- 2023Translation and Fusion Improves Zero-shot Cross-lingual Information Extractioncited by 15
50 most cited of 56 All 56 (JSON)
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024Controllable Image Synthesis of Industrial Data Using Stable Diffusion
- 2025Photovoltaic Defect Image Generator with Boundary Alignment Smoothing Constraint for Domain Shift Mitigation
- 2026Synthetic Defect Image Generation for Power Line Insulator Inspection Using Multimodal Large Language Models
- 2024Defect Image Sample Generation With Diffusion Prior for Steel Surface Defect Recognition
- 2026Industrial Surface Defect Detection via Diffusion Generation and Asymmetric Student-Teacher Network
- 2025Bounding Box-Guided Diffusion for Synthesizing Industrial Images and Segmentation Map
- 2026CrackSegFlow: Controllable Flow Matching Synthesis for Generalizable Crack Segmentation with a 50K Image-Mask Benchmark
- 2024Leveraging Latent Diffusion Models for Training-Free In-Distribution Data Augmentation for Surface Defect Detection