mlsanityData to 14 Oct 2026

Knowledge-Embedded and Hypernetwork-Guided Few-Shot Substation Meter Defect Image Generation Method

arXiv 2601.09238 ↗First posted 14 Jan 2026cs.CVcited by 0

On the map: Diffusion models → Flow matching, time series and science

Abstract (arXiv)

Substation meters play a critical role in monitoring and ensuring the stable operation of power grids, yet their detection of cracks and other physical defects is often hampered by a severe scarcity of annotated samples. To address this few-shot generation challenge, we propose a novel framework that integrates Knowledge Embedding and Hypernetwork-Guided Conditional Control into a Stable Diffusion pipeline, enabling realistic and controllable synthesis of defect images from limited data. First, we bridge the substantial domain gap between natural-image pre-trained models and industrial equipment by fine-tuning a Stable Diffusion backbone using DreamBooth-style knowledge embedding. This process encodes the unique structural and textural priors of substation meters, ensuring generated images retain authentic meter characteristics. Second, we introduce a geometric crack modeling module that parameterizes defect attributes--such as location, length, curvature, and branching pattern--to produce spatially constrained control maps. These maps provide precise, pixel-level guidance during generation. Third, we design a lightweight hypernetwork that dynamically modulates the denoising process of the diffusion model in response to the control maps and high-level defect descriptors, achieving a flexible balance between generation fidelity and controllability. Extensive experiments on a real-world substation meter dataset demonstrate that our method substantially outperforms existing augmentation and generation baselines. It reduces Frechet Inception Distance (FID) by 32.7%, increases diversity metrics, and--most importantly--boosts the mAP of a downstream defect detector by 15.3% when trained on augmented data. The framework offers a practical, high-quality data synthesis solution for industrial inspection systems where defect samples are rare.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Flow matching, time series and science, one of 14 directions in Diffusion models. Builds on 56 of its 80 references that are in the map. First posted on arXiv 14 Jan 2026.

Builds on

56 of 80 references.

References · 56

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2023GPT-4 Technical Reportcited by 18,396
  4. 2024The Llama 3 Herd of Modelscited by 14,715
  5. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  6. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
  7. 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,852
  8. 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,212
  9. 2024From Local to Global: A Graph RAG Approach to Query-Focused Summarizationcited by 1,453
  10. 2023LongLLMLingua: Accelerating and Enhancing LLMs in Long Context Scenarios via Prompt Compressioncited by 453
  11. 2023Is ChatGPT a Good NLG Evaluator? A Preliminary Studycited by 422
  12. 2023Ragas: Automated Evaluation of Retrieval Augmented Generationcited by 418
38 more
  1. 2025Seed1.5-VL Technical Reportcited by 373
  2. 2024LightRAG: Simple and Fast Retrieval-Augmented Generationcited by 315
  3. 2024Long-context LLMs Struggle with Long In-context Learningcited by 286
  4. 2023Blind Image Quality Assessment via Vision-Language Correspondence: A Multitask Learning Perspectivecited by 280
  5. 2024Self-Preference Bias in LLM-as-a-Judgecited by 258
  6. 2024OCRBench v2: An Improved Benchmark for Evaluating Large Multimodal Models on Visual Text Localization and Reasoningcited by 173
  7. 2023DocPedia: Unleashing the Power of Large Multimodal Model in the Frequency Domain for Versatile Document Understandingcited by 106
  8. 2024MTVQA: Benchmarking Multilingual Text-Centric Visual Question Answeringcited by 93
  9. 2024Medical Graph RAG: Towards Safe Medical Large Language Model via Graph Retrieval-Augmented Generationcited by 90
  10. 2024Enhancing Code LLMs with Reinforcement Learning in Code Generation: A Surveycited by 83
  11. 2025Dolphin: Document Image Parsing via Heterogeneous Anchor Promptingcited by 79
  12. 2023UniDoc: A Universal Large Multimodal Model for Simultaneous Text Detection, Recognition, Spotting and Understandingcited by 74
  13. 2024Late Chunking: Contextual Chunk Embeddings Using Long-Context Embedding Modelscited by 73
  14. 2024TabPedia: Towards Comprehensive Visual Table Understanding with Concept Synergycited by 71
  15. 2023SPTS v2: Single-Point Scene Text Spottingcited by 66
  16. 2022Few Could Be Better Than All: Feature Sampling and Grouping for Scene Text Detectioncited by 65
  17. 2024Attentive Eraser: Unleashing Diffusion Model's Object Removal Potential via Self-Attention Redirection Guidancecited by 63
  18. 2024TextSquare: Scaling up Text-Centric Visual Instruction Tuningcited by 62
  19. 2024A Bounding Box is Worth One Token: Interleaving Layout and Text in a Large Language Model for Document Understandingcited by 57
  20. 2024Harmonizing Visual Text Comprehension and Generationcited by 54
  21. 2023Multi-modal In-Context Learning Makes an Ego-evolving Scene Text Recognizercited by 53
  22. 2023Enhancing Knowledge Graph Construction Using Large Language Modelscited by 44
  23. 2024ParGo: Bridging Vision-Language with Partial and Global Viewscited by 40
  24. 2025Vision as LoRAcited by 37
  25. 2025Prolonged Reasoning Is Not All You Need: Certainty-Based Adaptive Routing for Efficient LLM/MLLM Reasoningcited by 35
  26. 2024Hermes 3 Technical Reportcited by 34
  27. 2022Optimal Boxes: Boosting End-to-End Scene Text Recognition by Adjusting Annotated Bounding Boxes via Reinforcement Learningcited by 33
  28. 2024MCTBench: Multimodal Cognition towards Text-Rich Visual Scenes Benchmarkcited by 26
  29. 2025WildDoc: How Far Are We from Achieving Comprehensive and Robust Document Understanding in the Wild?cited by 26
  30. 2025Advancing Sequential Numerical Prediction in Autoregressive Modelscited by 26
  31. 2025Evaluating Supervised Learning Models for Fraud Detection: A Comparative Study of Classical and Deep Architectures on Imbalanced Transaction Datacited by 20
  32. 2025SETransformer: A Hybrid Attention-Based Architecture for Robust Human Activity Recognitioncited by 19
  33. 2025Benchmarking Vision-Language Models on Chinese Ancient Documents: From OCR to Knowledge Reasoningcited by 19
  34. 2025CME-CAD: Heterogeneous Collaborative Multi-Expert Reinforcement Learning for CAD Code Generationcited by 19
  35. 2024Fine-Tuning Vision-Language Model for Automated Engineering Drawing Information Extractioncited by 18
  36. 2025Resolving Evidence Sparsity: Agentic Context Engineering for Long-Document Understandingcited by 18
  37. 2023Real-Time Idling Vehicles Detection using Combined Audio-Visual Deep Learningcited by 17
  38. 2023Translation and Fusion Improves Zero-shot Cross-lingual Information Extractioncited by 15

50 most cited of 56 All 56 (JSON)

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024Controllable Image Synthesis of Industrial Data Using Stable Diffusion
  2. 2025Photovoltaic Defect Image Generator with Boundary Alignment Smoothing Constraint for Domain Shift Mitigation
  3. 2026Synthetic Defect Image Generation for Power Line Insulator Inspection Using Multimodal Large Language Models
  4. 2024Defect Image Sample Generation With Diffusion Prior for Steel Surface Defect Recognition
  5. 2026Industrial Surface Defect Detection via Diffusion Generation and Asymmetric Student-Teacher Network
  6. 2025Bounding Box-Guided Diffusion for Synthesizing Industrial Images and Segmentation Map
  7. 2026CrackSegFlow: Controllable Flow Matching Synthesis for Generalizable Crack Segmentation with a 50K Image-Mask Benchmark
  8. 2024Leveraging Latent Diffusion Models for Training-Free In-Distribution Data Augmentation for Surface Defect Detection