Synthetic Defect Image Generation for Power Line Insulator Inspection Using Multimodal Large Language Models
On the map: Multimodal LLMs / vision-language models → Chart understanding and anomaly detection
Abstract (arXiv)
Utility companies increasingly rely on drone imagery for post-event and routine inspection, but training accurate defect-type classifiers remains difficult because defect examples are rare and inspection datasets are often limited or proprietary. We address this data-scarcity setting by using an off-the-shelf multimodal large language model (MLLM) as a training-free image generator to synthesize defect images from visual references and text prompts. Our pipeline increases diversity via dual-reference conditioning, improves label fidelity with lightweight human verification and prompt refinement, and filters the resulting synthetic pool using an embedding-based selection rule based on distances to class centroids computed from the real training split. We evaluate on ceramic insulator defect-type classification (shell vs. glaze) using a public dataset with a realistic low training-data regime (104 real training images; 152 validation; 308 test). Augmenting the 10% real training set with embedding-selected synthetic images improves test F1 score (harmonic mean of precision and recall) from 0.615 to 0.739 (20% relative), corresponding to an estimated 4--5x data-efficiency gain, and the gains persist with stronger backbone models and frozen-feature linear-probe baselines. These results suggest a practical, low-barrier path for improving defect recognition when collecting additional real defects is slow or infeasible.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Chart understanding and anomaly detection, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 13 of its 20 references that are in the map. First posted on arXiv 9 Mar 2026.
Builds on
13 of 20 references.
Closest ancestors · 1
Same direction, newest first
Other references · 12
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,829
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
- 2019RandAugment: Practical automated data augmentation with a reduced search spacecited by 2,261
- 2023AnomalyCLIP: Object-agnostic Prompt Learning for Zero-shot Anomaly Detectioncited by 270
- 2021Defect-GAN: High-Fidelity Defect Synthesis for Automated Defect Inspectioncited by 77
- 2023Industrial Anomaly Detection with Domain Shift: A Real-world Dataset and Masked Multi-scale Reconstructioncited by 22
- 2023InsPLAD: A Dataset and Benchmark for Power Line Asset Inspection in UAV Imagescited by 15
- 2025Improved YOLOv12 with LLM-Generated Synthetic Data for Enhanced Apple Detection and Benchmarking Against YOLOv11 and YOLOv10cited by 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Towards Open-Vocabulary Industrial Defect Understanding with a Large-Scale Multimodal Dataset
- 2026Unification of Closed-Open Industrial Detection Scenarios: New Large-Scale Benchmarks,Challenges and Baselines
- 2026A Hybrid Vision-Language Architecture for Automated Defect Reasoning and Report Generation in Industrial Inspection
- 2026Beyond Balanced Accuracy: A Resolution and Parity-Controlled Benchmark for Vision-Language and Vision-Only Defect Assessment in UAV Power-Line Inspection
- 2026GenAU: Language-Grounded Industrial Anomaly Understanding with Vision-Language Models
- 2025Anomaly Detection by Effectively Leveraging Synthetic Images
- 2024Controllable Image Synthesis of Industrial Data Using Stable Diffusion
- 2026SteelDefectX: A Multi-Form Vision-Language Dataset and Benchmark for Steel Surface Defect Analysis