mlsanityData to 7 Oct 2026

Synthetic Defect Image Generation for Power Line Insulator Inspection Using Multimodal Large Language Models

arXiv 2603.08069 ↗First posted 9 Mar 2026cs.CVcited by 0

On the map: Multimodal LLMs / vision-language models → Chart understanding and anomaly detection

Abstract (arXiv)

Utility companies increasingly rely on drone imagery for post-event and routine inspection, but training accurate defect-type classifiers remains difficult because defect examples are rare and inspection datasets are often limited or proprietary. We address this data-scarcity setting by using an off-the-shelf multimodal large language model (MLLM) as a training-free image generator to synthesize defect images from visual references and text prompts. Our pipeline increases diversity via dual-reference conditioning, improves label fidelity with lightweight human verification and prompt refinement, and filters the resulting synthetic pool using an embedding-based selection rule based on distances to class centroids computed from the real training split. We evaluate on ceramic insulator defect-type classification (shell vs. glaze) using a public dataset with a realistic low training-data regime (104 real training images; 152 validation; 308 test). Augmenting the 10% real training set with embedding-selected synthetic images improves test F1 score (harmonic mean of precision and recall) from 0.615 to 0.739 (20% relative), corresponding to an estimated 4--5x data-efficiency gain, and the gains persist with stronger backbone models and frozen-feature linear-probe baselines. These results suggest a practical, low-barrier path for improving defect recognition when collecting additional real defects is slow or infeasible.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Chart understanding and anomaly detection, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 13 of its 20 references that are in the map. First posted on arXiv 9 Mar 2026.

Builds on

13 of 20 references.

Closest ancestors · 1

Same direction, newest first

  1. 2023AnomalyGPT: Detecting Industrial Anomalies Using Large Vision-Language Models29 Aug

Other references · 12

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  4. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  5. 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,829
  6. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
  7. 2019RandAugment: Practical automated data augmentation with a reduced search spacecited by 2,261
  8. 2023AnomalyCLIP: Object-agnostic Prompt Learning for Zero-shot Anomaly Detectioncited by 270
  9. 2021Defect-GAN: High-Fidelity Defect Synthesis for Automated Defect Inspectioncited by 77
  10. 2023Industrial Anomaly Detection with Domain Shift: A Real-world Dataset and Masked Multi-scale Reconstructioncited by 22
  11. 2023InsPLAD: A Dataset and Benchmark for Power Line Asset Inspection in UAV Imagescited by 15
  12. 2025Improved YOLOv12 with LLM-Generated Synthetic Data for Enhanced Apple Detection and Benchmarking Against YOLOv11 and YOLOv10cited by 3

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Towards Open-Vocabulary Industrial Defect Understanding with a Large-Scale Multimodal Dataset
  2. 2026Unification of Closed-Open Industrial Detection Scenarios: New Large-Scale Benchmarks,Challenges and Baselines
  3. 2026A Hybrid Vision-Language Architecture for Automated Defect Reasoning and Report Generation in Industrial Inspection
  4. 2026Beyond Balanced Accuracy: A Resolution and Parity-Controlled Benchmark for Vision-Language and Vision-Only Defect Assessment in UAV Power-Line Inspection
  5. 2026GenAU: Language-Grounded Industrial Anomaly Understanding with Vision-Language Models
  6. 2025Anomaly Detection by Effectively Leveraging Synthetic Images
  7. 2024Controllable Image Synthesis of Industrial Data Using Stable Diffusion
  8. 2026SteelDefectX: A Multi-Form Vision-Language Dataset and Benchmark for Steel Surface Defect Analysis