mlsanityData to 14 Oct 2026

Transmission Line Defect Detection Based on UAV Patrol Images and Vision-language Pretraining

arXiv 2411.11370 ↗First posted 18 Nov 2024cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Unmanned aerial vehicle (UAV) patrol inspection has emerged as a predominant approach in transmission line monitoring owing to its cost-effectiveness. Detecting defects in transmission lines is a critical task during UAV patrol inspection. However, due to imaging distance and shooting angles, UAV patrol images often suffer from insufficient defect-related visual information, which has an adverse effect on detection accuracy. In this article, we propose a novel method for detecting defects in UAV patrol images, which is based on vision-language pretraining for transmission line (VLP-TL) and a progressive transfer strategy (PTS). Specifically, VLP-TL contains two novel pretraining tasks tailored for the transmission line scenario, aimimg at pretraining an image encoder with abundant knowledge acquired from both visual and linguistic information. Transferring the pretrained image encoder to the defect detector as its backbone can effectively alleviate the insufficient visual information problem. In addition, the PTS further improves transfer performance by progressively bridging the gap between pretraining and downstream defection detection. Experimental results demonstrate that the proposed method significantly improves defect detection accuracy by jointly utilizing multimodal information, overcoming the limitations of insufficient defect-related visual information provided by UAV patrol images.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 26 of its 54 references that are in the map. First posted on arXiv 18 Nov 2024.

Builds on

26 of 54 references.

References · 26

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,639
  3. 2020End-to-End Object Detection with Transformerscited by 7,414
  4. 2021Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervisioncited by 3,864
  5. 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,422
  6. 2021Learning to Prompt for Vision-Language Modelscited by 2,281
  7. 2021CLIP-Adapter: Better Vision-Language Models with Feature Adapterscited by 1,026
  8. 2023Vision-Language Models for Vision Tasks: A Surveycited by 839
  9. 2022Exploring Plain Vision Transformer Backbones for Object Detectioncited by 724
  10. 2022MedCLIP: Contrastive Learning from Unpaired Medical Images and Textcited by 570
  11. 2019Cascade R-CNN: High Quality Object Detection and Instance Segmentationcited by 429
  12. 2021Conditional DETR for Fast Training Convergencecited by 424
14 more
  1. 2023WinCLIP: Zero-/Few-Shot Anomaly Classification and Segmentationcited by 315
  2. 2023Improving CLIP Training with Language Rewritescited by 217
  3. 2022RTMDet: An Empirical Study of Designing Real-Time Object Detectorscited by 195
  4. 2022Unified Contrastive Learning in Image-Text-Label Spacecited by 194
  5. 2022Finetune like you pretrain: Improved finetuning of zero-shot vision modelscited by 150
  6. 2023CORA: Adapting CLIP for Open-Vocabulary Detection with Region Prompting and Anchor Pre-Matchingcited by 133
  7. 2021Towards artificial general intelligence via a multimodal foundation modelcited by 112
  8. 2022Chinese CLIP: Contrastive Vision-Language Pretraining in Chinesecited by 109
  9. 2023Multimodality Helps Unimodality: Cross-Modal Few-Shot Learning with Multimodal Modelscited by 91
  10. 2024Toward Generalist Anomaly Detection via In-context Residual Learning with Few-shot Sample Promptscited by 89
  11. 2023GraphAdapter: Tuning Vision-Language Models With Dual Knowledge Graphcited by 69
  12. 2022LASP: Text-to-Text Optimization for Language-Aware Soft Prompting of Vision & Language Modelscited by 59
  13. 2022FashionViL: Fashion-Focused Vision-and-Language Representation Learningcited by 32
  14. 2023S-CLIP: Semi-supervised Vision-Language Learning using Few Specialist Captionscited by 30

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Beyond Balanced Accuracy: A Resolution and Parity-Controlled Benchmark for Vision-Language and Vision-Only Defect Assessment in UAV Power-Line Inspection
  2. 2026A novel YOLO26-MoE optimized by an LLM agent for insulator fault detection considering UAV images
  3. 2026Synthetic Defect Image Generation for Power Line Insulator Inspection Using Multimodal Large Language Models
  4. 2026Bridge Damage Detection from Low-Light UAV Imagery via Degradation-Aware Mixture-of-Experts Enhancement
  5. 2022Comprehensive Analysis of the Object Detection Pipeline on UAVs
  6. 2026Visual Prototype Conditioned Focal Region Generation for UAV-Based Object Detection
  7. 2026Edge-Optimized Vision-Language Models for Underground Infrastructure Assessment
  8. 2025InfraGPT Smart Infrastructure: An End-to-End VLM-Based Framework for Detecting and Managing Urban Defects