mlsanityData to 14 Oct 2026

Benchmarking Vision Transformers and CNNs for Thermal Photovoltaic Fault Detection with Explainable AI Validation

arXiv 2509.07039 ↗First posted 8 Sep 2025cs.LG cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

Artificial intelligence deployment for automated photovoltaic (PV) monitoring faces interpretability barriers that limit adoption in energy infrastructure applications. While deep learning achieves high accuracy in thermal fault detection, validation that model decisions align with thermal physics principles remains lacking, creating deployment hesitancy where understanding model reasoning is critical. This study provides a systematic comparison of convolutional neural networks (ResNet-18, EfficientNet-B0) and vision transformers (ViT-Tiny, Swin-Tiny) for thermal PV fault detection, using XRAI saliency analysis to assess alignment with thermal physics principles. This represents the first systematic comparison of CNNs and vision transformers for thermal PV fault detection with physics-validated interpretability. Evaluation on 20,000 infrared images spanning normal operation and 11 fault categories shows that Swin Transformer achieves the highest performance (94% binary accuracy; 73% multiclass accuracy) compared to CNN approaches. XRAI analysis reveals that models learn physically meaningful features, such as localized hotspots for cell defects, linear thermal paths for diode failures, and thermal boundaries for vegetation shading, consistent with expected thermal signatures. However, performance varies significantly across fault types: electrical faults achieve strong detection (F1-scores >0.90) while environmental factors like soiling remain challenging (F1-scores 0.20-0.33), indicating limitations imposed by thermal imaging resolution. The thermal physics-guided interpretability approach provides methodology for validating AI decision-making in energy monitoring applications, addressing deployment barriers in renewable energy infrastructure.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 6 of its 20 references that are in the map. First posted on arXiv 8 Sep 2025.

Builds on

6 of 20 references.

References · 6

  1. 2021Trustworthy AI: From Principles to Practicescited by 207
  2. 2023A Survey on Trustworthy Edge Intelligence: From Security and Reliability To Transparency and Sustainabilitycited by 7
  3. 2024False Sense of Security in Explainable Artificial Intelligence (XAI)cited by 4
  4. 2021Anomaly Detection in IR Images of PV Modules using Supervised Contrastive Learningcited by 3
  5. 2024Trustworthy artificial intelligence in the energy sector: Landscape analysis and evaluation frameworkcited by 2
  6. 2025HOTSPOT-YOLO: A Lightweight Deep Learning Attention-Driven Model for Detecting Thermal Anomalies in Drone-Based Solar Photovoltaic Inspectionscited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.