mlsanityData to 14 Oct 2026

SubstationAI: Multimodal Large Model-Based Approaches for Analyzing Substation Equipment Faults

arXiv 2412.17077 ↗First posted 22 Dec 2024cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

The reliability of substation equipment is crucial to the stability of power systems, but traditional fault analysis methods heavily rely on manual expertise, limiting their effectiveness in handling complex and large-scale data. This paper proposes a substation equipment fault analysis method based on a multimodal large language model (MLLM). We developed a database containing 40,000 entries, including images, defect labels, and analysis reports, and used an image-to-video generation model for data augmentation. Detailed fault analysis reports were generated using GPT-4. Based on this database, we developed SubstationAI, the first model dedicated to substation fault analysis, and designed a fault diagnosis knowledge base along with knowledge enhancement methods. Experimental results show that SubstationAI significantly outperforms existing models, such as GPT-4, across various evaluation metrics, demonstrating higher accuracy and practicality in fault cause analysis, repair suggestions, and preventive measures, providing a more advanced solution for substation equipment fault analysis.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 24 of its 35 references that are in the map. First posted on arXiv 22 Dec 2024.

Builds on

24 of 35 references.

References · 24

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2023Visual Instruction Tuningcited by 7,869
  4. 2023Improved Baselines with Visual Instruction Tuningcited by 4,418
  5. 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,322
  6. 2021Zero-Shot Text-to-Image Generationcited by 4,288
  7. 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
  8. 2022Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedbackcited by 3,720
  9. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,614
  10. 2023MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Modelscited by 2,711
  11. 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,224
  12. 2019Fine-Tuning Language Models from Human Preferencescited by 2,150
12 more
  1. 2019LXMERT: Learning Cross-Modality Encoder Representations from Transformerscited by 1,553
  2. 2022CoCa: Contrastive Captioners are Image-Text Foundation Modelscited by 1,274
  3. 2021A General Language Assistant as a Laboratory for Alignmentcited by 1,055
  4. 2023MiniGPT-v2: large language model as a unified interface for vision-language multi-task learningcited by 625
  5. 2022Transformers in Time Series: A Surveycited by 497
  6. 2021VATT: Transformers for Multimodal Self-Supervised Learning from Raw Video, Audio and Textcited by 429
  7. 2021MERLOT: Multimodal Neural Script Knowledge Modelscited by 311
  8. 2023HuatuoGPT, towards Taming Language Model to Be a Doctorcited by 214
  9. 2020ERNIE-ViL: Knowledge Enhanced Vision-Language Representations Through Scene Graphcited by 211
  10. 2024EasyAnimate: High-Performance Video Generation Framework with Hybrid Windows Attention and Reward Backpropagationcited by 77
  11. 2024Zero-Shot Visual Reasoning by Vision-Language Models: Benchmarking and Analysiscited by 15
  12. 2023Dynamic Fault Analysis in Substations Based on Knowledge Graphscited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024Fault Diagnosis in Power Grids with Large Language Model
  2. 2026Lightweight Multimodal LLM-Enabled Cost-Effective Defect Grading of Power Transmission Equipment
  3. 2025LLM-YOLOMS: Large Language Model-based Semantic Interpretation and Fault Diagnosis for Wind Turbine Components
  4. 2025Intelligent Power Grid Design Review via Active Perception-Enabled Multimodal Large Language Models
  5. 2024MMAD: A Comprehensive Benchmark for Multimodal Large Language Models in Industrial Anomaly Detection
  6. 2026Multi-Modal Agents for Power Distribution Defect Detection: An Evaluation of Foundation Models
  7. 2026Knowledge-Embedded and Hypernetwork-Guided Few-Shot Substation Meter Defect Image Generation Method
  8. 2025Physics-Informed Machine Learning for Transformer Condition Monitoring -- Part I: Basic Concepts, Neural Networks, and Variants