mlsanityData to 14 Oct 2026

Empowering ChatGPT-Like Large-Scale Language Models with Local Knowledge Base for Industrial Prognostics and Health Management

arXiv 2312.14945 ↗First posted 6 Dec 2023cs.IR cs.AI cs.CLcited by 1

Not on the map. Why?

Abstract (arXiv)

Prognostics and health management (PHM) is essential for industrial operation and maintenance, focusing on predicting, diagnosing, and managing the health status of industrial systems. The emergence of the ChatGPT-Like large-scale language model (LLM) has begun to lead a new round of innovation in the AI field. It has extensively promoted the level of intelligence in various fields. Therefore, it is also expected further to change the application paradigm in industrial PHM and promote PHM to become intelligent. Although ChatGPT-Like LLMs have rich knowledge reserves and powerful language understanding and generation capabilities, they lack domain-specific expertise, significantly limiting their practicability in PHM applications. To this end, this study explores the ChatGPT-Like LLM empowered by the local knowledge base (LKB) in industrial PHM to solve the above limitations. In addition, we introduce the method and steps of combining the LKB with LLMs, including LKB preparation, LKB vectorization, prompt engineering, etc. Experimental analysis of real cases shows that combining the LKB with ChatGPT-Like LLM can significantly improve its performance and make ChatGPT-Like LLMs more accurate, relevant, and able to provide more insightful information. This can promote the development of ChatGPT-Like LLMs in industrial PHM and promote their efficiency and quality.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 18 of its 44 references that are in the map. First posted on arXiv 6 Dec 2023.

Builds on

18 of 44 references.

References · 18

  1. 2017Attention Is All You Needcited by 60,361
  2. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  3. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  4. 2023GPT-4 Technical Reportcited by 18,396
  5. 2022Training language models to follow instructions with human feedbackcited by 15,971
  6. 2023A Survey of Large Language Modelscited by 2,576
  7. 2017Billion-scale similarity search with GPUscited by 2,497
  8. 2021GLM: General Language Model Pretraining with Autoregressive Blank Infillingcited by 1,031
  9. 2022GLM-130B: An Open Bilingual Pre-trained Modelcited by 843
  10. 2023Vision-Language Models for Vision Tasks: A Surveycited by 839
  11. 2019Self-supervised Visual Feature Learning with Deep Neural Networks: A Surveycited by 657
  12. 2021A Survey of Transformerscited by 401
6 more
  1. 2023A Comprehensive Survey on Pretrained Foundation Models: A History from BERT to ChatGPTcited by 368
  2. 2021ERNIE 3.0: Large-scale Knowledge Enhanced Pre-training for Language Understanding and Generationcited by 260
  3. 2019ERNIE 2.0: A Continual Pre-training Framework for Language Understandingcited by 231
  4. 2023A Comprehensive Survey of AI-Generated Content (AIGC): A History of Generative AI from GAN to ChatGPTcited by 224
  5. 2020A Survey on Contextual Embeddingscited by 48
  6. 2023ChatGPT-Like Large-Scale Foundation Models for Prognostics and Health Management: A Survey and Roadmapscited by 8

Built on by

Cited by year

Citing papers per year: 2024: 1.

1 paper.