mlsanityData to 7 Oct 2026

LLM-R: A Framework for Domain-Adaptive Maintenance Scheme Generation Combining Hierarchical Agents and RAG

arXiv 2411.04476 ↗First posted 7 Nov 2024cs.LGcited by 1

On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks

Abstract (arXiv)

The increasing use of smart devices has emphasized the critical role of maintenance in production activities. Interactive Electronic Technical Manuals (IETMs) are vital tools that support the maintenance of smart equipment. However, traditional IETMs face challenges such as transitioning from Graphical User Interfaces (GUIs) to natural Language User Interfaces (LUIs) and managing complex logical relationships. Additionally, they must meet the current demands for higher intelligence. This paper proposes a Maintenance Scheme Generation Method based on Large Language Models (LLM-R). The proposed method includes several key innovations: We propose the Low Rank Adaptation-Knowledge Retention (LORA-KR) loss technology to proportionally adjust mixed maintenance data for fine-tuning the LLM. This method prevents knowledge conflicts caused by mixed data, improving the model's adaptability and reasoning ability in specific maintenance domains, Besides, Hierarchical Task-Based Agent and Instruction-level Retrieval-Augmented Generation (RAG) technologies are adopted to optimize the generation steps and mitigate the phenomenon of hallucination caused by the model's Inability to access contextual information. This enhancement improves the model's flexibility and accuracy in handling known or unknown maintenance objects and maintenance scheme scenarios. To validate the proposed method's effectiveness in maintenance tasks, a maintenance scheme dataset was constructed using objects from different fields. The experimental results show that the accuracy of the maintenance schemes generated by the proposed method reached 91.59%, indicating which improvement enhances the intelligence of maintenance schemes and introduces novel technical approaches for equipment maintenance.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 33 of its 49 references that are in the map. First posted on arXiv 7 Nov 2024.

Builds on

33 of 49 references.

Closest ancestors · 5

Same direction, newest first

  1. 2024TRAD: Enhancing LLM Agents with Step-Wise Thought Retrieval and Aligned Decision10 Mar
  2. 2023A Dynamic LLM-Powered Agent Network for Task-Oriented Agent Collaboration3 Oct
  3. 2023SMART-LLM: Smart Multi-Agent Robot Task Planning using Large Language Models18 Sep
  4. 2023A Survey on Large Language Model based Autonomous Agents22 Aug
  5. 2023Multi-Agent Collaboration: Harnessing the Power of Intelligent LLM Agents5 Jun

Other references · 28

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2022Training language models to follow instructions with human feedbackcited by 15,712
  3. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  4. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
  5. 2023Qwen Technical Reportcited by 3,273
  6. 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,185
  7. 2024ChatGLM: A Family of Large Language Models from GLM-130B to GLM-4 All Toolscited by 1,096
  8. 2022GLM-130B: An Open Bilingual Pre-trained Modelcited by 837
  9. 2023SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Modelscited by 787
  10. 2023Baichuan 2: Open Large-scale Language Modelscited by 664
  11. 2024Parameter-Efficient Fine-Tuning for Large Models: A Comprehensive Surveycited by 641
  12. 2023A Stitch in Time Saves Nine: Detecting and Mitigating Hallucinations of LLMs by Validating Low-Confidence Generationcited by 202
16 more
  1. 2022Factuality Enhanced Language Models for Open-Ended Text Generationcited by 200
  2. 2024Data Mixing Laws: Optimizing Data Mixtures by Predicting Language Modeling Performancecited by 179
  3. 2023Large Language Models for Robotics: A Surveycited by 132
  4. 2024RAP: Retrieval-Augmented Planning with Contextual Memory for Multimodal LLM Agentscited by 80
  5. 2018On the Impact of Various Types of Noise on Neural Machine Translationcited by 76
  6. 2024Enhancing LLM Factual Accuracy with RAG to Counter Hallucinations: A Case Study on Domain-Specific Queries in Private Knowledge-Basescited by 76
  7. 2021AutoMix: Unveiling the Power of Mixup for Stronger Classifierscited by 69
  8. 2020ResizeMix: Mixing Data with Preserved Object Information and True Labelscited by 68
  9. 2023A Study on the Implementation of Generative AI Services Using an Enterprise Data-Based LLM Application Architecturecited by 28
  10. 2021Survey: Image Mixing and Deleting for Data Augmentationcited by 25
  11. 2023ChatHome: Development and Evaluation of a Domain-Specific Language Model for Home Renovationcited by 25
  12. 2024T-RAG: Lessons from the LLM Trenchescited by 23
  13. 2021Retrieval Enhanced Model for Commonsense Generationcited by 18
  14. 2023Enhancing LLM Intelligence with ARM-RAG: Auxiliary Rationale Memory for Retrieval Augmented Generationcited by 14
  15. 2022RandoMix: A mixed sample data augmentation method with multiple mixed modescited by 8
  16. 2023Enhancing Quantitative Reasoning Skills of Large Language Models through Dimension Perceptioncited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025Cross-Format Retrieval-Augmented Generation in XR with LLMs for Context-Aware Maintenance Assistance
  2. 2025Cleaning Maintenance Logs with LLM Agents for Improved Predictive Maintenance
  3. 2025Agent-based Condition Monitoring Assistance with Multimodal Industrial Database Retrieval Augmented Generation
  4. 2025CAMB: A comprehensive industrial LLM benchmark on civil aviation maintenance
  5. 2025Prescriptive Agents based on RAG for Automated Maintenance (PARAM)
  6. 2026FactoryLLM: A Safe and Open-Source AI Playground for Evaluating LLMs in Smart Factories
  7. 2024Knowledge Management for Automobile Failure Analysis Using Graph RAG
  8. 2025KEO: Knowledge Extraction on OMIn via Knowledge Graphs and RAG for Safety-Critical Aviation Maintenance