Leveraging Graph-RAG and Prompt Engineering to Enhance LLM-Based Automated Requirement Traceability and Compliance Checks
On the map: Retrieval-augmented generation → RAG pipeline design and evaluation
Abstract (arXiv)
Ensuring that Software Requirements Specifications (SRS) align with higher-level organizational or national requirements is vital, particularly in regulated environments such as finance and aerospace. In these domains, maintaining consistency, adhering to regulatory frameworks, minimizing errors, and meeting critical expectations are essential for the reliable functioning of systems. The widespread adoption of large language models (LLMs) highlights their immense potential, yet there remains considerable scope for improvement in retrieving relevant information and enhancing reasoning capabilities. This study demonstrates that integrating a robust Graph-RAG framework with advanced prompt engineering techniques, such as Chain of Thought and Tree of Thought, can significantly enhance performance. Compared to baseline RAG methods and simple prompting strategies, this approach delivers more accurate and context-aware results. While this method demonstrates significant improvements in performance, it comes with challenges. It is both costly and more complex to implement across diverse contexts, requiring careful adaptation to specific scenarios. Additionally, its effectiveness heavily relies on having complete and accurate input data, which may not always be readily available, posing further limitations to its scalability and practicality.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Placed in RAG pipeline design and evaluation, one of 15 directions in Retrieval-augmented generation. Builds on 14 of its 37 references that are in the map. First posted on arXiv 11 Dec 2024.
Builds on
14 of 37 references.
Closest ancestors · 1
Same direction, newest first
Other references · 13
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
- 2023A Survey of Large Language Modelscited by 2,537
- 2023A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questionscited by 1,582
- 2024From Local to Global: A Graph RAG Approach to Query-Focused Summarizationcited by 1,411
- 2024Graph Retrieval-Augmented Generation: A Surveycited by 320
- 2024From LLMs to LLM-based Agents for Software Engineering: A Survey of Current, Challenges and Futurecited by 85
- 2024Using LLMs in Software Requirements Specifications: An Empirical Evaluationcited by 20
- 2024Rethinking Legal Compliance Automation: Opportunities with Large Language Modelscited by 6
- 2024Towards Standards-Compliant Assistive Technology Product Specifications via LLMscited by 4
- 2024Prioritizing Software Requirements Using Large Language Modelscited by 4
Built on by
Citing papers per year: 2025: 2; 2026: 4.
6 papers.
- 2025Scaling Policy Compliance Assessment in Language Models with Policy Reasoning Tracescited by 4
- 2025Evaluating the Use of LLMs for Documentation to Code Traceabilitycited by 2
- 2026A Retrieval-Augmented Language Assistant for Unmanned Aircraft Safety Assessment and Regulatory Compliancecited by 0
- 2026Neuro-Symbolic Agents for Hallucination-Free Requirements Reusecited by 0
- 2026Model-Driven Requirements Configuration with Three-Valued Uncertainty Scoringcited by 0
- 2026A Triple-Robustness Analysis of Retrieval-Augmented Generation for Multi-Hop Requirements Traceabilitycited by 0
- 2026A Triple-Robustness Analysis of Retrieval-Augmented Generation for Multi-Hop Requirements Traceability1 Aug 2026
- 2026Model-Driven Requirements Configuration with Three-Valued Uncertainty Scoring28 Jul 2026
- 2026Neuro-Symbolic Agents for Hallucination-Free Requirements Reuse2 May 2026
- 2026A Retrieval-Augmented Language Assistant for Unmanned Aircraft Safety Assessment and Regulatory Compliance16 Feb 2026
- 2025Scaling Policy Compliance Assessment in Language Models with Policy Reasoning Traces27 Sep 2025
- 2025Evaluating the Use of LLMs for Documentation to Code Traceability19 Jun 2025
Similar, not cited
Close in wording, no citation either way
- 2025Prompt Engineering for Requirements Engineering: A Literature Review and Roadmap
- 2026BT-APE: A Computationally Light Backtracking Approach to Automatic Prompt Engineering for Requirements Classification ↗
- 2026When Generic Prompt Improvements Hurt: Evaluation-Driven Iteration for LLM Applications
- 2024Generating Test Scenarios from NL Requirements using Retrieval-Augmented LLMs: An Industrial Study
- 2025Towards Requirements Engineering for RAG Systems
- 2025TVR: Automotive System Requirement Traceability Validation and Recovery Through Retrieval-Augmented Generation
- 2025Inference-Time Intervention in Large Language Models for Reliable Requirement Verification
- 2026Evaluating LLM-Based Goal Extraction in Requirements Engineering: Prompting Strategies and Their Limitations