Retrieval Augmented Decision-Making: A Requirements-Driven, Multi-Criteria Framework for Structured Decision Support
On the map: Retrieval-augmented generation → RAG pipeline design and evaluation
Abstract (arXiv)
Various industries have produced a large number of documents such as industrial plans, technical guidelines, and regulations that are structurally complex and content-wise fragmented. This poses significant challenges for experts and decision-makers in terms of retrieval and understanding. Although existing LLM-based Retrieval-Augmented Generation methods can provide context-related suggestions, they lack quantitative weighting and traceable reasoning paths, making it difficult to offer multi-level and transparent decision support. To address this issue, this paper proposes the RAD method, which integrates Multi-Criteria Decision Making with the semantic understanding capabilities of LLMs. The method automatically extracts key criteria from industry documents, builds a weighted hierarchical decision model, and generates structured reports under model guidance. The RAD framework introduces explicit weight assignment and reasoning chains in decision generation to ensure accuracy, completeness, and traceability. Experiments show that in various decision-making tasks, the decision reports generated by RAD significantly outperform existing methods in terms of detail, rationality, and structure, demonstrating its application value and potential in complex decision support scenarios.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in RAG pipeline design and evaluation, one of 15 directions in Retrieval-augmented generation. Builds on 9 of its 15 references that are in the map. First posted on arXiv 24 May 2025.
Builds on
9 of 15 references.
Closest ancestors · 1
Same direction, newest first
Other references · 8
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2024From Local to Global: A Graph RAG Approach to Query-Focused Summarizationcited by 1,453
- 2022From Anecdotal Evidence to Quantitative Evaluation Methods: A Systematic Review on Evaluating Explainable AIcited by 302
- 2023LLMs for Knowledge Graph Construction and Reasoning: Recent Capabilities and Future Opportunitiescited by 97
- 2024LawLLM: Law Large Language Model for the US Legal Systemcited by 37
- 2024Improving Retrieval Augmented Language Model with Self-Reasoningcited by 28
- 2021Regulatory Compliance through Doc2Doc Information Retrieval: A case study in EU/UK legislation where text similarity has limitationscited by 13
- 2024A framework for developing a knowledge management platformcited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024Reliable Decision Making via Calibration Oriented Retrieval Augmented Generation
- 2024KAG: Boosting LLMs in Professional Domains via Knowledge Augmented Generation
- 2024Deploying Large Language Models With Retrieval Augmented Generation
- 2025Retrieval-Augmented Generation in Industry: An Interview Study on Use Cases, Requirements, Challenges, and Evaluation
- 2025One for All: A General Framework of LLMs-based Multi-Criteria Decision Making on Human Expert Level
- 2026Retrieval-Augmented Generation to Support Railways Engineering Tasks: A Case Study
- 2025Evaluation of retrieval-based QA on QUEST-LOFT
- 2024Responsible Retrieval Augmented Generation for Climate Decision Making from Documents