mlsanityData to 7 Oct 2026

PlanRAG: A Plan-then-Retrieval Augmented Generation for Generative Large Language Models as Decision Makers

arXiv 2406.12430 ↗First posted 18 Jun 2024cs.CL cs.AI cs.LGcited by 42

On the map: Retrieval-augmented generation → RAG pipeline design and evaluation

Abstract (arXiv)

In this paper, we conduct a study to utilize LLMs as a solution for decision making that requires complex data analysis. We define Decision QA as the task of answering the best decision, dbest, for a decision-making question Q, business rules R and a database D. Since there is no benchmark that can examine Decision QA, we propose Decision QA benchmark, DQA. It has two scenarios, Locating and Building, constructed from two video games (Europa Universalis IV and Victoria 3) that have almost the same goal as Decision QA. To address Decision QA effectively, we also propose a new RAG technique called the iterative plan-then-retrieval augmented generation (PlanRAG). Our PlanRAG-based LM generates the plan for decision making as the first step, and the retriever generates the queries for data analysis as the second step. The proposed method outperforms the state-of-the-art iterative RAG method by 15.8% in the Locating scenario and by 7.4% in the Building scenario, respectively. We release our code and benchmark at https://github.com/myeon9h/PlanRAG.

Key facts. Cited by 42 papers in the map (data through 7 Oct 2026). Placed in RAG pipeline design and evaluation, one of 15 directions in Retrieval-augmented generation. Builds on 28 of its 49 references that are in the map. First posted on arXiv 18 Jun 2024.

Builds on

28 of 49 references.

References · 28

  1. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  2. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  3. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  4. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
  5. 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,779
  6. 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,686
  7. 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,126
  8. 2018FEVER: a large-scale dataset for Fact Extraction and VERificationcited by 1,362
  9. 2021Improving language models by retrieving from trillions of tokenscited by 1,278
  10. 2020Constructing A Multi-hop QA Dataset for Comprehensive Evaluation of Reasoning Stepscited by 1,259
  11. 2020Leveraging Passage Retrieval with Generative Models for Open Domain Question Answeringcited by 1,203
  12. 2022Atlas: Few-shot Learning with Retrieval Augmented Language Modelscited by 940
16 more
  1. 2022Interleaving Retrieval with Chain-of-Thought Reasoning for Knowledge-Intensive Multi-Step Questionscited by 911
  2. 2019Generalization through Memorization: Nearest Neighbor Language Modelscited by 788
  3. 2023REPLUG: Retrieval-Augmented Black-Box Language Modelscited by 786
  4. 2021FinQA: A Dataset of Numerical Reasoning over Financial Datacited by 552
  5. 2019TabFact: A Large-scale Dataset for Table-based Fact Verificationcited by 425
  6. 2021TAT-QA: A Question Answering Benchmark on a Hybrid of Tabular and Textual Content in Financecited by 402
  7. 2023Enhancing Retrieval-Augmented Large Language Models with Iterative Retrieval-Generation Synergycited by 343
  8. 2023StructGPT: A General Framework for Large Language Model to Reason over Structured Datacited by 339
  9. 2020HybridQA: A Dataset of Multi-Hop Question Answering over Tabular and Textual Datacited by 263
  10. 2014Graph-based Anomaly Detection and Description: A Surveycited by 182
  11. 2021FeTaQA: Free-form Table Question Answeringcited by 174
  12. 2020A Survey on Knowledge Graph-Based Recommender Systemscited by 170
  13. 2020Open Question Answering over Tables and Textcited by 163
  14. 2020INFOTABS: Inference on Tables as Semi-structured Datacited by 84
  15. 2022Retrieval as Attention: End-to-end Learning of Retrieval and Reading within a Single Transformercited by 45
  16. 2022Leveraging Data Recasting to Enhance Tabular Reasoningcited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 6; 2025: 17; 2026: 19.

42 papers.

Sort:

By area:

  1. 2025Memory in the Age of AI Agentscited by 285
  2. 2025A Survey of LLM-based Deep Search Agents: Paradigm, Optimization, Evaluation, and Challengescited by 58
  3. 2025Ask in Any Modality: A Comprehensive Survey on Multimodal Retrieval-Augmented Generationcited by 42
  4. 2024Modular RAG: Transforming RAG Systems into LEGO-like Reconfigurable Frameworkscited by 41
  5. 2025A Survey on Knowledge-Oriented Retrieval-Augmented Generationcited by 34
  6. 2025SimpleDoc: Multi-Modal Document Understanding with Dual-Cue Page Retrieval and Iterative Refinementcited by 27
  7. 2025A Comprehensive Survey on Reinforcement Learning-based Agentic Search: Foundations, Roles, Optimizations, Evaluations, and Applicationscited by 21
  8. 2025DualRAG: A Dual-Process Approach to Integrate Reasoning and Retrieval for Multi-Hop Question Answeringcited by 20
  9. 2024SFR-RAG: Towards Contextually Faithful LLMscited by 19
  10. 2024Are LLMs Correctly Integrated into Software Systems?cited by 13
  11. 2025Self-Routing RAG: Binding Selective Retrieval with Knowledge Verbalizationcited by 9
  12. 2025InstructRAG: Leveraging Retrieval-Augmented Generation on Instruction Graphs for LLM-Based Task Planningcited by 8
30 more
  1. 2025EviNote-RAG: Enhancing RAG Models via Answer-Supportive Evidence Notescited by 8
  2. 2026DeepRead: Document Structure-Aware Reasoning to Enhance Agentic Searchcited by 6
  3. 2025Cache Mechanism for Agent RAG Systemscited by 5
  4. 2026Retrieval as Generation: A Unified Framework with Self-Triggered Information Planningcited by 5
  5. 2026Beyond Individual Intelligence: Surveying Collaboration, Failure Attribution, and Self-Evolution in LLM-based Multi-Agent Systemscited by 5
  6. 2026HyMem: Hybrid Memory Architecture with Dynamic Retrieval Schedulingcited by 4
  7. 2026H-Mem: A Novel Memory Mechanism for Evolving and Retrieving Agent Memory via a Hybrid Structurecited by 4
  8. 2024SLA Management in Reconfigurable Multi-Agent RAG: A Systems Approach to Question Answeringcited by 3
  9. 2025Automating the loop in traffic incident management on highwaycited by 2
  10. 2026Experience as a Compass: Multi-agent RAG with Evolving Orchestration and Agent Promptscited by 2
  11. 2024Evaluation of Attribution Bias in Generator-Aware Retrieval-Augmented Large Language Modelscited by 1
  12. 2025PolicyEvol-Agent: Evolving Policy via Environment Perception and Self-Awareness with Theory of Mindcited by 1
  13. 2025Alternatives To Next Token Prediction In Text Generation -- A Surveycited by 1
  14. 2026PRISMA: Reinforcement Learning Guided Two-Stage Policy Optimization in Multi-Agent Architecture for Open-Domain Multi-Hop Question Answeringcited by 1
  15. 2026When Iterative RAG Beats Ideal Evidence: A Diagnostic Study in Scientific Multi-hop Question Answeringcited by 1
  16. 2026SPARC-RAG: Adaptive Sequential-Parallel Scaling with Context Management for Retrieval-Augmented Generationcited by 1
  17. 2026MG2-RAG: Multi-Granularity Graph for Multimodal Retrieval-Augmented Generationcited by 1
  18. 2026STRIDE: Strategic Iterative Decision-Making for Retrieval-Augmented Multi-Hop Question Answeringcited by 1
  19. 2026AgenticRAG: Agentic Retrieval for Enterprise Knowledge Basescited by 1
  20. 2024A Method for Detecting Legal Article Competition for Korean Criminal Law Using a Case-augmented Mention Graphcited by 0
  21. 2025Augmenting LLM Reasoning with Dynamic Notes Writing for Complex QAcited by 0
  22. 2025Intent-Driven Storage Systems: From Low-Level Tuning to High-Level Understandingcited by 0
  23. 2026GraFine: Retrieval-Time Refinement for Efficient Graph RAG over Corpus Graphscited by 0
  24. 2026RAG without Forgetting: Continual Query-Infused Key Memorycited by 0
  25. 2025Comparative Analysis of Neural Retriever-Reranker Pipelines for Retrieval-Augmented Generation over Knowledge Graphs in E-commerce Applicationscited by 0
  26. 2026Test-Driven Agentic Framework for Reliable Robot Controllercited by 0
  27. 2026CORAL: Adaptive Retrieval Loop for Culturally-Aligned Multilingual RAGcited by 0
  28. 2026Training the Orchestrator: A Supervised Approach to End-to-End PDDL Planning with LLM Agentscited by 0
  29. 2026KAMR: Grounding Generation via Knowledge-Aligned Multi-hop Retrievalcited by 0
  30. 2026DocNavRAG: Document-Structured Graph RAG with Stateful Evidence Construction for Complex Document Question Answeringcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2024Auto-RAG: Autonomous Retrieval-Augmented Generation for Large Language Models
  2. 2024Retrieve-Plan-Generation: An Iterative Planning and Answering Framework for Knowledge-Intensive LLM Generation
  3. 2024Understanding the Fundamental Design Decisions of Retrieval-Augmented Generation Systems
  4. 2024Reliable Decision Making via Calibration Oriented Retrieval Augmented Generation
  5. 2025Evaluation of retrieval-based QA on QUEST-LOFT
  6. 2024Efficient Sequential Decision Making with Large Language Models
  7. 2024A Survey on RAG Meeting LLMs: Towards Retrieval-Augmented Large Language Models
  8. 2025AirRAG: Autonomous Strategic Planning and Reasoning Steer Retrieval Augmented Generation