Credible Plan-Driven RAG Method for Multi-Hop Question Answering
On the map: Retrieval-augmented generation → Knowledge-graph and structured-knowledge RAG
Abstract (arXiv)
Retrieval-augmented generation (RAG) has demonstrated strong performance in single-hop question answering (QA) by integrating external knowledge into large language models (LLMs). However, its effectiveness remains limited in multi-hop QA, which demands both stable reasoning and factual consistency. Existing approaches often provide partial solutions, addressing either reasoning trajectory stability or factual verification, but rarely achieving both simultaneously. To bridge this gap, we propose PAR-RAG, a three-stage Plan-then-Act-and-Review framework inspired by the PDCA cycle. PAR-RAG incorporates semantic complexity as a unifying principle through three key components: (i) complexity-aware exemplar selection guides plan generation by aligning decomposition granularity with question difficulty, thereby stabilizing reasoning trajectories; (ii) execution follows a structured retrieve-then-read process; and (iii) dual verification identifies and corrects intermediate errors while dynamically adjusting verification strength based on question complexity: emphasizing accuracy for simple queries and multi-evidence consistency for complex ones. This cognitively inspired framework integrates theoretical grounding with practical robustness. Experiments across diverse benchmarks demonstrate that PAR-RAG consistently outperforms competitive baselines, while ablation studies confirm the complementary roles of complexity-aware planning and dual verification. Collectively, these results establish PAR-RAG as a robust and generalizable framework for reliable multi-hop reasoning.
Key facts. Cited by 12 papers in the map (data through 7 Oct 2026). Placed in Knowledge-graph and structured-knowledge RAG, one of 15 directions in Retrieval-augmented generation. Builds on 72 of its 87 references that are in the map. First posted on arXiv 23 Apr 2025.
Builds on
72 of 87 references.
Closest ancestors · 8
Same direction, newest first
- 2024SiReRAG: Indexing Similar and Related Information for Multihop Reasoning9 Dec
- 2024Plan*RAG: Efficient Test-Time Planning for Retrieval Augmented Generation28 Oct
- 2024Retrieve, Summarize, Plan: Advancing Multi-hop Question Answering with an Iterative Approach18 Jul
- 2024Generate-then-Ground in Retrieval-Augmented Generation for Multi-hop Question Answering21 Jun
- 2024Learning to Plan for Retrieval-Augmented Large Language Models from Knowledge Graphs20 Jun
- 2024From Local to Global: A Graph RAG Approach to Query-Focused Summarization24 Apr
- 2024RAPTOR: Recursive Abstractive Processing for Tree-Organized Retrieval31 Jan
- 2023Enhancing Retrieval-Augmented Large Language Models with Iterative Retrieval-Generation Synergy24 May
Other references · 64
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2023GPT-4 Technical Reportcited by 18,132
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2022Large Language Models are Zero-Shot Reasonerscited by 4,323
- 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,115
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
- 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,686
- 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,383
- 2017TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehensioncited by 2,895
38 more
- 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,185
- 2023Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflectioncited by 1,800
- 2022Least-to-Most Prompting Enables Complex Reasoning in Large Language Modelscited by 1,397
- 2020Constructing A Multi-hop QA Dataset for Comprehensive Evaluation of Reasoning Stepscited by 1,259
- 2021What Makes Good In-Context Examples for GPT-3?cited by 1,184
- 2021Fantastically Ordered Prompts and Where to Find Them: Overcoming Few-Shot Prompt Order Sensitivitycited by 1,122
- 2022When Not to Trust Language Models: Investigating Effectiveness of Parametric and Non-Parametric Memoriescited by 1,103
- 2022Measuring and Narrowing the Compositionality Gap in Language Modelscited by 1,054
- 2023Large Language Models Cannot Self-Correct Reasoning Yetcited by 965
- 2022Interleaving Retrieval with Chain-of-Thought Reasoning for Knowledge-Intensive Multi-Step Questionscited by 911
- 2021MuSiQue: Multihop Questions via Single-hop Question Compositioncited by 893
- 2023Reasoning with Language Model is Planning with World Modelcited by 846
- 2023Large Language Models Can Be Easily Distracted by Irrelevant Contextcited by 820
- 2023Enabling Large Language Models to Generate Text with Citationscited by 584
- 2023Active Retrieval Augmented Generationcited by 506
- 2024From Generation to Judgment: Opportunities and Challenges of LLM-as-a-judgecited by 480
- 2021ColBERTv2: Effective and Efficient Retrieval via Lightweight Late Interactioncited by 464
- 2024Adaptive-RAG: Learning to Adapt Retrieval-Augmented Large Language Models through Question Complexitycited by 437
- 2023Describe, Explain, Plan and Select: Interactive Planning with Large Language Models Enables Open-World Multi-Task Agentscited by 396
- 2023A Survey of Hallucination in Large Foundation Modelscited by 365
- 2023Making Retrieval-Augmented Language Models Robust to Irrelevant Contextcited by 364
- 2022RARR: Researching and Revising What Language Models Say, Using Language Modelscited by 286
- 2024Long-context LLMs Struggle with Long In-context Learningcited by 285
- 2023Can We Edit Factual Knowledge by In-Context Learning?cited by 284
- 2024Knowledge Conflicts for LLMs: A Surveycited by 274
- 2024HippoRAG: Neurobiologically Inspired Long-Term Memory for Large Language Modelscited by 273
- 2023Challenges and Applications of Large Language Modelscited by 251
- 2024When Can LLMs Actually Correct Their Own Mistakes? A Critical Survey of Self-Correction of LLMscited by 230
- 2024Corrective Retrieval Augmented Generationcited by 187
- 2024Do Large Language Models Latently Perform Multi-Hop Reasoning?cited by 165
- 2024Evaluation of Retrieval-Augmented Generation: A Surveycited by 146
- 2022The Debate Over Understanding in AI's Large Language Modelscited by 142
- 2023Verify-and-Edit: A Knowledge-Enhanced Chain-of-Thought Frameworkcited by 139
- 2022Improving the Domain Adaptation of Retrieval Augmented Generation (RAG) Models for Open Domain Question Answeringcited by 126
- 2024Chain of Preference Optimization: Improving Chain-of-Thought Reasoning in LLMscited by 94
- 2023Automatic Evaluation of Attribution by Large Language Modelscited by 70
- 2024StructRAG: Boosting Knowledge Intensive Reasoning of LLMs via Inference-time Hybrid Information Structurizationcited by 70
- 2024Retrieval Augmented Generation (RAG) and Beyond: A Comprehensive Survey on How to Make your LLMs use External Data More Wiselycited by 65
50 most cited of 64 All 64 (JSON)
Built on by
Citing papers per year: 2025: 8; 2026: 4.
12 papers.
- 2025A Survey of LLM-based Deep Search Agents: Paradigm, Optimization, Evaluation, and Challengescited by 58
- 2025From Web Search towards Agentic Deep Research: Incentivizing Search with Reasoning Agentscited by 49
- 2025Towards Agentic RAG with Deep Reasoning: A Survey of RAG-Reasoning Systems in LLMscited by 40
- 2026Retrieval--Reasoning Processes for Multi-hop Question Answering: A Four-Axis Design Framework and Empirical Trendscited by 8
- 2026Optimizing Agentic Reasoning with Retrieval via Synthetic Semantic Information Gain Rewardcited by 6
- 2025SUBQRAG: Sub-Question Driven Dynamic Graph RAGcited by 3
- 2026Only Ask What You Don't Know: Grounded Delta Planning for Efficient Multi-step RAGcited by 3
- 2025Confident RAG: Enhancing the Performance of LLMs for Mathematics Question Answering through Multi-Embedding and Confidence Scoringcited by 2
- 2025RAISE: Enhancing Scientific Reasoning in LLMs via Step-by-Step Retrievalcited by 1
- 2025CID-GraphRAG: Enhancing Multi-Turn Dialogue Systems through Dual-Pathway Retrieval of Conversation Flow and Context Semanticscited by 1
- 2025From Query to Logic: Ontology-Driven Multi-Hop Reasoning in LLMscited by 0
- 2026Mapping the RAG Landscape: A Four Axis Taxonomy of Efficiency, Defense, Interactivity, and Reasoningcited by 0
- 2026Mapping the RAG Landscape: A Four Axis Taxonomy of Efficiency, Defense, Interactivity, and Reasoning1 Oct 2026
- 2026Only Ask What You Don't Know: Grounded Delta Planning for Efficient Multi-step RAG21 Jun 2026
- 2026Optimizing Agentic Reasoning with Retrieval via Synthetic Semantic Information Gain Reward31 Jan 2026
- 2026Retrieval--Reasoning Processes for Multi-hop Question Answering: A Four-Axis Design Framework and Empirical Trends2 Jan 2026
- 2025SUBQRAG: Sub-Question Driven Dynamic Graph RAG9 Oct 2025
- 2025A Survey of LLM-based Deep Search Agents: Paradigm, Optimization, Evaluation, and Challenges3 Aug 2025
- 2025From Query to Logic: Ontology-Driven Multi-Hop Reasoning in LLMs2 Aug 2025
- 2025Confident RAG: Enhancing the Performance of LLMs for Mathematics Question Answering through Multi-Embedding and Confidence Scoring23 Jul 2025
- 2025Towards Agentic RAG with Deep Reasoning: A Survey of RAG-Reasoning Systems in LLMs13 Jul 2025
- 2025CID-GraphRAG: Enhancing Multi-Turn Dialogue Systems through Dual-Pathway Retrieval of Conversation Flow and Context Semantics24 Jun 2025
- 2025From Web Search towards Agentic Deep Research: Incentivizing Search with Reasoning Agents23 Jun 2025
- 2025RAISE: Enhancing Scientific Reasoning in LLMs via Step-by-Step Retrieval10 Jun 2025
Similar, not cited
Close in wording, no citation either way
- 2026Reasoning in Trees: Improving Retrieval-Augmented Generation for Multi-Hop Question Answering
- 2025REAP: Enhancing RAG with Recursive Evaluation and Adaptive Planning for Multi-Hop Question Answering
- 2025ComposeRAG: A Modular and Composable RAG for Corpus-Grounded Multi-Hop Question Answering
- 2024Review-Then-Refine: A Dynamic Framework for Multi-Hop Question Answering with Temporal Adaptability
- 2026PAR2-RAG: Planned Active Retrieval and Reasoning for Multi-Hop Question Answering
- 2026Self-Correcting RAG: Enhancing Faithfulness via MMKP Context Selection and NLI-Guided MCTS
- 2026D2F-ReAG: Dynamic Decomposition and Filtering for Multi-Hop Reasoning-Augmented Generation
- 2026ConRAG: Consensus-Driven Multi-View Retrieval for Multi-Hop Question Answering