mlsanityData to 7 Oct 2026

Credible Plan-Driven RAG Method for Multi-Hop Question Answering

arXiv 2504.16787 ↗First posted 23 Apr 2025cs.CL cs.AIcited by 12

On the map: Retrieval-augmented generation → Knowledge-graph and structured-knowledge RAG

Abstract (arXiv)

Retrieval-augmented generation (RAG) has demonstrated strong performance in single-hop question answering (QA) by integrating external knowledge into large language models (LLMs). However, its effectiveness remains limited in multi-hop QA, which demands both stable reasoning and factual consistency. Existing approaches often provide partial solutions, addressing either reasoning trajectory stability or factual verification, but rarely achieving both simultaneously. To bridge this gap, we propose PAR-RAG, a three-stage Plan-then-Act-and-Review framework inspired by the PDCA cycle. PAR-RAG incorporates semantic complexity as a unifying principle through three key components: (i) complexity-aware exemplar selection guides plan generation by aligning decomposition granularity with question difficulty, thereby stabilizing reasoning trajectories; (ii) execution follows a structured retrieve-then-read process; and (iii) dual verification identifies and corrects intermediate errors while dynamically adjusting verification strength based on question complexity: emphasizing accuracy for simple queries and multi-evidence consistency for complex ones. This cognitively inspired framework integrates theoretical grounding with practical robustness. Experiments across diverse benchmarks demonstrate that PAR-RAG consistently outperforms competitive baselines, while ablation studies confirm the complementary roles of complexity-aware planning and dual verification. Collectively, these results establish PAR-RAG as a robust and generalizable framework for reliable multi-hop reasoning.

Key facts. Cited by 12 papers in the map (data through 7 Oct 2026). Placed in Knowledge-graph and structured-knowledge RAG, one of 15 directions in Retrieval-augmented generation. Builds on 72 of its 87 references that are in the map. First posted on arXiv 23 Apr 2025.

Builds on

72 of 87 references.

Closest ancestors · 8

Same direction, newest first

  1. 2024SiReRAG: Indexing Similar and Related Information for Multihop Reasoning9 Dec
  2. 2024Plan*RAG: Efficient Test-Time Planning for Retrieval Augmented Generation28 Oct
  3. 2024Retrieve, Summarize, Plan: Advancing Multi-hop Question Answering with an Iterative Approach18 Jul
  4. 2024Generate-then-Ground in Retrieval-Augmented Generation for Multi-hop Question Answering21 Jun
  5. 2024Learning to Plan for Retrieval-Augmented Large Language Models from Knowledge Graphs20 Jun
  6. 2024From Local to Global: A Graph RAG Approach to Query-Focused Summarization24 Apr
  7. 2024RAPTOR: Recursive Abstractive Processing for Tree-Organized Retrieval31 Jan
  8. 2023Enhancing Retrieval-Augmented Large Language Models with Iterative Retrieval-Generation Synergy24 May

Other references · 64

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2023GPT-4 Technical Reportcited by 18,132
  3. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  4. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  5. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  6. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  7. 2022Large Language Models are Zero-Shot Reasonerscited by 4,323
  8. 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,115
  9. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
  10. 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,686
  11. 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,383
  12. 2017TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehensioncited by 2,895
38 more
  1. 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,185
  2. 2023Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflectioncited by 1,800
  3. 2022Least-to-Most Prompting Enables Complex Reasoning in Large Language Modelscited by 1,397
  4. 2020Constructing A Multi-hop QA Dataset for Comprehensive Evaluation of Reasoning Stepscited by 1,259
  5. 2021What Makes Good In-Context Examples for GPT-3?cited by 1,184
  6. 2021Fantastically Ordered Prompts and Where to Find Them: Overcoming Few-Shot Prompt Order Sensitivitycited by 1,122
  7. 2022When Not to Trust Language Models: Investigating Effectiveness of Parametric and Non-Parametric Memoriescited by 1,103
  8. 2022Measuring and Narrowing the Compositionality Gap in Language Modelscited by 1,054
  9. 2023Large Language Models Cannot Self-Correct Reasoning Yetcited by 965
  10. 2022Interleaving Retrieval with Chain-of-Thought Reasoning for Knowledge-Intensive Multi-Step Questionscited by 911
  11. 2021MuSiQue: Multihop Questions via Single-hop Question Compositioncited by 893
  12. 2023Reasoning with Language Model is Planning with World Modelcited by 846
  13. 2023Large Language Models Can Be Easily Distracted by Irrelevant Contextcited by 820
  14. 2023Enabling Large Language Models to Generate Text with Citationscited by 584
  15. 2023Active Retrieval Augmented Generationcited by 506
  16. 2024From Generation to Judgment: Opportunities and Challenges of LLM-as-a-judgecited by 480
  17. 2021ColBERTv2: Effective and Efficient Retrieval via Lightweight Late Interactioncited by 464
  18. 2024Adaptive-RAG: Learning to Adapt Retrieval-Augmented Large Language Models through Question Complexitycited by 437
  19. 2023Describe, Explain, Plan and Select: Interactive Planning with Large Language Models Enables Open-World Multi-Task Agentscited by 396
  20. 2023A Survey of Hallucination in Large Foundation Modelscited by 365
  21. 2023Making Retrieval-Augmented Language Models Robust to Irrelevant Contextcited by 364
  22. 2022RARR: Researching and Revising What Language Models Say, Using Language Modelscited by 286
  23. 2024Long-context LLMs Struggle with Long In-context Learningcited by 285
  24. 2023Can We Edit Factual Knowledge by In-Context Learning?cited by 284
  25. 2024Knowledge Conflicts for LLMs: A Surveycited by 274
  26. 2024HippoRAG: Neurobiologically Inspired Long-Term Memory for Large Language Modelscited by 273
  27. 2023Challenges and Applications of Large Language Modelscited by 251
  28. 2024When Can LLMs Actually Correct Their Own Mistakes? A Critical Survey of Self-Correction of LLMscited by 230
  29. 2024Corrective Retrieval Augmented Generationcited by 187
  30. 2024Do Large Language Models Latently Perform Multi-Hop Reasoning?cited by 165
  31. 2024Evaluation of Retrieval-Augmented Generation: A Surveycited by 146
  32. 2022The Debate Over Understanding in AI's Large Language Modelscited by 142
  33. 2023Verify-and-Edit: A Knowledge-Enhanced Chain-of-Thought Frameworkcited by 139
  34. 2022Improving the Domain Adaptation of Retrieval Augmented Generation (RAG) Models for Open Domain Question Answeringcited by 126
  35. 2024Chain of Preference Optimization: Improving Chain-of-Thought Reasoning in LLMscited by 94
  36. 2023Automatic Evaluation of Attribution by Large Language Modelscited by 70
  37. 2024StructRAG: Boosting Knowledge Intensive Reasoning of LLMs via Inference-time Hybrid Information Structurizationcited by 70
  38. 2024Retrieval Augmented Generation (RAG) and Beyond: A Comprehensive Survey on How to Make your LLMs use External Data More Wiselycited by 65

50 most cited of 64 All 64 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 8; 2026: 4.

12 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Reasoning in Trees: Improving Retrieval-Augmented Generation for Multi-Hop Question Answering
  2. 2025REAP: Enhancing RAG with Recursive Evaluation and Adaptive Planning for Multi-Hop Question Answering
  3. 2025ComposeRAG: A Modular and Composable RAG for Corpus-Grounded Multi-Hop Question Answering
  4. 2024Review-Then-Refine: A Dynamic Framework for Multi-Hop Question Answering with Temporal Adaptability
  5. 2026PAR2-RAG: Planned Active Retrieval and Reasoning for Multi-Hop Question Answering
  6. 2026Self-Correcting RAG: Enhancing Faithfulness via MMKP Context Selection and NLI-Guided MCTS
  7. 2026D2F-ReAG: Dynamic Decomposition and Filtering for Multi-Hop Reasoning-Augmented Generation
  8. 2026ConRAG: Consensus-Driven Multi-View Retrieval for Multi-Hop Question Answering