mlsanityData to 7 Oct 2026

Plan-on-Graph: Self-Correcting Adaptive Planning of Large Language Model on Knowledge Graphs

arXiv 2410.23875 ↗First posted 31 Oct 2024cs.AIcited by 77

On the map: LLM reasoning → Knowledge- and tool-augmented reasoning

Abstract (arXiv)

Large Language Models (LLMs) have shown remarkable reasoning capabilities on complex tasks, but they still suffer from out-of-date knowledge, hallucinations, and opaque decision-making. In contrast, Knowledge Graphs (KGs) can provide explicit and editable knowledge for LLMs to alleviate these issues. Existing paradigm of KG-augmented LLM manually predefines the breadth of exploration space and requires flawless navigation in KGs. However, this paradigm cannot adaptively explore reasoning paths in KGs based on the question semantics and self-correct erroneous reasoning paths, resulting in a bottleneck in efficiency and effect. To address these limitations, we propose a novel self-correcting adaptive planning paradigm for KG-augmented LLM named Plan-on-Graph (PoG), which first decomposes the question into several sub-objectives and then repeats the process of adaptively exploring reasoning paths, updating memory, and reflecting on the need to self-correct erroneous reasoning paths until arriving at the answer. Specifically, three important mechanisms of Guidance, Memory, and Reflection are designed to work together, to guarantee the adaptive breadth of self-correcting planning for graph reasoning. Finally, extensive experiments on three real-world datasets demonstrate the effectiveness and efficiency of PoG.

Key facts. Cited by 77 papers in the map (data through 7 Oct 2026). Placed in Knowledge- and tool-augmented reasoning, one of 17 directions in LLM reasoning. Builds on 39 of its 64 references that are in the map. First posted on arXiv 31 Oct 2024.

Builds on

39 of 64 references.

Closest ancestors · 2

Same direction, newest first

  1. 2023Reasoning on Graphs: Faithful and Interpretable Large Language Model Reasoning2 Oct
  2. 2022UniKGQA: Unified Retrieval and Reasoning for Solving Multi-hop Question Answering Over Knowledge Graph2 Dec

Other references · 37

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  3. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
  4. 2022Large Language Models are Zero-Shot Reasonerscited by 4,323
  5. 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,243
  6. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
  7. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
  8. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
  9. 2022Least-to-Most Prompting Enables Complex Reasoning in Large Language Modelscited by 1,397
  10. 2023Graph of Thoughts: Solving Elaborate Problems with Large Language Modelscited by 873
  11. 2019ERNIE: Enhanced Language Representation with Informative Entitiescited by 525
  12. 2018The Web as a Knowledge-base for Answering Complex Questionscited by 409
25 more
  1. 2019KEPLER: A Unified Model for Knowledge Embedding and Pre-trained Language Representationcited by 356
  2. 2023StructGPT: A General Framework for Large Language Model to Reason over Structured Datacited by 339
  3. 2019KG-BERT: BERT for Knowledge Graph Completioncited by 323
  4. 2023GraphGPT: Graph Instruction Tuning for Large Language Modelscited by 223
  5. 2020Beyond I.I.D.: Three Levels of Generalization for Question Answering on Knowledge Basescited by 169
  6. 2023SelfCheck: Using LLMs to Zero-Shot Check Their Own Step-by-Step Reasoningcited by 157
  7. 2023Knowledge-Driven CoT: Exploring Faithful Reasoning in LLMs for Knowledge-intensive Question Answeringcited by 97
  8. 2021RnG-KBQA: Generation Augmented Iterative Ranking for Knowledge Base Question Answeringcited by 86
  9. 2022DecAF: Joint Decoding of Answers and Logical Forms for Question Answering over Knowledge Basescited by 83
  10. 2023Boosting Language Models Reasoning with Chain-of-Knowledge Promptingcited by 77
  11. 2023Few-shot In-context Learning for Knowledge Base Question Answeringcited by 74
  12. 2022TIARA: Multi-grained Retrieval for Robust Question Answering over Large Knowledge Basescited by 59
  13. 2023T-SciQ: Teaching Multimodal Chain-of-Thought Reasoning via Mixed Large Language Model Signals for Science Question Answeringcited by 59
  14. 2022Don't Generate, Discriminate: A Proposal for Grounding Language Models to Real-World Environmentscited by 57
  15. 2023FlexKBQA: A Flexible LLM-Powered Framework for Few-Shot Knowledge Base Question Answeringcited by 51
  16. 2023MoT: Memory-of-Thought Enables ChatGPT to Self-Improvecited by 37
  17. 2024Interactive-KBQA: Multi-Turn Interactions for Knowledge Base Question Answering with Large Language Modelscited by 25
  18. 2023Using Large Language Models for Zero-Shot Natural Language Generation from Knowledge Graphscited by 24
  19. 2023FC-KBQA: A Fine-to-Coarse Composition Framework for Knowledge Base Question Answeringcited by 21
  20. 2024Graph-oriented Instruction Tuning of Large Language Models for Generic Graph Miningcited by 20
  21. 2023UniGen: A Unified Generative Framework for Retrieval and Question Answering with Large Language Modelscited by 14
  22. 2024AFDGCF: Adaptive Feature De-correlation Graph Collaborative Filtering for Recommendationscited by 12
  23. 2023Pay More Attention to Relation Exploration for Knowledge Base Question Answeringcited by 7
  24. 2024Dynamic Sparse Learning: A Novel Paradigm for Efficient Recommendationcited by 7
  25. 2024Joint Admission Control and Resource Allocation of Virtual Network Embedding via Hierarchical Deep Reinforcement Learningcited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 2; 2025: 42; 2026: 33.

77 papers.

Sort:

By area:

  1. 2025A Survey of Graph Retrieval-Augmented Generation for Customized Large Language Modelscited by 85
  2. 2025PathRAG: Pruning Graph-based Retrieval Augmented Generation with Relational Pathscited by 60
  3. 2024TokenSelect: Efficient Long-Context Inference and Length Extrapolation for LLMs via Dynamic Token-Level KV Cache Selectioncited by 38
  4. 2025Large Language Models Meet Knowledge Graphs for Question Answering: Synthesis and Opportunitiescited by 30
  5. 2024Harnessing Large Language Models for Knowledge Graph Question Answering via Adaptive Multi-Aspect Retrieval-Augmentationcited by 24
  6. 2025LLM-powered Multi-agent Framework for Goal-oriented Learning in Intelligent Tutoring Systemcited by 21
  7. 2025Hierarchical Time-Aware Mixture of Experts for Multi-Modal Sequential Recommendationcited by 14
  8. 2025Diagnosing and Addressing Pitfalls in KG-RAG Datasets: Toward More Reliable Benchmarkingcited by 11
  9. 2025Align-GRAG: Anchor and Rationale Guided Dual Alignment for Graph Retrieval-Augmented Generationcited by 9
  10. 2025Reliable Reasoning Path: Distilling Effective Guidance for LLM Reasoning with Knowledge Graphscited by 9
  11. 2025ReMindRAG: Low-Cost LLM-Guided Knowledge Graph Traversal for Efficient RAGcited by 8
  12. 2025Reason-Align-Respond: Aligning LLM Reasoning with Knowledge Graphs for KGQAcited by 7
38 more
  1. 2025TeaRAG: A Token-Efficient Agentic Retrieval-Augmented Generation Frameworkcited by 7
  2. 2026Membox: Weaving Topic Continuity into Long-Range Memory for LLM Agentscited by 6
  3. 2025Dynamic-KGQA: A Scalable Framework for Generating Adaptive Question Answering Datasetscited by 5
  4. 2025Learning Efficient and Generalizable Graph Retriever for Knowledge-Graph Question Answeringcited by 5
  5. 2025Efficient and Transferable Agentic Knowledge Graph RAG via Reinforcement Learningcited by 5
  6. 2025Search-on-Graph: Iterative Informed Navigation for Large Language Model Reasoning on Knowledge Graphscited by 5
  7. 2025Self-Reflective Planning with Knowledge Graphs: Enhancing LLM Reasoning Reliability for Question Answeringcited by 4
  8. 2025RJE: A Retrieval-Judgment-Exploration Framework for Efficient Knowledge Graph Question Answering with LLMscited by 4
  9. 2025KnowPath: Knowledge-enhanced Reasoning via LLM-generated Inference Paths over Knowledge Graphscited by 3
  10. 2025Enhancing Large Language Models with Reward-guided Tree Search for Knowledge Graph Question and Answeringcited by 3
  11. 2025Advancing Multi-Agent RAG Systems with Minimalist Reinforcement Learningcited by 3
  12. 2025Debate over Mixed-knowledge: A Robust Multi-Agent Reasoning Framework for Incomplete Knowledge Graph Question Answeringcited by 3
  13. 2025KBQA-R1: Reinforcing Large Language Models for Knowledge Base Question Answeringcited by 3
  14. 2026CoG: Controllable Graph Reasoning via Relational Blueprints and Failure-Aware Refinement over Knowledge Graphscited by 3
  15. 2026Agentic SPARQL: Evaluating SPARQL-MCP-powered Intelligent Agents on the Federated KGQA Benchmarkcited by 3
  16. 2025GLTW: Joint Improved Graph Transformer and LLM via Three-Word Language for Knowledge Graph Completioncited by 2
  17. 2025Beyond Chains: Bridging Large Language Models and Knowledge Bases in Complex Question Answeringcited by 2
  18. 2025LLM Inference Enhanced by External Knowledge: A Surveycited by 2
  19. 2025Towards Open-World Retrieval-Augmented Generation on Knowledge Graph: A Multi-Agent Collaboration Frameworkcited by 2
  20. 2025PRoH: Dynamic Planning and Reasoning over Knowledge Hypergraphs for Retrieval-Augmented Generationcited by 2
  21. 2025Plan of Knowledge: Retrieval-Augmented Large Language Models for Temporal Knowledge Graph Question Answeringcited by 2
  22. 2025Ground-Truth Subgraphs for Better Training and Evaluation of Knowledge Graph Augmented LLMscited by 2
  23. 2025Schema Matching on Graph: Iterative Graph Exploration for Efficient and Explainable Data Integrationcited by 2
  24. 2025Cooperative Retrieval-Augmented Generation for Question Answering: Mutual Information Exchange and Ranking by Contrasting Layerscited by 2
  25. 2025PRAXIS: Integrating Program Analysis with Observability for Root-Cause Analysiscited by 2
  26. 2026Embodied Task Planning via Graph-Informed Action Generation with Large Language Modelscited by 2
  27. 2026Explore-on-Graph: Incentivizing Autonomous Exploration of Large Language Models on Knowledge Graphs with Path-refined Reward Modelingcited by 2
  28. 2026Aligning Large Language Models with Searcher Preferencescited by 2
  29. 2026IoT-Brain: Grounding LLMs for Semantic-Spatial Sensor Schedulingcited by 2
  30. 2026Evolving Idea Graphs with Learnable Edits-and-Commits for Multi-Agent Scientific Ideationcited by 2
  31. 2026Code-on-Graph: Iterative Programmatic Reasoning via Large Language Models on Knowledge Graphscited by 2
  32. 2026Search-on-Graph-R1: Training Large Language Models to Search Knowledge Graphs with Reinforcement Learningcited by 2
  33. 2025Human Cognition Inspired RAG with Knowledge Graph for Complex Problem Solvingcited by 1
  34. 2025Knowledge Fusion via Bidirectional Information Aggregationcited by 1
  35. 2025CIMR: Contextualized Iterative Multimodal Reasoning for Robust Instruction Following in LVLMscited by 1
  36. 2025Guided Navigation in Knowledge-Dense Environments: Structured Semantic Exploration with Guidance Graphscited by 1
  37. 2025Exemplar-Guided Planing: Enhanced LLM Agent for KGQAcited by 1
  38. 2025Efficient Multi-Hop Question Answering over Knowledge Graphs via LLM Planning and Embedding-Guided Searchcited by 1

50 most cited of 77 All 77 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2023Think-on-Graph: Deep and Responsible Reasoning of Large Language Model on Knowledge Graph
  2. 2024KARPA: A Training-free Method of Adapting Knowledge Graph as References for Large Language Model's Reasoning Path Aggregation
  3. 2024Paths-over-Graph: Knowledge Graph Empowered Large Language Model Reasoning
  4. 2025Plan Then Retrieve: Reinforcement Learning-Guided Complex Reasoning over Knowledge Graphs
  5. 2024On the Self-Verification Limitations of Large Language Models on Reasoning and Planning Tasks
  6. 2024Graph-enhanced Large Language Models in Asynchronous Plan Reasoning
  7. 2025PathMind: A Retrieve-Prioritize-Reason Framework for Knowledge Graph Reasoning with Large Language Models
  8. 2024Graph-constrained Reasoning: Faithful Reasoning on Knowledge Graphs with Large Language Models