mlsanityData to 7 Oct 2026

MindMap: Knowledge Graph Prompting Sparks Graph of Thoughts in Large Language Models

arXiv 2308.09729 ↗First posted 17 Aug 2023cs.AI cs.CL cs.LGcited by 73

On the map: LLM reasoning → Knowledge- and tool-augmented reasoning

Abstract (arXiv)

Large language models (LLMs) have achieved remarkable performance in natural language understanding and generation tasks. However, they often suffer from limitations such as difficulty in incorporating new knowledge, generating hallucinations, and explaining their reasoning process. To address these challenges, we propose a novel prompting pipeline, named method, that leverages knowledge graphs (KGs) to enhance LLMs' inference and transparency. Our method enables LLMs to comprehend KG inputs and infer with a combination of implicit and external knowledge. Moreover, our method elicits the mind map of LLMs, which reveals their reasoning pathways based on the ontology of knowledge. We evaluate our method on diverse question & answering tasks, especially in medical domains, and show significant improvements over baselines. We also introduce a new hallucination evaluation benchmark and analyze the effects of different components of our method. Our results demonstrate the effectiveness and robustness of our method in merging knowledge from LLMs and KGs for combined inference. To reproduce our results and extend the framework further, we make our codebase available at https://github.com/wyl-willing/MindMap.

Key facts. Cited by 73 papers in the map (data through 7 Oct 2026). Placed in Knowledge- and tool-augmented reasoning, one of 17 directions in LLM reasoning. Builds on 32 of its 41 references that are in the map. First posted on arXiv 17 Aug 2023.

Builds on

32 of 41 references.

Closest ancestors · 2

Same direction, newest first

  1. 2023Complex Logical Reasoning over Knowledge Graphs using Large Language Models2 May
  2. 2022GreaseLM: Graph REASoning Enhanced Language Models for Question Answering21 Jan

Other references · 30

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2022Training language models to follow instructions with human feedbackcited by 15,712
  3. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  4. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
  5. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
  6. 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,747
  7. 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,383
  8. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
  9. 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,222
  10. 2022Survey of Hallucination in Natural Language Generationcited by 2,056
  11. 2022Large Language Models Encode Clinical Knowledgecited by 1,807
  12. 2020How Much Knowledge Can You Pack Into the Parameters of a Language Model?cited by 713
18 more
  1. 2023Unifying Large Language Models and Knowledge Graphs: A Roadmapcited by 663
  2. 2019ERNIE: Enhanced Language Representation with Informative Entitiescited by 525
  3. 2021QA-GNN: Reasoning with Language Models and Knowledge Graphs for Question Answeringcited by 386
  4. 2023Check Your Facts and Try Again: Improving Large Language Models with External Knowledge and Automated Feedbackcited by 351
  5. 2023ChatDoctor: A Medical Chat Model Fine-Tuned on a Large Language Model Meta-AI (LLaMA) Using Medical Domain Knowledgecited by 324
  6. 2019K-BERT: Enabling Language Representation with Knowledge Graphcited by 303
  7. 2023Exploring the Potential of Large Language Models (LLMs) in Learning on Graphscited by 271
  8. 2021ERNIE 3.0: Large-scale Knowledge Enhanced Pre-training for Language Understanding and Generationcited by 258
  9. 2023GPT4Graph: Can Large Language Models Understand Graph Structured Data ? An Empirical Evaluation and Benchmarkingcited by 209
  10. 2020A Survey of the State of Explainable AI for Natural Language Processingcited by 206
  11. 2023Progressive Prompts: Continual Learning for Language Modelscited by 195
  12. 2022Deep Bidirectional Language-Knowledge Graph Pretrainingcited by 156
  13. 2023Knowledge-Augmented Language Model Prompting for Zero-Shot Knowledge Graph Question Answeringcited by 119
  14. 2020CoLAKE: Contextualized Language and Knowledge Embeddingcited by 86
  15. 2021Complex Temporal Question Answering on Knowledge Graphscited by 69
  16. 2018Improving Natural Language Inference Using External Knowledge in the Science Questions Domaincited by 48
  17. 2023ExplainCPE: A Free-text Explanation Benchmark of Chinese Pharmacist Examinationcited by 10
  18. 2020Word2vec Conjecture and A Limitative Resultcited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 6; 2024: 22; 2025: 32; 2026: 13.

73 papers.

Sort:

By area:

  1. 2025From System 1 to System 2: A Survey of Reasoning Large Language Modelscited by 319
  2. 2024HippoRAG: Neurobiologically Inspired Long-Term Memory for Large Language Modelscited by 273
  3. 2024Retrieval-Augmented Generation with Graphs (GraphRAG)cited by 170
  4. 2024GNN-RAG: Graph Neural Retrieval for Large Language Model Reasoningcited by 128
  5. 2025A Survey of Graph Retrieval-Augmented Generation for Customized Large Language Modelscited by 85
  6. 2023Cognitive Mirage: A Review of Hallucinations in Large Language Modelscited by 83
  7. 2024Simple Is Effective: The Roles of Graphs and Large Language Models in Knowledge-Graph-Based Retrieval-Augmented Generationcited by 78
  8. 2024Risk Taxonomy, Mitigation, and Assessment Benchmarks of Large Language Model Systemscited by 63
  9. 2024Demystifying Chains, Trees, and Graphs of Thoughtscited by 63
  10. 2024Visual Agents as Fast and Slow Thinkerscited by 53
  11. 2023Making Large Language Models Perform Better in Knowledge Graph Completioncited by 48
  12. 2024Graph Machine Learning in the Era of Large Language Models (LLMs)cited by 33
38 more
  1. 2023KnowGPT: Knowledge Graph based Prompting for Large Language Modelscited by 30
  2. 2025Graphs Meet AI Agents: Taxonomy, Progress, and Future Opportunitiescited by 23
  3. 2024Can Knowledge Graphs Make Large Language Models More Trustworthy? An Empirical Study Over Open-ended Question Answeringcited by 20
  4. 2023Graph Meets LLMs: Towards Large Graph Modelscited by 19
  5. 2025RAG-Enhanced Collaborative LLM Agents for Drug Discoverycited by 18
  6. 2024A Survey of Large Language Models on Generative Graph Analytics: Query, Learning, and Applicationscited by 17
  7. 2024Structure Guided Prompt: Instructing Large Language Model in Multi-Step Reasoning by Exploring Graph Structure of the Textcited by 14
  8. 2023Large Knowledge Model: Perspectives and Challengescited by 12
  9. 2025Resisting Contextual Interference in RAG via Parametric-Knowledge Reinforcementcited by 11
  10. 2024Large Language Models Can Better Understand Knowledge Graphs Than We Thoughtcited by 10
  11. 2024Thought Graph: Generating Thought Process for Biological Reasoningcited by 10
  12. 2024Preference-Guided Refactored Tuning for Retrieval Augmented Code Generationcited by 10
  13. 2025Out of Style: RAG's Fragility to Linguistic Variationcited by 10
  14. 2025MedGUIDE: Benchmarking Clinical Decision-Making in Large Language Modelscited by 10
  15. 2023On the Evolution of Knowledge Graphs: A Survey and Perspectivecited by 9
  16. 2024Reasoning on Efficient Knowledge Paths:Knowledge Graph Guides Large Language Model for Domain Question Answeringcited by 9
  17. 2025Exploring the Security Threats of Knowledge Base Poisoning in Retrieval-Augmented Code Generationcited by 9
  18. 2024A Perspective for Adapting Generalist AI to Specialized Medical AI Applications and Their Challengescited by 8
  19. 2025LightPROF: A Lightweight Reasoning Framework for Large Language Model on Knowledge Graphcited by 8
  20. 2024Fake Artificial Intelligence Generated Contents (FAIGC): A Survey of Theories, Detection Methods, and Opportunitiescited by 7
  21. 2024RACOON: An LLM-based Framework for Retrieval-Augmented Column Type Annotation with a Knowledge Graphcited by 7
  22. 2026Query-Aware Flow Diffusion for Graph-Based RAG with Retrieval Guaranteescited by 7
  23. 2024LinkQ: An LLM-Assisted Visual Interface for Knowledge Graph Question-Answeringcited by 6
  24. 2024Structure-aware Domain Knowledge Injection for Large Language Modelscited by 6
  25. 2025WikiAutoGen: Towards Multi-Modal Wikipedia-Style Article Generationcited by 5
  26. 2025Learning Efficient and Generalizable Graph Retriever for Knowledge-Graph Question Answeringcited by 5
  27. 2025MedKGent: A Large Language Model Agent Framework for Constructing Temporally Evolving Medical Knowledge Graphcited by 5
  28. 2025Reasoning by Exploration: A Unified Approach to Retrieval and Generation over Graphscited by 5
  29. 2024MathLearner: A Large Language Model Agent Framework for Learning to Solve Mathematical Problemscited by 4
  30. 2025Knowledge Graphs for Enhancing Large Language Models in Entity Disambiguationcited by 4
  31. 2025KG-Infused RAG: Augmenting Corpus-Based RAG with External Knowledge Graphscited by 4
  32. 2024Enhancing LLM's Cognition via Structurizationcited by 2
  33. 2025Cochain: Balancing Insufficient and Excessive Collaboration in LLM Agent Workflowscited by 2
  34. 2025Walk&Retrieve: Simple Yet Effective Zero-shot Retrieval-Augmented Generation via Knowledge Graph Walkscited by 2
  35. 2025Towards Self-cognitive Exploration: Metacognitive Knowledge Graph Retrieval Augmented Generationcited by 2
  36. 2025A Dynamic Knowledge Update-Driven Model with Large Language Models for Fake News Detectioncited by 2
  37. 2025Adaptive and Resource-efficient Agentic AI Systems for Mobile and Embedded Devices: A Surveycited by 2
  38. 2025DeepEvidence: Empowering Biomedical Discovery with Deep Knowledge Graph Researchcited by 2

50 most cited of 73 All 73 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2023On Exploring the Reasoning Capability of Large Language Models with Knowledge Graphs
  2. 2023Graph of Thoughts: Solving Elaborate Problems with Large Language Models
  3. 2025Mapping the Minds of LLMs: A Graph-Based Analysis of Reasoning LLM
  4. 2023Boosting Language Models Reasoning with Chain-of-Knowledge Prompting
  5. 2026Visual Graph Scaffolds for Structural Reasoning in Large Language Models
  6. 2023Why Can Large Language Models Generate Correct Chain-of-Thoughts?
  7. 2024An Enhanced Prompt-Based LLM Reasoning Scheme via Knowledge Graph-Integrated Collaboration
  8. 2024Thinking with Knowledge Graphs: Enhancing LLM Reasoning Through Structured Data