mlsanityData to 7 Oct 2026

KG-GPT: A General Framework for Reasoning on Knowledge Graphs Using Large Language Models

arXiv 2310.11220 ↗First posted 17 Oct 2023cs.CLcited by 32

On the map: LLM reasoning → Knowledge- and tool-augmented reasoning

Abstract (arXiv)

While large language models (LLMs) have made considerable advancements in understanding and generating unstructured text, their application in structured data remains underexplored. Particularly, using LLMs for complex reasoning tasks on knowledge graphs (KGs) remains largely untouched. To address this, we propose KG-GPT, a multi-purpose framework leveraging LLMs for tasks employing KGs. KG-GPT comprises three steps: Sentence Segmentation, Graph Retrieval, and Inference, each aimed at partitioning sentences, retrieving relevant graph components, and deriving logical conclusions, respectively. We evaluate KG-GPT using KG-based fact verification and KGQA benchmarks, with the model showing competitive and robust performance, even outperforming several fully-supervised models. Our work, therefore, marks a significant step in unifying structured and unstructured data processing within the realm of LLMs.

Key facts. Cited by 32 papers in the map (data through 7 Oct 2026). Placed in Knowledge- and tool-augmented reasoning, one of 17 directions in LLM reasoning. Builds on 16 of its 27 references that are in the map. First posted on arXiv 17 Oct 2023.

Builds on

16 of 27 references.

Closest ancestors · 1

Same direction, newest first

  1. 2022UniKGQA: Unified Retrieval and Reasoning for Solving Multi-hop Question Answering Over Knowledge Graph2 Dec

Other references · 15

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2023GPT-4 Technical Reportcited by 18,132
  3. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  4. 2021Training Verifiers to Solve Math Word Problemscited by 9,743
  5. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
  6. 2018CommonsenseQA: A Question Answering Challenge Targeting Commonsense Knowledgecited by 1,793
  7. 2023PaLM 2 Technical Reportcited by 1,154
  8. 2021Are NLP Models really able to Solve Simple Math Word Problems?cited by 861
  9. 2023StructGPT: A General Framework for Large Language Model to Reason over Structured Datacited by 339
  10. 2021A Diverse Corpus for Evaluating and Developing English Math Word Problem Solverscited by 314
  11. 2017Variational Reasoning for Question Answering with Knowledge Graphcited by 170
  12. 2018Open Domain Question Answering Using Early Fusion of Knowledge Bases and Textcited by 167
3 more
  1. 2019GEAR: Graph-based Evidence Aggregating and Reasoning for Fact Verificationcited by 100
  2. 2021Improving Multi-hop Knowledge Base Question Answering by Learning Intermediate Supervision Signalscited by 100
  3. 2023FactKG: Fact Verification via Reasoning on Knowledge Graphscited by 57

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 9; 2025: 16; 2026: 7.

32 papers.

Sort:

By area:

  1. 2024Simple Is Effective: The Roles of Graphs and Large Language Models in Knowledge-Graph-Based Retrieval-Augmented Generationcited by 78
  2. 2024InstructGraph: Boosting Large Language Models via Graph-centric Instruction Tuning and Preference Alignmentcited by 56
  3. 2024Graph Machine Learning in the Era of Large Language Models (LLMs)cited by 33
  4. 2024TC-RAG:Turing-Complete RAG's Case study on Medical LLM Systemscited by 28
  5. 2024Atomic Fact Decomposition Helps Attributed Question Answeringcited by 21
  6. 2024Neural-Symbolic Reasoning over Knowledge Graphs: A Survey from a Query Perspectivecited by 20
  7. 2024Prompt-SAW: Leveraging Relation-Aware Graphs for Textual Prompt Compressioncited by 18
  8. 2025Graph-based Approaches and Functionalities in Retrieval-Augmented Generation: A Comprehensive Surveycited by 18
  9. 2026EvolveRouter: Co-Evolving Routing and Prompt for Multi-Agent Question Answeringcited by 13
  10. 2024Evaluating the Factuality of Large Language Models using Large-Scale Knowledge Graphscited by 10
  11. 2025LightPROF: A Lightweight Reasoning Framework for Large Language Model on Knowledge Graphcited by 8
  12. 2025Graph-O1 : Monte Carlo Tree Search with Reinforcement Learning for Text-Attributed Graph Reasoningcited by 7
20 more
  1. 2025How to Mitigate Information Loss in Knowledge Graphs for GraphRAG: Leveraging Triple Context Restoration and Query-Driven Feedbackcited by 6
  2. 2025MAGIC: A Multi-Hop and Graph-Based Benchmark for Inter-Context Conflicts in Retrieval-Augmented Generationcited by 6
  3. 2025Learning Efficient and Generalizable Graph Retriever for Knowledge-Graph Question Answeringcited by 5
  4. 2024EHRCon: Dataset for Checking Consistency between Unstructured Notes and Structured Tables in Electronic Health Recordscited by 3
  5. 2025SAM Guided Semantic and Motion Changed Region Mining for Remote Sensing Change Captioningcited by 3
  6. 2025Lie to Me: Knowledge Graphs for Robust Hallucination Self-Detection in LLMscited by 3
  7. 2025Towards Self-cognitive Exploration: Metacognitive Knowledge Graph Retrieval Augmented Generationcited by 2
  8. 2025Towards Open-World Retrieval-Augmented Generation on Knowledge Graph: A Multi-Agent Collaboration Frameworkcited by 2
  9. 2026Multi-hop Reasoning and Retrieval in Embedding Space: Leveraging Large Language Models with Knowledgecited by 2
  10. 2025Knowledge Fusion via Bidirectional Information Aggregationcited by 1
  11. 2025Knowledge Reasoning Language Model: Unifying Knowledge and Language for Inductive Knowledge Graph Reasoningcited by 1
  12. 2025Discourse Graph Guided Document Translation with Large Language Modelscited by 1
  13. 2026When to Trust: A Causality-Aware Calibration Framework for Accurate Knowledge Graph Retrieval-Augmented Generationcited by 1
  14. 2025A Pilot Empirical Study on When and How to Use Knowledge Graphs as Retrieval Augmented Generationcited by 0
  15. 2025EMERGE: A Benchmark for Updating Knowledge Graphs with Emerging Textual Knowledgecited by 0
  16. 2025SHARP: Shared State Reduction for Efficient Matching of Sequential Patternscited by 0
  17. 2026The Initial Exploration Problem in Knowledge Graph Explorationcited by 0
  18. 2026From Unstructured to Structured: LLM-Guided Attribute Graphs for Entity Search and Rankingcited by 0
  19. 2026Structure-Internalized Rule Language Model for Faithful Knowledge Graph Reasoningcited by 0
  20. 2026Generating Biomedical Fact-Checking Reports with RL-Enhanced Agentic Searchcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025KG-LLM-Bench: A Scalable Benchmark for Evaluating LLM Reasoning on Textualized Knowledge Graphs
  2. 2023Reasoning on Graphs: Faithful and Interpretable Large Language Model Reasoning
  3. 2023LLMs for Knowledge Graph Construction and Reasoning: Recent Capabilities and Future Opportunities
  4. 2024Thinking with Knowledge Graphs: Enhancing LLM Reasoning Through Structured Data
  5. 2024Graph-constrained Reasoning: Faithful Reasoning on Knowledge Graphs with Large Language Models
  6. 2024Graph Chain-of-Thought: Augmenting Large Language Models by Reasoning on Graphs
  7. 2025Grounding LLM Reasoning with Knowledge Graphs
  8. 2023Unifying Large Language Models and Knowledge Graphs: A Roadmap