mlsanityData to 14 Oct 2026

KG-Agent: An Efficient Autonomous Agent Framework for Complex Reasoning over Knowledge Graph

arXiv 2402.11163 ↗First posted 17 Feb 2024cs.CLcited by 93

On the map: LLM reasoning → Knowledge- and tool-augmented reasoning

also in 1 more
Abstract (arXiv)

In this paper, we aim to improve the reasoning ability of large language models (LLMs) over knowledge graphs (KGs) to answer complex questions. Inspired by existing methods that design the interaction strategy between LLMs and KG, we propose an autonomous LLM-based agent framework, called KG-Agent, which enables a small LLM to actively make decisions until finishing the reasoning process over KGs. In KG-Agent, we integrate the LLM, multifunctional toolbox, KG-based executor, and knowledge memory, and develop an iteration mechanism that autonomously selects the tool then updates the memory for reasoning over KG. To guarantee the effectiveness, we leverage program language to formulate the multi-hop reasoning process over the KG, and synthesize a code-based instruction dataset to fine-tune the base LLM. Extensive experiments demonstrate that only using 10K samples for tuning LLaMA-7B can outperform state-of-the-art methods using larger LLMs or more data, on both in-domain and out-domain datasets. Our code and data will be publicly released.

Key facts. Cited by 93 papers in the map (data through 14 Oct 2026). Placed in Knowledge- and tool-augmented reasoning, one of 17 directions in LLM reasoning. Builds on 39 of its 49 references that are in the map. First posted on arXiv 17 Feb 2024.

Builds on

39 of 49 references.

Closest ancestors · 3

Same direction, newest first

  1. 2023ReasoningLM: Enabling Structural Subgraph Reasoning in Pre-trained Language Models for Question Answering over Knowledge Graph30 Dec
  2. 2023Reasoning on Graphs: Faithful and Interpretable Large Language Model Reasoning2 Oct
  3. 2022UniKGQA: Unified Retrieval and Reasoning for Solving Multi-hop Question Answering Over Knowledge Graph2 Dec

Other references · 36

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  3. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  4. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
  5. 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,673
  6. 2022Scaling Instruction-Finetuned Language Modelscited by 3,024
  7. 2017TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehensioncited by 2,955
  8. 2023A Survey on Large Language Model based Autonomous Agentscited by 2,242
  9. 2023Code Llama: Open Foundation Models for Codecited by 2,139
  10. 2021WebGPT: Browser-assisted question-answering with human feedbackcited by 1,745
  11. 2017Modeling Relational Data with Graph Convolutional Networkscited by 1,694
  12. 2017Reading Wikipedia to Answer Open-Domain Questionscited by 777
24 more
  1. 2020How Much Knowledge Can You Pack Into the Parameters of a Language Model?cited by 719
  2. 2023Unifying Large Language Models and Knowledge Graphs: A Roadmapcited by 668
  3. 2023MM-REACT: Prompting ChatGPT for Multimodal Reasoning and Actioncited by 517
  4. 2018The Web as a Knowledge-base for Answering Complex Questionscited by 410
  5. 2020TaBERT: Pretraining for Joint Understanding of Textual and Tabular Datacited by 398
  6. 2023StructGPT: A General Framework for Large Language Model to Reason over Structured Datacited by 343
  7. 2022UnifiedSKG: Unifying and Multi-Tasking Structured Knowledge Grounding with Text-to-Text Language Modelscited by 231
  8. 2016Key-Value Memory Networks for Directly Reading Documentscited by 223
  9. 2020Beyond I.I.D.: Three Levels of Generalization for Question Answering on Knowledge Basescited by 171
  10. 2017Variational Reasoning for Question Answering with Knowledge Graphcited by 170
  11. 2018Open Domain Question Answering Using Early Fusion of Knowledge Bases and Textcited by 168
  12. 2021ExT5: Towards Extreme Multi-Task Scaling for Transfer Learningcited by 161
  13. 2023ChatDB: Augmenting LLMs with Databases as Their Symbolic Memorycited by 140
  14. 2021Improving Multi-hop Knowledge Base Question Answering by Learning Intermediate Supervision Signalscited by 101
  15. 2022Subgraph Retrieval Enhanced Model for Multi-hop Knowledge Base Question Answeringcited by 93
  16. 2021RnG-KBQA: Generation Augmented Iterative Ranking for Knowledge Base Question Answeringcited by 86
  17. 2020KQA Pro: A Dataset with Explicit Compositional Programs for Complex Question Answering over Knowledge Basecited by 78
  18. 2022TIARA: Multi-grained Retrieval for Robust Question Answering over Large Knowledge Basescited by 59
  19. 2022Don't Generate, Discriminate: A Proposal for Grounding Language Models to Real-World Environmentscited by 57
  20. 2021Complex Knowledge Base Question Answering: A Surveycited by 52
  21. 2023Do Large Language Models Know about Facts?cited by 51
  22. 2022ArcaneQA: Dynamic Program Induction and Contextualized Encoding for Knowledge Base Question Answeringcited by 48
  23. 2022UniParser: A Unified Log Parser for Heterogeneous Log Datacited by 26
  24. 2023FC-KBQA: A Fine-to-Coarse Composition Framework for Knowledge Base Question Answeringcited by 21

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 22; 2025: 46; 2026: 25.

93 papers.

Sort:

By area:

  1. 2024Graph Retrieval-Augmented Generation: A Surveycited by 324
  2. 2024Retrieval-Augmented Generation with Graphs (GraphRAG)cited by 172
  3. 2025A Survey of Context Engineering for Large Language Modelscited by 126
  4. 2024AriGraph: Learning Knowledge Graph World Models with Episodic Memory for LLM Agentscited by 102
  5. 2024Simple Is Effective: The Roles of Graphs and Large Language Models in Knowledge-Graph-Based Retrieval-Augmented Generationcited by 80
  6. 2024KnowAgent: Knowledge-Augmented Planning for LLM-Based Agentscited by 61
  7. 2024Graph-constrained Reasoning: Faithful Reasoning on Knowledge Graphs with Large Language Modelscited by 48
  8. 2024Auto-RAG: Autonomous Retrieval-Augmented Generation for Large Language Modelscited by 43
  9. 2024FlowBench: Revisiting and Benchmarking Workflow-Guided Planning for LLM-based Agentscited by 40
  10. 2024Graph Machine Learning in the Era of Large Language Models (LLMs)cited by 33
  11. 2025AgentRouter: A Knowledge-Graph-Guided LLM Router for Collaborative Multi-Agent Question Answeringcited by 32
  12. 2025Large Language Models Meet Knowledge Graphs for Question Answering: Synthesis and Opportunitiescited by 31
38 more
  1. 2024Interactive-KBQA: Multi-Turn Interactions for Knowledge Base Question Answering with Large Language Modelscited by 25
  2. 2026Graph-based Agent Memory: Taxonomy, Techniques, and Applicationscited by 25
  3. 2025Graphs Meet AI Agents: Taxonomy, Progress, and Future Opportunitiescited by 23
  4. 2025Reasoning of Large Language Models over Knowledge Graphs with Super-Relationscited by 21
  5. 2024Small Agent Can Also Rock! Empowering Small Language Models as Hallucination Detectorcited by 20
  6. 2024Debate on Graph: a Flexible and Reliable Reasoning Framework for Large Language Modelscited by 19
  7. 2024GraphOTTER: Evolving LLM-based Graph Reasoning for Complex Table Question Answeringcited by 18
  8. 2025Large language models for artificial general intelligence (AGI): A survey of foundational principles and approachescited by 18
  9. 2025Graph-based Approaches and Functionalities in Retrieval-Augmented Generation: A Comprehensive Surveycited by 18
  10. 2025Graph-Augmented Large Language Model Agents: Current Progress and Future Prospectscited by 14
  11. 2025Simulating Society Requires Simulating Thoughtcited by 13
  12. 2025VistaWise: Building Cost-Effective Agent with Cross-Modal Knowledge Graph for Minecraftcited by 13
  13. 2024SQLFixAgent: Towards Semantic-Accurate Text-to-SQL Parsing via Consistency-Enhanced Multi-Agent Collaborationcited by 11
  14. 2024Knowledge Graph Enhanced Language Agents for Recommendationcited by 11
  15. 2024BioKGBench: A Knowledge Graph Checking Benchmark of AI Agent for Biomedical Sciencecited by 10
  16. 2025Memory-augmented Query Reconstruction for LLM-based Knowledge Graph Reasoningcited by 10
  17. 2025Agent-S: LLM Agentic workflow to automate Standard Operating Procedurescited by 10
  18. 2025BYOKG-RAG: Multi-Strategy Graph Retrieval for Knowledge Graph Question Answeringcited by 10
  19. 2025NG-Router: Graph-Supervised Multi-Agent Collaboration for Nutrition Question Answeringcited by 10
  20. 2025Align-GRAG: Anchor and Rationale Guided Dual Alignment for Graph Retrieval-Augmented Generationcited by 9
  21. 2024Complex Reasoning over Logical Queries on Commonsense Knowledge Graphscited by 8
  22. 2025FRAG: A Flexible Modular Framework for Retrieval-Augmented Generation based on Knowledge Graphscited by 8
  23. 2025MCTS-KBQA: Monte Carlo Tree Search with Information Gain Rewards for Knowledge Base Question Answeringcited by 7
  24. 2026Agentic Trading: When LLM Agents Meet Financial Marketscited by 7
  25. 2025Learning to Retrieve and Reason on Knowledge Graph through Active Self-Reflectioncited by 6
  26. 2025Reasoning by Exploration: A Unified Approach to Retrieval and Generation over Graphscited by 6
  27. 2025Experience-Evolving Multi-Turn Tool-Use Agent with Hybrid Episodic-Procedural Memorycited by 6
  28. 2026GraphWalker: Agentic Knowledge Graph Question Answering via Synthetic Trajectory Curriculumcited by 6
  29. 2024LLM-based Discriminative Reasoning for Knowledge Graph Question Answeringcited by 5
  30. 2024TARGA: Targeted Synthetic Data Generation for Practical Reasoning over Structured Datacited by 5
  31. 2025Learning Efficient and Generalizable Graph Retriever for Knowledge-Graph Question Answeringcited by 5
  32. 2025Search-on-Graph: Iterative Informed Navigation for Large Language Model Reasoning on Knowledge Graphscited by 5
  33. 2025Cache Mechanism for Agent RAG Systemscited by 5
  34. 2025Multi-Agent GraphRAG: A Text-to-Cypher Framework for Labeled Property Graphscited by 5
  35. 2024MathLearner: A Large Language Model Agent Framework for Learning to Solve Mathematical Problemscited by 4
  36. 2025HealthGenie: Empowering Users with Healthy Dietary Guidance through Knowledge Graph and Large Language Modelscited by 4
  37. 2025Temporal Reasoning with Large Language Models Augmented by Evolving Knowledge Graphscited by 4
  38. 2025RJE: A Retrieval-Judgment-Exploration Framework for Efficient Knowledge Graph Question Answering with LLMscited by 4

50 most cited of 93 All 93 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2026KG-Reasoner: A Reinforced Model for End-to-End Multi-Hop Knowledge Graph Reasoning
  2. 2026KG-Hopper: Empowering Compact Open LLMs with Knowledge Graph Reasoning via Reinforcement Learning
  3. 2023Think-on-Graph: Deep and Responsible Reasoning of Large Language Model on Knowledge Graph
  4. 2025KG-o1: Enhancing Multi-hop Question Answering in Large Language Models via Knowledge Graph Integration
  5. 2025SymAgent: A Neural-Symbolic Self-Learning Agent Framework for Complex Reasoning over Knowledge Graphs
  6. 2024KG-RAG: Bridging the Gap Between Knowledge and Creativity
  7. 2024Thinking with Knowledge Graphs: Enhancing LLM Reasoning Through Structured Data
  8. 2026RACER: Reinforced Agent Collaboration for Explainable Reasoning on Knowledge Graphs