mlsanityData to 14 Oct 2026

Injecting Knowledge Graphs into Large Language Models

arXiv 2505.07554 ↗First posted 12 May 2025cs.LG cs.IRcited by 5

On the map: LLM reasoning → Knowledge- and tool-augmented reasoning

Abstract (arXiv)

Integrating structured knowledge from Knowledge Graphs (KGs) into Large Language Models (LLMs) remains a key challenge for symbolic reasoning. Existing methods mainly rely on prompt engineering or fine-tuning, which lose structural fidelity or incur high computational costs. Building on recent encoding techniques which integrate graph embeddings within the LLM input as tokens, we extend this paradigm to the KG domain by leveraging Knowledge Graph Embedding (KGE) models, thus enabling graph-aware reasoning. Our approach is model-agnostic, resource-efficient, and compatible with any LLMs. Extensive experimentation on synthetic and real-world datasets shows that our method improves reasoning performance over established baselines, further achieving the best trade-off in terms of accuracy and efficiency against state-of-the-art LLMs.

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Placed in Knowledge- and tool-augmented reasoning, one of 17 directions in LLM reasoning. Builds on 23 of its 46 references that are in the map. First posted on arXiv 12 May 2025.

Builds on

23 of 46 references.

Closest ancestors · 2

Same direction, newest first

  1. 2024Right for Right Reasons: Large Language Models for Verifiable Commonsense Knowledge Graph Question Answering3 Mar
  2. 2023Can Language Models Solve Graph Problems in Natural Language?17 May

Other references · 21

  1. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  2. 2020Language Models are Few-Shot Learnerscited by 32,419
  3. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  4. 2022Large Language Models are Zero-Shot Reasonerscited by 4,374
  5. 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,795
  6. 2018Graph Neural Networks: A Review of Methods and Applicationscited by 1,576
  7. 2016An overview of gradient descent optimization algorithmscited by 1,033
  8. 2014Embedding Entities and Relations for Learning and Inference in Knowledge Basescited by 932
  9. 2016Complex Embeddings for Simple Link Predictioncited by 902
  10. 2019RotatE: Knowledge Graph Embedding by Relational Rotation in Complex Spacecited by 898
  11. 2020TUDataset: A collection of benchmark datasets for learning with graphscited by 728
  12. 2020A Survey on Knowledge Graphs: Representation, Acquisition and Applicationscited by 643
9 more
  1. 2021QA-GNN: Reasoning with Language Models and Knowledge Graphs for Question Answeringcited by 388
  2. 2019PullNet: Open Domain Question Answering with Iterative Retrieval on Knowledge Bases and Textcited by 184
  3. 2018Open Domain Question Answering Using Early Fusion of Knowledge Bases and Textcited by 168
  4. 2024Let Your Graph Do the Talking: Encoding Structured Data for LLMscited by 118
  5. 2014Question Answering with Subgraph Embeddingscited by 58
  6. 2025A Survey of Large Language Model Agents for Question Answeringcited by 48
  7. 2024Recent Trends in Personalized Dialogue Generation: A Review of Datasets, Methodologies, and Evaluationscited by 20
  8. 2017Connectivity Inference from Neural Recording Data: Challenges, Mathematical Bases and Research Directionscited by 12
  9. 2025Bridging the Linguistic Divide: A Survey on Leveraging Large Language Models for Machine Translationcited by 8

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 3; 2026: 2.

5 papers.

  1. 2025A Survey of Context Engineering for Large Language Modelscited by 126
  2. 2026Think Locally, Explain Globally: Graph-Guided LLM Investigations via Local Reasoning and Belief Propagationcited by 3
  3. 2026KLDrive: Fine-Grained 3D Scene Reasoning for Autonomous Driving based on Knowledge Graphcited by 2
  4. 2025Multi-dimensional Data Analysis and Applications Basing on LLM Agents and Knowledge Graph Interactionscited by 1
  5. 2025Matching Game Preferences Through Dialogical Large Language Models: A Perspectivecited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025From Symbolic to Neural and Back: Exploring Knowledge Graph-Large Language Model Synergies
  2. 2024Graph-constrained Reasoning: Faithful Reasoning on Knowledge Graphs with Large Language Models
  3. 2024Thinking with Knowledge Graphs: Enhancing LLM Reasoning Through Structured Data
  4. 2023Reasoning on Graphs: Faithful and Interpretable Large Language Model Reasoning
  5. 2024Synergizing Knowledge Graphs with Large Language Models: A Comprehensive Review and Future Prospects ↗
  6. 2023Talk like a Graph: Encoding Graphs for Large Language Models
  7. 2025KG-LLM-Bench: A Scalable Benchmark for Evaluating LLM Reasoning on Textualized Knowledge Graphs
  8. 2025Beyond Textual Context: Structural Graph Encoding with Adaptive Space Alignment to alleviate the hallucination of LLMs