mlsanityData to 14 Oct 2026

Knowledge Graph Large Language Model (KG-LLM) for Link Prediction

arXiv 2403.07311 ↗First posted 12 Mar 2024cs.CL cs.LGcited by 36

Not on the map. Why?

Abstract (arXiv)

The task of multi-hop link prediction within knowledge graphs (KGs) stands as a challenge in the field of knowledge graph analysis, as it requires the model to reason through and understand all intermediate connections before making a prediction. In this paper, we introduce the Knowledge Graph Large Language Model (KG-LLM), a novel framework that leverages large language models (LLMs) for knowledge graph tasks. We first convert structured knowledge graph data into natural language and then use these natural language prompts to fine-tune LLMs to enhance multi-hop link prediction in KGs. By converting the KG to natural language prompts, our framework is designed to learn the latent representations of entities and their interrelations. To show the efficacy of the KG-LLM Framework, we fine-tune three leading LLMs within this framework, including Flan-T5, LLaMa2 and Gemma. Further, we explore the framework's potential to provide LLMs with zero-shot capabilities for handling previously unseen prompts. Experimental results show that KG-LLM significantly improves the models' generalization capabilities, leading to more accurate predictions in unfamiliar scenarios.

Key facts. Cited by 36 papers in the map (data through 14 Oct 2026). Builds on 24 of its 42 references that are in the map. First posted on arXiv 12 Mar 2024.

Builds on

24 of 42 references.

References · 24

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2020Language Models are Few-Shot Learnerscited by 32,419
  3. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  4. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  5. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  6. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  7. 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,780
  8. 2022Emergent Abilities of Large Language Modelscited by 2,512
  9. 2021An Explanation of In-context Learning as Implicit Bayesian Inferencecited by 938
  10. 2014Embedding Entities and Relations for Learning and Inference in Knowledge Basescited by 932
  11. 2016Complex Embeddings for Simple Link Predictioncited by 902
  12. 2023Instruction Tuning with GPT-4cited by 686
12 more
  1. 2019KG-BERT: BERT for Knowledge Graph Completioncited by 324
  2. 2015Holographic Embeddings of Knowledge Graphscited by 181
  3. 2020A Survey of Evaluation Metrics Used for NLG Systemscited by 164
  4. 2024The Impact of Reasoning Step Length on Large Language Modelscited by 153
  5. 2019Learning Attention-based Embeddings for Relation Prediction in Knowledge Graphscited by 125
  6. 2020JAKET: Joint Pre-training of Knowledge Graph and Language Understandingcited by 73
  7. 2017Analogical Inference for Multi-Relational Embeddingscited by 69
  8. 2024InstructGraph: Boosting Large Language Models via Graph-centric Instruction Tuning and Preference Alignmentcited by 56
  9. 2024GraphEdit: Large Language Models for Graph Structure Learningcited by 33
  10. 2024Graph-oriented Instruction Tuning of Large Language Models for Generic Graph Miningcited by 20
  11. 2022KGLM: Integrating Knowledge Graph Structure in Language Models for Link Predictioncited by 15
  12. 2021wsGAT: Weighted and Signed Graph Attention Networks for Link Predictioncited by 8

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 10; 2025: 19; 2026: 7.

36 papers.

Sort:

By area:

  1. 2025A Survey of Graph Retrieval-Augmented Generation for Customized Large Language Modelscited by 88
  2. 2024MoralBench: Moral Evaluation of LLMscited by 50
  3. 2024LawLLM: Law Large Language Model for the US Legal Systemcited by 37
  4. 2024When AI Meets Finance (StockAgent): Large Language Model-based Stock Trading in Simulated Real-world Environmentscited by 26
  5. 2025TRIX: A More Expressive Model for Zero-shot Domain Transfer in Knowledge Graphscited by 24
  6. 2025LLM as GNN: Graph Vocabulary Learning for Text-Attributed Graph Foundation Modelscited by 22
  7. 2024A Survey of Large Language Models on Generative Graph Analytics: Query, Learning, and Applicationscited by 17
  8. 2024Knowledge Graph Enhanced Language Agents for Recommendationcited by 11
  9. 2025Toward Reliable Scientific Hypothesis Generation: Evaluating Truthfulness and Hallucination in Large Language Modelscited by 9
  10. 2024CXSimulator: A User Behavior Simulation using LLM Embeddings for Web-Marketing Campaign Assessmentcited by 8
  11. 2025Biomedical Knowledge Graph: A Survey of Domains, Tasks, and Real-World Applicationscited by 6
  12. 2024RuAG: Learned-rule-augmented Generation for Large Language Modelscited by 5
24 more
  1. 2024Enabling Explainable Recommendation in E-commerce with LLM-powered Product Knowledge Graphcited by 5
  2. 2025Large Language Models for Knowledge Graph Embedding: A Surveycited by 3
  3. 2025From Documents to Dialogue: Building KG-RAG Enhanced AI Assistantscited by 3
  4. 2025SAM Guided Semantic and Motion Changed Region Mining for Remote Sensing Change Captioningcited by 3
  5. 2024Filter-then-Generate: Large Language Models with Structure-Text Adapter for Knowledge Graph Completioncited by 2
  6. 2025Node-as-Agent: Graph Agentic Networkcited by 2
  7. 2026Leveraging LLM-GNN Integration for Open-World Question Answering over Knowledge Graphscited by 2
  8. 2025Pseudo-Knowledge Graph: Meta-Path Guided Retrieval and In-Graph Text for RAG-Equipped LLMcited by 1
  9. 2025Enhancing Large Language Models (LLMs) for Telecommunications using Knowledge Graphs and Retrieval-Augmented Generationcited by 1
  10. 2025Toward Revealing Nuanced Biases in Medical LLMscited by 1
  11. 2025KG-EDAS: A Meta-Metric Framework for Evaluating Knowledge Graph Completion Modelscited by 1
  12. 2025Customized Retrieval-Augmented Generation with LLM for Debiasing Recommendation Unlearningcited by 1
  13. 2026OMNIA: Closing the Loop by Leveraging LLMs for Knowledge Graph Completioncited by 1
  14. 2026Integrating Graphs, Large Language Models, and Agents: Reasoning and Retrievalcited by 1
  15. 2024Large Language Models and Knowledge Graphs for Astronomical Entity Disambiguationcited by 0
  16. 2025Efficient and Privacy-Preserved Link Prediction via Condensed Graphscited by 0
  17. 2025Beyond Single Pass, Looping Through Time: KG-IRAG with Iterative Knowledge Retrievalcited by 0
  18. 2025Comparison of Metadata Representation Models for Knowledge Graph Embeddingscited by 0
  19. 2025GenIC: An LLM-Based Framework for Instance Completion in Knowledge Graphscited by 0
  20. 2025An Interdisciplinary and Cross-Task Review on Missing Data Imputationcited by 0
  21. 2026Bridging Graph Structure and Knowledge-Guided Editing for Interpretable Temporal Knowledge Graph Reasoningcited by 0
  22. 2026From Literature to Hypotheses: An AI Co-Scientist System for Biomarker-Guided Drug Combination Hypothesis Generationcited by 0
  23. 2026Learning Chain Of Thoughts Prompts for Predicting Entities, Relations, and even Literals on Knowledge Graphscited by 0
  24. 2026Advancing Edge Classification through High-Dimensional Causal Modeling of Node-Edge Interplaycited by 0