Exploring Large Language Models for Knowledge Graph Completion
Not on the map. Why?
Abstract (arXiv)
Knowledge graphs play a vital role in numerous artificial intelligence tasks, yet they frequently face the issue of incompleteness. In this study, we explore utilizing Large Language Models (LLM) for knowledge graph completion. We consider triples in knowledge graphs as text sequences and introduce an innovative framework called Knowledge Graph LLM (KG-LLM) to model these triples. Our technique employs entity and relation descriptions of a triple as prompts and utilizes the response for predictions. Experiments on various benchmark knowledge graphs demonstrate that our method attains state-of-the-art performance in tasks such as triple classification and relation prediction. We also find that fine-tuning relatively smaller models (e.g., LLaMA-7B, ChatGLM-6B) outperforms recent ChatGPT and GPT-4.
Key facts. Cited by 43 papers in the map (data through 14 Oct 2026). Builds on 23 of its 46 references that are in the map. First posted on arXiv 26 Aug 2023.
Builds on
23 of 46 references.
References · 23
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2023GPT-4 Technical Reportcited by 18,396
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2023A Survey of Large Language Modelscited by 2,576
- 2021GLM: General Language Model Pretraining with Autoregressive Blank Infillingcited by 1,031
- 2014Embedding Entities and Relations for Learning and Inference in Knowledge Basescited by 932
- 2017Convolutional 2D Knowledge Graph Embeddingscited by 730
- 2021P-Tuning v2: Prompt Tuning Can Be Comparable to Fine-tuning Universally Across Scales and Taskscited by 689
- 2020A Survey on Knowledge Graphs: Representation, Acquisition and Applicationscited by 643
- 2019KG-BERT: BERT for Knowledge Graph Completioncited by 324
- 2019Learning Attention-based Embeddings for Relation Prediction in Knowledge Graphscited by 125
11 more
- 2023LLMs for Knowledge Graph Construction and Reasoning: Recent Capabilities and Future Opportunitiescited by 97
- 2022SimKGC: Simple Contrastive Knowledge Graph Completion with Pre-trained Language Modelscited by 91
- 2022Sequence-to-Sequence Knowledge Graph Completion and Question Answeringcited by 75
- 2019KBQA: Learning Question Answering over QA Corpora and Knowledge Basescited by 44
- 2022Knowledge Is Flat: A Seq2Seq Generative Framework for Various Knowledge Graph Completioncited by 32
- 2015TransG : A Generative Mixture Model for Knowledge Graph Embeddingcited by 28
- 2016SSP: Semantic Space Projection for Knowledge Graph Embedding with Text Descriptionscited by 18
- 2016Knowledge Graph Representation with Jointly Structural and Textual Encodingcited by 17
- 2022KGLM: Integrating Knowledge Graph Structure in Language Models for Link Predictioncited by 15
- 2018DOLORES: Deep Contextualized Knowledge Graph Embeddingscited by 11
- 2022LambdaKG: A Library for Pre-trained Language Model-Based Knowledge Graph Embeddingscited by 5
Built on by
Citing papers per year: 2023: 2; 2024: 19; 2025: 16; 2026: 6.
43 papers.
Sort:
By area:
- 2024From Local to Global: A Graph RAG Approach to Query-Focused Summarizationcited by 1,453
- 2024From Isolated Conversations to Hierarchical Schemas: Dynamic Tree Memory Representation for LLMscited by 79
- 2024GRAG: Graph Retrieval-Augmented Generationcited by 78
- 2024Knowledge Graphs Meet Multi-Modal Learning: A Comprehensive Surveycited by 53
- 2023Making Large Language Models Perform Better in Knowledge Graph Completioncited by 48
- 2024Graph Machine Learning in the Era of Large Language Models (LLMs)cited by 33
- 2025TRIX: A More Expressive Model for Zero-shot Domain Transfer in Knowledge Graphscited by 24
- 2024MKGL: Mastery of a Three-Word Languagecited by 17
- 2025GraphEval: A Lightweight Graph-Based LLM Framework for Idea Evaluationcited by 17
- 2024KG-FIT: Knowledge Graph Fine-Tuning Upon Open-World Knowledgecited by 16
- 2024UrbanKGent: A Unified Large Language Model Agent Framework for Urban Knowledge Graph Constructioncited by 15
- 2023Enhancing Emergency Decision-making with Knowledge Graphs and Large Language Modelscited by 12
31 more
- 2024Large Language Model Enhanced Knowledge Representation Learning: A Surveycited by 7
- 2024Scaling Knowledge Graph Construction through Synthetic Data Generation and Distillationcited by 6
- 2024KGValidator: A Framework for Automatic Validation of Knowledge Graph Constructioncited by 5
- 2024Finetuning Generative Large Language Models with Discrimination Instructions for Knowledge Graph Completioncited by 5
- 2024A Condensed Transition Graph Framework for Zero-shot Link Prediction with Large Language Modelscited by 3
- 2024Embedding Ontologies via Incorporating Extensional and Intensional Knowledgecited by 2
- 2024A Self-matching Training Method with Annotation Embedding Models for Ontology Subsumption Predictioncited by 2
- 2024Multi-level Shared Knowledge Guided Learning for Knowledge Graph Completioncited by 2
- 2025Neuro-Symbolic Frameworks: Conceptual Characterization and Empirical Comparative Analysiscited by 2
- 2025On the Problem of Consistent Anomalies in Zero-Shot Industrial Anomaly Detectioncited by 2
- 2024Is Large Language Model Good at Triple Set Prediction? An Empirical Studycited by 1
- 2025KG-CF: Knowledge Graph Completion with Context Filtering under the Guidance of Large Language Modelscited by 1
- 2025Enhancing Knowledge Graph Construction: Evaluating with Emphasis on Hallucination, Omission, and Graph Similarity Metricscited by 1
- 2025Talking to GDELT Through Knowledge Graphscited by 1
- 2025KG-BiLM: Knowledge Graph Embedding via Bidirectional Language Modelscited by 1
- 2025KG2QA: Knowledge Graph-enhanced Retrieval-augmented Generation for Communication Standards Question Answeringcited by 1
- 2025Ontology-Enhanced Knowledge Graph Completion using Large Language Modelscited by 1
- 2025Knowledge Graph-Guided Multi-Agent Distillation for Reliable Industrial Question Answering with Datasetscited by 1
- 2025Knowledge Reasoning Language Model: Unifying Knowledge and Language for Inductive Knowledge Graph Reasoningcited by 1
- 2026OMNIA: Closing the Loop by Leveraging LLMs for Knowledge Graph Completioncited by 1
- 2024FLAME: Empowering Frozen LLMs for Knowledge Graph Completioncited by 0
- 2024Deep Sparse Latent Feature Models for Knowledge Graph Completioncited by 0
- 2025Error-Aware Curriculum Learning for Biomedical Relation Classificationcited by 0
- 2025Evo-DKD: Dual-Knowledge Decoding for Autonomous Ontology Evolution in Large Language Modelscited by 0
- 2025An Interdisciplinary and Cross-Task Review on Missing Data Imputationcited by 0
- 2025HyperComplEx: Adaptive Multi-Space Knowledge Graph Embeddingscited by 0
- 2026SASA: Semantic-Aware Contrastive Learning Framework with Separated Attention for Triple Classificationcited by 0
- 2026FactNet: A Billion-Scale Knowledge Graph for Multilingual Factual Groundingcited by 0
- 2026Intent-Driven Smart Manufacturing Integrating Knowledge Graphs and Large Language Modelscited by 0
- 2026Performance Evaluation of LLMs in Automated RDF Knowledge Graph Generationcited by 0
- 2026The Illusion of Replacement: Rethinking Specialized Machine Learning Models in the Foundation Model Eracited by 0
- 2026The Illusion of Replacement: Rethinking Specialized Machine Learning Models in the Foundation Model Era29 Aug 2026
- 2026OMNIA: Closing the Loop by Leveraging LLMs for Knowledge Graph Completion12 Mar 2026
- 2026Intent-Driven Smart Manufacturing Integrating Knowledge Graphs and Large Language Models12 Feb 2026
- 2026Performance Evaluation of LLMs in Automated RDF Knowledge Graph Generation6 Feb 2026
- 2026FactNet: A Billion-Scale Knowledge Graph for Multilingual Factual Grounding3 Feb 2026
- 2026SASA: Semantic-Aware Contrastive Learning Framework with Separated Attention for Triple Classification19 Jan 2026
- 2025HyperComplEx: Adaptive Multi-Space Knowledge Graph Embeddings13 Nov 2025
- 2025An Interdisciplinary and Cross-Task Review on Missing Data Imputation3 Nov 2025
- 2025Knowledge Reasoning Language Model: Unifying Knowledge and Language for Inductive Knowledge Graph Reasoning15 Oct 2025
- 2025On the Problem of Consistent Anomalies in Zero-Shot Industrial Anomaly Detection12 Oct 2025
- 2025Knowledge Graph-Guided Multi-Agent Distillation for Reliable Industrial Question Answering with Datasets3 Oct 2025
- 2025Neuro-Symbolic Frameworks: Conceptual Characterization and Empirical Comparative Analysis8 Sep 2025
31 more
- 2025Evo-DKD: Dual-Knowledge Decoding for Autonomous Ontology Evolution in Large Language Models29 Jul 2025
- 2025Ontology-Enhanced Knowledge Graph Completion using Large Language Models28 Jul 2025
- 2025Error-Aware Curriculum Learning for Biomedical Relation Classification18 Jul 2025
- 2025KG2QA: Knowledge Graph-enhanced Retrieval-augmented Generation for Communication Standards Question Answering8 Jun 2025
- 2025KG-BiLM: Knowledge Graph Embedding via Bidirectional Language Models4 Jun 2025
- 2025GraphEval: A Lightweight Graph-Based LLM Framework for Idea Evaluation16 Mar 2025
- 2025Talking to GDELT Through Knowledge Graphs10 Mar 2025
- 2025TRIX: A More Expressive Model for Zero-shot Domain Transfer in Knowledge Graphs26 Feb 2025
- 2025Enhancing Knowledge Graph Construction: Evaluating with Emphasis on Hallucination, Omission, and Graph Similarity Metrics7 Feb 2025
- 2025KG-CF: Knowledge Graph Completion with Context Filtering under the Guidance of Large Language Models6 Jan 2025
- 2024Is Large Language Model Good at Triple Set Prediction? An Empirical Study24 Dec 2024
- 2024Deep Sparse Latent Feature Models for Knowledge Graph Completion24 Nov 2024
- 2024Scaling Knowledge Graph Construction through Synthetic Data Generation and Distillation22 Oct 2024
- 2024From Isolated Conversations to Hierarchical Schemas: Dynamic Tree Memory Representation for LLMs17 Oct 2024
- 2024MKGL: Mastery of a Three-Word Language10 Oct 2024
- 2024FLAME: Empowering Frozen LLMs for Knowledge Graph Completion13 Aug 2024
- 2024Finetuning Generative Large Language Models with Discrimination Instructions for Knowledge Graph Completion23 Jul 2024
- 2024Large Language Model Enhanced Knowledge Representation Learning: A Survey1 Jul 2024
- 2024GRAG: Graph Retrieval-Augmented Generation26 May 2024
- 2024KG-FIT: Knowledge Graph Fine-Tuning Upon Open-World Knowledge26 May 2024
- 2024Multi-level Shared Knowledge Guided Learning for Knowledge Graph Completion8 May 2024
- 2024From Local to Global: A Graph RAG Approach to Query-Focused Summarization24 Apr 2024
- 2024KGValidator: A Framework for Automatic Validation of Knowledge Graph Construction24 Apr 2024
- 2024Graph Machine Learning in the Era of Large Language Models (LLMs)23 Apr 2024
- 2024A Self-matching Training Method with Annotation Embedding Models for Ontology Subsumption Prediction26 Feb 2024
- 2024A Condensed Transition Graph Framework for Zero-shot Link Prediction with Large Language Models16 Feb 2024
- 2024UrbanKGent: A Unified Large Language Model Agent Framework for Urban Knowledge Graph Construction10 Feb 2024
- 2024Knowledge Graphs Meet Multi-Modal Learning: A Comprehensive Survey8 Feb 2024
- 2024Embedding Ontologies via Incorporating Extensional and Intensional Knowledge20 Jan 2024
- 2023Enhancing Emergency Decision-making with Knowledge Graphs and Large Language Models15 Nov 2023
- 2023Making Large Language Models Perform Better in Knowledge Graph Completion10 Oct 2023
- 2024From Local to Global: A Graph RAG Approach to Query-Focused Summarizationcited by 1,453
- 2024GRAG: Graph Retrieval-Augmented Generationcited by 78
- 2025Talking to GDELT Through Knowledge Graphscited by 1
- 2025KG2QA: Knowledge Graph-enhanced Retrieval-augmented Generation for Communication Standards Question Answeringcited by 1
- 2025KG2QA: Knowledge Graph-enhanced Retrieval-augmented Generation for Communication Standards Question Answering8 Jun 2025
- 2025Talking to GDELT Through Knowledge Graphs10 Mar 2025
- 2024GRAG: Graph Retrieval-Augmented Generation26 May 2024
- 2024From Local to Global: A Graph RAG Approach to Query-Focused Summarization24 Apr 2024
- 2024From Isolated Conversations to Hierarchical Schemas: Dynamic Tree Memory Representation for LLMscited by 79
- 2024Knowledge Graphs Meet Multi-Modal Learning: A Comprehensive Surveycited by 53
- 2023Making Large Language Models Perform Better in Knowledge Graph Completioncited by 48
- 2024Graph Machine Learning in the Era of Large Language Models (LLMs)cited by 33
- 2025TRIX: A More Expressive Model for Zero-shot Domain Transfer in Knowledge Graphscited by 24
- 2024MKGL: Mastery of a Three-Word Languagecited by 17
- 2025GraphEval: A Lightweight Graph-Based LLM Framework for Idea Evaluationcited by 17
- 2024KG-FIT: Knowledge Graph Fine-Tuning Upon Open-World Knowledgecited by 16
- 2023Enhancing Emergency Decision-making with Knowledge Graphs and Large Language Modelscited by 12
- 2024Large Language Model Enhanced Knowledge Representation Learning: A Surveycited by 7
- 2024KGValidator: A Framework for Automatic Validation of Knowledge Graph Constructioncited by 5
- 2024Finetuning Generative Large Language Models with Discrimination Instructions for Knowledge Graph Completioncited by 5
12 most cited of 35 All 35 (JSON)
- 2026The Illusion of Replacement: Rethinking Specialized Machine Learning Models in the Foundation Model Era29 Aug 2026
- 2026OMNIA: Closing the Loop by Leveraging LLMs for Knowledge Graph Completion12 Mar 2026
- 2026Intent-Driven Smart Manufacturing Integrating Knowledge Graphs and Large Language Models12 Feb 2026
- 2026Performance Evaluation of LLMs in Automated RDF Knowledge Graph Generation6 Feb 2026
- 2026FactNet: A Billion-Scale Knowledge Graph for Multilingual Factual Grounding3 Feb 2026
- 2026SASA: Semantic-Aware Contrastive Learning Framework with Separated Attention for Triple Classification19 Jan 2026
- 2025HyperComplEx: Adaptive Multi-Space Knowledge Graph Embeddings13 Nov 2025
- 2025An Interdisciplinary and Cross-Task Review on Missing Data Imputation3 Nov 2025
- 2025On the Problem of Consistent Anomalies in Zero-Shot Industrial Anomaly Detection12 Oct 2025
- 2025Neuro-Symbolic Frameworks: Conceptual Characterization and Empirical Comparative Analysis8 Sep 2025
- 2025Evo-DKD: Dual-Knowledge Decoding for Autonomous Ontology Evolution in Large Language Models29 Jul 2025
- 2025Ontology-Enhanced Knowledge Graph Completion using Large Language Models28 Jul 2025
12 newest of 35 All 35 (JSON)