mlsanityData to 7 Oct 2026

KG-BERT: BERT for Knowledge Graph Completion

arXiv 1909.03193 ↗First posted 7 Sep 2019cs.CL cs.AIcited by 323

Not on the map. Why?

Cited by 33 in LLM reasoning, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

Knowledge graphs are important resources for many artificial intelligence tasks but often suffer from incompleteness. In this work, we propose to use pre-trained language models for knowledge graph completion. We treat triples in knowledge graphs as textual sequences and propose a novel framework named Knowledge Graph Bidirectional Encoder Representations from Transformer (KG-BERT) to model these triples. Our method takes entity and relation descriptions of a triple as input and computes scoring function of the triple with the KG-BERT language model. Experimental results on multiple benchmark knowledge graphs show that our method can achieve state-of-the-art performance in triple classification, link prediction and relation prediction tasks.

Key facts. Cited by 323 papers in the map (data through 7 Oct 2026). First posted on arXiv 7 Sep 2019.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 36; 2022: 71; 2023: 69; 2024: 63; 2025: 55; 2026: 29.

323 papers.

Sort:

By area:

  1. 2023Unifying Large Language Models and Knowledge Graphs: A Roadmapcited by 663
  2. 2023A Comprehensive Survey of AI-Generated Content (AIGC): A History of Generative AI from GAN to ChatGPTcited by 221
  3. 2022A Comprehensive Survey of Few-shot Learning: Evolution, Applications, Challenges, and Opportunitiescited by 162
  4. 2022A Review on Language Models as Knowledge Basescited by 156
  5. 2022Deep Bidirectional Language-Knowledge Graph Pretrainingcited by 156
  6. 2022SimKGC: Simple Contrastive Knowledge Graph Completion with Pre-trained Language Modelscited by 90
  7. 2024Plan-on-Graph: Self-Correcting Adaptive Planning of Large Language Model on Knowledge Graphscited by 77
  8. 2022Sequence-to-Sequence Knowledge Graph Completion and Question Answeringcited by 75
  9. 2021NodePiece: Compositional and Parameter-Efficient Representations of Large Knowledge Graphscited by 71
  10. 2023Large Language Models and Knowledge Graphs: Opportunities and Challengescited by 71
  11. 2023Knowledge Graphs: Opportunities and Challengescited by 70
  12. 2022Clinical-Longformer and Clinical-BigBird: Transformers for long clinical sequencescited by 67
38 more
  1. 2023GraphCare: Enhancing Healthcare Predictions with Personalized Knowledge Graphscited by 57
  2. 2024Knowledge Graphs Meet Multi-Modal Learning: A Comprehensive Surveycited by 50
  3. 2023Making Large Language Models Perform Better in Knowledge Graph Completioncited by 48
  4. 2022From Discrimination to Generation: Knowledge Graph Completion with Generative Transformercited by 45
  5. 2022Hybrid Transformer with Multi-level Fusion for Multimodal Knowledge Graph Completioncited by 44
  6. 2023Exploring Large Language Models for Knowledge Graph Completioncited by 43
  7. 2022Knowledge Graph Embedding: A Survey from the Perspective of Representation Spacescited by 41
  8. 2024From human experts to machines: An LLM supported approach to ontology and knowledge graph constructioncited by 40
  9. 2024KICGPT: Large Language Model with Knowledge in Context for Knowledge Graph Completioncited by 36
  10. 2024Knowledge Graph Large Language Model (KG-LLM) for Link Predictioncited by 36
  11. 2023A Comparative Study of Pretrained Language Models for Long Clinical Textcited by 35
  12. 2021Knowledge Enhanced Pretrained Language Models: A Compreshensive Surveycited by 33
  13. 2023Dipping PLMs Sauce: Bridging Structure and Text for Effective Knowledge Graph Completion via Conditional Soft Promptingcited by 33
  14. 2022Prompting as Probing: Using Language Models for Knowledge Base Constructioncited by 32
  15. 2022Knowledge Is Flat: A Seq2Seq Generative Framework for Various Knowledge Graph Completioncited by 32
  16. 2022Transfer Learning with Synthetic Corpora for Spatial Role Labeling and Reasoningcited by 32
  17. 2021Relational World Knowledge Representation in Contextual Language Models: A Reviewcited by 31
  18. 2021Meta-Knowledge Transfer for Inductive Knowledge Graph Embeddingcited by 31
  19. 2022Contextual Semantic Embeddings for Ontology Subsumption Predictioncited by 31
  20. 2022Relational Message Passing for Fully Inductive Knowledge Graph Completioncited by 29
  21. 2021Inductive Relation Prediction by BERTcited by 27
  22. 2021DISCOS: Bridging the Gap between Discourse Knowledge and Commonsense Knowledgecited by 26
  23. 2021Combining pre-trained language models and structured knowledgecited by 25
  24. 2023CAT: A Contextualized Conceptualization and Instantiation Framework for Commonsense Reasoningcited by 25
  25. 2022Relational Memory Augmented Language Modelscited by 24
  26. 2022Ontology-enhanced Prompt-tuning for Few-shot Learningcited by 24
  27. 2022Multilingual Knowledge Graph Completion with Self-Supervised Adaptive Graph Alignmentcited by 24
  28. 2021Scientific Language Models for Biomedical Knowledge Base Completion: An Empirical Studycited by 23
  29. 2021Zero-shot and Few-shot Learning with Knowledge Graphs: A Comprehensive Surveycited by 23
  30. 2023Editing Language Model-based Knowledge Graph Embeddingscited by 23
  31. 2021Improving Inductive Link Prediction Using Hyper-Relational Factscited by 21
  32. 2022BertNet: Harvesting Knowledge Graphs with Arbitrary Relations from Pretrained Language Modelscited by 20
  33. 2024Graph-Based Retriever Captures the Long Tail of Biomedical Knowledgecited by 20
  34. 2024Multi-perspective Improvement of Knowledge Graph Completion with Large Language Modelscited by 20
  35. 2022Knowledge Graph Completion with Pre-trained Multimodal Transformer and Twins Negative Samplingcited by 18
  36. 2022Tele-Knowledge Pre-training for Fault Analysiscited by 18
  37. 2024Contextualization Distillation from Large Language Model for Knowledge Graph Completioncited by 18
  38. 2022Acquiring and Modelling Abstract Commonsense Knowledge via Conceptualizationcited by 17

50 most cited of 323 All 323 (JSON)