mlsanityData to 14 Oct 2026

Text-Augmented Open Knowledge Graph Completion via Pre-Trained Language Models

arXiv 2305.15597 ↗First posted 24 May 2023cs.CL cs.AI cs.IRcited by 8

Not on the map. Why?

Abstract (arXiv)

The mission of open knowledge graph (KG) completion is to draw new findings from known facts. Existing works that augment KG completion require either (1) factual triples to enlarge the graph reasoning space or (2) manually designed prompts to extract knowledge from a pre-trained language model (PLM), exhibiting limited performance and requiring expensive efforts from experts. To this end, we propose TAGREAL that automatically generates quality query prompts and retrieves support information from large text corpora to probe knowledge from PLM for KG completion. The results show that TAGREAL achieves state-of-the-art performance on two benchmark datasets. We find that TAGREAL has superb performance even with limited training data, outperforming existing embedding-based, graph-based, and PLM-based methods.

Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 29 of its 48 references that are in the map. First posted on arXiv 24 May 2023.

Builds on

29 of 48 references.

References · 29

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2020Language Models are Few-Shot Learnerscited by 32,419
  3. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
  4. 2019Language Models as Knowledge Bases?cited by 1,936
  5. 2019How Can We Know What Language Models Know?cited by 959
  6. 2014Embedding Entities and Relations for Learning and Inference in Knowledge Basescited by 932
  7. 2016Complex Embeddings for Simple Link Predictioncited by 902
  8. 2019RotatE: Knowledge Graph Embedding by Relational Rotation in Complex Spacecited by 898
  9. 2017Convolutional 2D Knowledge Graph Embeddingscited by 730
  10. 2020Knowledge Graphscited by 621
  11. 2021QA-GNN: Reasoning with Language Models and Knowledge Graphs for Question Answeringcited by 388
  12. 2020LUKE: Deep Contextualized Entity Representations with Entity-aware Self-attentioncited by 326
17 more
  1. 2019KG-BERT: BERT for Knowledge Graph Completioncited by 324
  2. 2019TuckER: Tensor Factorization for Knowledge Graph Completioncited by 290
  3. 2018Modeling polypharmacy side effects with graph convolutional networkscited by 237
  4. 2020Self-Alignment Pretraining for Biomedical Entity Representationscited by 237
  5. 2017Go for a Walk and Arrive at the Answer: Reasoning Over Paths in Knowledge Bases using Reinforcement Learningcited by 161
  6. 2022A Review on Language Models as Knowledge Basescited by 157
  7. 2018Embedding Logical Queries on Knowledge Graphscited by 120
  8. 2017Automated Phrase Mining from Massive Text Corporacited by 70
  9. 2017Open-World Knowledge Graph Completioncited by 64
  10. 2021Variational Information Bottleneck for Effective Low-Resource Fine-Tuningcited by 51
  11. 2020Interactive Recommender System via Knowledge Graph-enhanced Reinforcement Learningcited by 40
  12. 2018Differentiating Concepts and Instances for Knowledge Graph Embeddingcited by 27
  13. 2020Empower Entity Set Expansion via Language Model Probingcited by 25
  14. 2021Incorporating Commonsense Knowledge Graph in Pretrained Models for Social Commonsense Taskscited by 24
  15. 2019Collaborative Policy Learning for Open Knowledge Graph Reasoningcited by 18
  16. 2017MetaPAD: Meta Pattern Discovery from Massive Text Corporacited by 12
  17. 2019Transfer Fine-Tuning: A BERT Case Studycited by 8

Built on by

Cited by year

Citing papers per year: 2023: 1; 2024: 5; 2025: 2.

8 papers.

  1. 2023When Large Language Models Meet Personalization: Perspectives of Challenges and Opportunitiescited by 90
  2. 2024Multi-perspective Improvement of Knowledge Graph Completion with Large Language Modelscited by 20
  3. 2024Automated Construction of Theme-specific Knowledge Graphscited by 16
  4. 2024KG-FIT: Knowledge Graph Fine-Tuning Upon Open-World Knowledgecited by 16
  5. 2025A Survey on Retrieval And Structuring Augmented Generation with Large Language Modelscited by 8
  6. 2025Enhancing Large Language Model for Knowledge Graph Completion via Structure-Aware Alignment-Tuningcited by 4
  7. 2024KC-GenRe: A Knowledge-constrained Generative Re-ranking Method Based on Large Language Models for Knowledge Graph Completioncited by 1
  8. 2024Learning Rules from KGs Guided by Language Modelscited by 0