mlsanityData to 7 Oct 2026

Enhancing Text-based Knowledge Graph Completion with Zero-Shot Large Language Models: A Focus on Semantic Enhancement

arXiv 2310.08279 ↗First posted 12 Oct 2023cs.CL cs.AIcited by 14

Not on the map. Why?

Abstract (arXiv)

The design and development of text-based knowledge graph completion (KGC) methods leveraging textual entity descriptions are at the forefront of research. These methods involve advanced optimization techniques such as soft prompts and contrastive learning to enhance KGC models. The effectiveness of text-based methods largely hinges on the quality and richness of the training data. Large language models (LLMs) can utilize straightforward prompts to alter text data, thereby enabling data augmentation for KGC. Nevertheless, LLMs typically demand substantial computational resources. To address these issues, we introduce a framework termed constrained prompts for KGC (CP-KGC). This CP-KGC framework designs prompts that adapt to different datasets to enhance semantic richness. Additionally, CP-KGC employs a context constraint strategy to effectively identify polysemous entities within KGC datasets. Through extensive experimentation, we have verified the effectiveness of this framework. Even after quantization, the LLM (Qwen-7B-Chat-int4) still enhances the performance of text-based KGC methods footnoteCode and datasets are available at hrefhttps://github.com/sjlmg/CP-KGChttps://github.com/sjlmg/CP-KGC. This study extends the performance limits of existing models and promotes further integration of KGC with LLMs.

Key facts. Cited by 14 papers in the map (data through 7 Oct 2026). Builds on 28 of its 36 references that are in the map. First posted on arXiv 12 Oct 2023.

Builds on

28 of 36 references.

References · 28

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2020Language Models are Few-Shot Learnerscited by 32,199
  4. 2023GPT-4 Technical Reportcited by 18,132
  5. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  6. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  7. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  8. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  9. 2020Scaling Laws for Neural Language Modelscited by 6,411
  10. 2023Qwen Technical Reportcited by 3,273
  11. 2023A Survey of Large Language Modelscited by 2,537
  12. 2022Emergent Abilities of Large Language Modelscited by 2,483
16 more
  1. 2019Language Models as Knowledge Bases?cited by 1,922
  2. 2022Large Language Models Encode Clinical Knowledgecited by 1,807
  3. 2022Large Language Models Are Human-Level Prompt Engineerscited by 1,020
  4. 2019How Can We Know What Language Models Know?cited by 953
  5. 2014Embedding Entities and Relations for Learning and Inference in Knowledge Basescited by 929
  6. 2016Complex Embeddings for Simple Link Predictioncited by 897
  7. 2019RotatE: Knowledge Graph Embedding by Relational Rotation in Complex Spacecited by 893
  8. 2017Convolutional 2D Knowledge Graph Embeddingscited by 729
  9. 2023Unifying Large Language Models and Knowledge Graphs: A Roadmapcited by 663
  10. 2019KEPLER: A Unified Model for Knowledge Embedding and Pre-trained Language Representationcited by 356
  11. 2019KG-BERT: BERT for Knowledge Graph Completioncited by 323
  12. 2020AutoPrompt: Eliciting Knowledge from Language Models with Automatically Generated Promptscited by 246
  13. 2019PullNet: Open Domain Question Answering with Iterative Retrieval on Knowledge Bases and Textcited by 182
  14. 2022SimKGC: Simple Contrastive Knowledge Graph Completion with Pre-trained Language Modelscited by 90
  15. 2023Dipping PLMs Sauce: Bridging Structure and Text for Effective Knowledge Graph Completion via Conditional Soft Promptingcited by 33
  16. 2022Knowledge Is Flat: A Seq2Seq Generative Framework for Various Knowledge Graph Completioncited by 32

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 6; 2025: 7; 2026: 1.

14 papers.

Sort:

By area: