mlsanityData to 14 Oct 2026

Dipping PLMs Sauce: Bridging Structure and Text for Effective Knowledge Graph Completion via Conditional Soft Prompting

arXiv 2307.01709 ↗First posted 4 Jul 2023cs.CLcited by 33

Not on the map. Why?

Abstract (arXiv)

Knowledge Graph Completion (KGC) often requires both KG structural and textual information to be effective. Pre-trained Language Models (PLMs) have been used to learn the textual information, usually under the fine-tune paradigm for the KGC task. However, the fine-tuned PLMs often overwhelmingly focus on the textual information and overlook structural knowledge. To tackle this issue, this paper proposes CSProm-KG (Conditional Soft Prompts for KGC) which maintains a balance between structural information and textual knowledge. CSProm-KG only tunes the parameters of Conditional Soft Prompts that are generated by the entities and relations representations. We verify the effectiveness of CSProm-KG on three popular static KGC benchmarks WN18RR, FB15K-237 and Wikidata5M, and two temporal KGC benchmarks ICEWS14 and ICEWS05-15. CSProm-KG outperforms competitive baseline models and sets new state-of-the-art on these benchmarks. We conduct further analysis to show (i) the effectiveness of our proposed components, (ii) the efficiency of CSProm-KG, and (iii) the flexibility of CSProm-KG.

Key facts. Cited by 33 papers in the map (data through 14 Oct 2026). Builds on 30 of its 50 references that are in the map. First posted on arXiv 4 Jul 2023.

Builds on

30 of 50 references.

References · 30

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2020Language Models are Few-Shot Learnerscited by 32,419
  3. 2014Explaining and Harnessing Adversarial Examplescited by 7,364
  4. 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,415
  5. 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,915
  6. 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,795
  7. 2020Big Bird: Transformers for Longer Sequencescited by 1,684
  8. 2014Embedding Entities and Relations for Learning and Inference in Knowledge Basescited by 932
  9. 2016Complex Embeddings for Simple Link Predictioncited by 902
  10. 2019RotatE: Knowledge Graph Embedding by Relational Rotation in Complex Spacecited by 898
  11. 2017Convolutional 2D Knowledge Graph Embeddingscited by 730
  12. 2019Universal Adversarial Triggers for Attacking and Analyzing NLPcited by 722
18 more
  1. 2021P-Tuning v2: Prompt Tuning Can Be Comparable to Fine-tuning Universally Across Scales and Taskscited by 689
  2. 2019Composition-based Multi-Relational Graph Convolutional Networkscited by 396
  3. 2019KEPLER: A Unified Model for Knowledge Embedding and Pre-trained Language Representationcited by 356
  4. 2019KG-BERT: BERT for Knowledge Graph Completioncited by 324
  5. 2016Adversarial Training Methods for Semi-Supervised Text Classificationcited by 280
  6. 2018Learning Sequence Encoders for Temporal Knowledge Graph Completioncited by 145
  7. 2020Tensor Decompositions for temporal knowledge base completioncited by 115
  8. 2019Diachronic Embedding for Temporal Knowledge Graph Completioncited by 104
  9. 2022Sequence-to-Sequence Knowledge Graph Completion and Question Answeringcited by 75
  10. 2022PromDA: Prompt-based Data Augmentation for Low-Resource NLU Taskscited by 51
  11. 2020TeRo: A Time-aware Knowledge Graph Embedding via Temporal Rotationcited by 48
  12. 2022From Discrimination to Generation: Knowledge Graph Completion with Generative Transformercited by 45
  13. 2020Realistic Re-evaluation of Knowledge Graph Completion Methods: An Experimental Studycited by 37
  14. 2023Language Models are Few-shot Learners for Prognostic Predictioncited by 37
  15. 2022Knowledge Is Flat: A Seq2Seq Generative Framework for Various Knowledge Graph Completioncited by 32
  16. 2019Temporal Knowledge Graph Embedding Model based on Additive Time Series Decompositioncited by 24
  17. 2020MLMLM: Link Prediction with Mean Likelihood Masked Language Modelcited by 22
  18. 2021BERT4GCN: Using BERT Intermediate Layers to Augment GCN for Aspect-based Sentiment Classificationcited by 7

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 6; 2024: 11; 2025: 11; 2026: 5.

33 papers.

Sort:

By area:

  1. 2024Threats, Attacks, and Defenses in Machine Unlearning: A Surveycited by 39
  2. 2025TRIX: A More Expressive Model for Zero-shot Domain Transfer in Knowledge Graphscited by 24
  3. 2024Multi-perspective Improvement of Knowledge Graph Completion with Large Language Modelscited by 20
  4. 2024Contextualization Distillation from Large Language Model for Knowledge Graph Completioncited by 18
  5. 2024KG-FIT: Knowledge Graph Fine-Tuning Upon Open-World Knowledgecited by 16
  6. 2023Enhancing Text-based Knowledge Graph Completion with Zero-Shot Large Language Models: A Focus on Semantic Enhancementcited by 14
  7. 2024Urban Region Pre-training and Prompting: A Graph-based Approachcited by 8
  8. 2024Large Language Model Enhanced Knowledge Representation Learning: A Surveycited by 7
  9. 2025Graph-O1 : Monte Carlo Tree Search with Reinforcement Learning for Text-Attributed Graph Reasoningcited by 7
  10. 2025Harnessing Diverse Perspectives: A Multi-Agent Framework for Enhanced Error Detection in Knowledge Graphscited by 5
  11. 2023MoCoSA: Momentum Contrast for Knowledge Graph Completion with Structure-Augmented Pre-trained Language Modelscited by 4
  12. 2023Knowledge Graph Error Detection with Contrastive Confidence Adaptioncited by 4
21 more
  1. 2025A Survey of Link Prediction in N-ary Knowledge Graphscited by 4
  2. 2025Enhancing Large Language Model for Knowledge Graph Completion via Structure-Aware Alignment-Tuningcited by 4
  3. 2023Prompting Disentangled Embeddings for Knowledge Graph Completion with Pre-trained Language Modelcited by 3
  4. 2024Multi-level Shared Knowledge Guided Learning for Knowledge Graph Completioncited by 2
  5. 2024Filter-then-Generate: Large Language Models with Structure-Text Adapter for Knowledge Graph Completioncited by 2
  6. 2025GLTW: Joint Improved Graph Transformer and LLM via Three-Word Language for Knowledge Graph Completioncited by 2
  7. 2025From Knowledge to Treatment: Large Language Model Assisted Biomedical Concept Representation for Drug Repurposingcited by 2
  8. 2026Multi-hop Reasoning and Retrieval in Embedding Space: Leveraging Large Language Models with Knowledgecited by 2
  9. 2023Unifying Structure and Language Semantic for Efficient Contrastive Knowledge Graph Completion with Structured Entity Anchorscited by 1
  10. 2024Deja vu: Contrastive Historical Modeling with Prefix-tuning for Temporal Knowledge Graph Reasoningcited by 1
  11. 2025Transformer-Based Multimodal Knowledge Graph Completion with Link-Aware Contextscited by 1
  12. 2025KG-BiLM: Knowledge Graph Embedding via Bidirectional Language Modelscited by 1
  13. 2025Knowledge Reasoning Language Model: Unifying Knowledge and Language for Inductive Knowledge Graph Reasoningcited by 1
  14. 2023Simple Rule Injection for ComplEx Embeddingscited by 0
  15. 2024What Would Happen Next? Predicting Consequences from An Event Causality Graphcited by 0
  16. 2024Deep Sparse Latent Feature Models for Knowledge Graph Completioncited by 0
  17. 2025Soft Prompts for Evaluation: Measuring Conditional Distance of Capabilitiescited by 0
  18. 2026SASA: Semantic-Aware Contrastive Learning Framework with Separated Attention for Triple Classificationcited by 0
  19. 2026RADAR: Reasoning as Discrimination with Aligned Representations for LLM-based Knowledge Graph Reasoningcited by 0
  20. 2026Tokenization, Fusion and Decoupling: Bridging the Granularity Mismatch Between Large Language Models and Knowledge Graphscited by 0
  21. 2026ImbalancE: Inference-Time Latent Search Against Degree Imbalance in Link Predictioncited by 0