SLiNT: Structure-aware Language Model with Injection and Contrastive Training for Knowledge Graph Completion
Not on the map. Why?
Abstract (arXiv)
Link prediction in knowledge graphs requires integrating structural information and semantic context to infer missing entities. While large language models offer strong generative reasoning capabilities, their limited exploitation of structural signals often results in structural sparsity and semantic ambiguity, especially under incomplete or zero-shot settings. To address these challenges, we propose SLiNT (Structure-aware Language model with Injection and coNtrastive Training), a modular framework that injects knowledge-graph-derived structural context into a frozen LLM backbone with lightweight LoRA-based adaptation for robust link prediction. Specifically, Structure-Guided Neighborhood Enhancement (SGNE) retrieves pseudo-neighbors to enrich sparse entities and mitigate missing context; Dynamic Hard Contrastive Learning (DHCL) introduces fine-grained supervision by interpolating hard positives and negatives to resolve entity-level ambiguity; and Gradient-Decoupled Dual Injection (GDDI) performs token-level structure-aware intervention while preserving the core LLM parameters. Experiments on WN18RR and FB15k-237 show that SLiNT achieves superior or competitive performance compared with both embedding-based and generation-based baselines, demonstrating the effectiveness of structure-aware representation learning for scalable knowledge graph completion.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 19 of its 32 references that are in the map. First posted on arXiv 8 Sep 2025.
Builds on
19 of 32 references.
References · 19
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
- 2017Billion-scale similarity search with GPUscited by 2,497
- 2017Sigmoid-Weighted Linear Units for Neural Network Function Approximation in Reinforcement Learningcited by 950
- 2014Embedding Entities and Relations for Learning and Inference in Knowledge Basescited by 932
- 2019RotatE: Knowledge Graph Embedding by Relational Rotation in Complex Spacecited by 898
- 2015Deep Learning and the Information Bottleneck Principlecited by 802
- 2017Convolutional 2D Knowledge Graph Embeddingscited by 730
- 2019A Theoretical Analysis of Contrastive Unsupervised Representation Learningcited by 530
- 2019Composition-based Multi-Relational Graph Convolutional Networkscited by 396
- 2019KEPLER: A Unified Model for Knowledge Embedding and Pre-trained Language Representationcited by 356
- 2019KGAT: Knowledge Graph Attention Network for Recommendationcited by 343
7 more
- 2019KG-BERT: BERT for Knowledge Graph Completioncited by 324
- 2019TuckER: Tensor Factorization for Knowledge Graph Completioncited by 290
- 2021Neural Bellman-Ford Networks: A General Graph Neural Network Framework for Link Predictioncited by 275
- 2019KagNet: Knowledge-Aware Graph Networks for Commonsense Reasoningcited by 216
- 2020HittER: Hierarchical Transformers for Knowledge Graph Embeddingscited by 54
- 2022From Discrimination to Generation: Knowledge Graph Completion with Generative Transformercited by 45
- 2022I Know What You Do Not Know: Knowledge Graph Embedding via Co-distillation Learningcited by 15
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Enhancing Large Language Model for Knowledge Graph Completion via Structure-Aware Alignment-Tuning
- 2023Making Large Language Models Perform Better in Knowledge Graph Completion
- 2025Enhancing Knowledge Graph Completion with Entity Neighborhood and Relation Context
- 2025Align-GRAG: Anchor and Rationale Guided Dual Alignment for Graph Retrieval-Augmented Generation
- 2025Enhancing Large Language Models with Reliable Knowledge Graphs
- 2026GS-Quant: Granular Semantic and Generative Structural Quantization for Knowledge Graph Completion
- 2025SSTAG: Structure-Aware Self-Supervised Learning Method for Text-Attributed Graphs
- 2023Enhancing Text-based Knowledge Graph Completion with Zero-Shot Large Language Models: A Focus on Semantic Enhancement