Type-Less yet Type-Aware Inductive Link Prediction with Pretrained Language Models
Not on the map. Why?
Abstract (arXiv)
Inductive link prediction is emerging as a key paradigm for real-world knowledge graphs (KGs), where new entities frequently appear and models must generalize to them without retraining. Predicting links in a KG faces the challenge of guessing previously unseen entities by leveraging generalizable node features such as subgraph structure, type annotations, and ontological constraints. However, explicit type information is often lacking or incomplete. Even when available, type information in most KGs is often coarse-grained, sparse, and prone to errors due to human annotation. In this work, we explore the potential of pre-trained language models (PLMs) to enrich node representations with implicit type signals. We introduce TyleR, a Type-less yet type-awaRe approach for subgraph-based inductive link prediction that leverages PLMs for semantic enrichment. Experiments on standard benchmarks demonstrate that TyleR outperforms state-of-the-art baselines in scenarios with scarce type annotations and sparse graph connectivity. To ensure reproducibility, we share our code at https://github.com/sisinflab/tyler .
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 21 of its 32 references that are in the map. First posted on arXiv 30 Sep 2025.
Builds on
21 of 32 references.
References · 21
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2017Inductive Representation Learning on Large Graphscited by 6,284
- 2016Layer Normalizationcited by 5,579
- 2019Language Models as Knowledge Bases?cited by 1,922
- 2017Modeling Relational Data with Graph Convolutional Networkscited by 1,684
- 2018Representation Learning on Graphs with Jumping Knowledge Networkscited by 875
- 2019How Contextual are Contextualized Word Representations? Comparing the Geometry of BERT, ELMo, and GPT-2 Embeddingscited by 770
- 2020Knowledge Graphscited by 619
- 2019Composition-based Multi-Relational Graph Convolutional Networkscited by 395
- 2019KEPLER: A Unified Model for Knowledge Embedding and Pre-trained Language Representationcited by 356
9 more
- 2019KG-BERT: BERT for Knowledge Graph Completioncited by 323
- 2019Knowledge Enhanced Contextual Word Representationscited by 294
- 2019Inductive Relation Prediction by Subgraph Reasoningcited by 237
- 2020Inductive Entity Representations from Text via Link Predictioncited by 61
- 2020Communicative Message Passing for Inductive Relation Reasoningcited by 53
- 2021Topology-Aware Correlations Between Relations for Inductive Link Prediction in Knowledge Graphscited by 47
- 2022BertNet: Harvesting Knowledge Graphs with Arbitrary Relations from Pretrained Language Modelscited by 20
- 2023Knowledge Graph Embeddings in the Biomedical Domain: Are They Useful? A Look at Link Prediction, Rule Learning, and Downstream Polypharmacy Taskscited by 9
- 2024Context-aware Inductive Knowledge Graph Completion with Latent Type Constraints and Subgraph Reasoningcited by 4
Built on by
Not cited yet.