# Learning to Exploit Long-term Relational Dependencies in Knowledge Graphs

arXiv: https://arxiv.org/abs/1905.04914 · HTML: https://mlsanity.com/paper/1905.04914/

## Key facts

- Cited by 83 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 13 May 2019.

## Built on by (most cited first, 30 of 83)

- [TimeTraveler: Reinforcement Learning for Temporal Knowledge Graph Forecasting](https://mlsanity.com/paper/2109.04101/) (2021)
- [Knowledge Graphs Meet Multi-Modal Learning: A Comprehensive Survey](https://mlsanity.com/paper/2402.05391/) (2024)
- [Paths-over-Graph: Knowledge Graph Empowered Large Language Model Reasoning](https://mlsanity.com/paper/2410.14211/) (2024)
- [Knowledge Graph Embedding: A Survey from the Perspective of Representation Spaces](https://mlsanity.com/paper/2211.03536/) (2022)
- [Boosting the Speed of Entity Alignment 10*: Dual Attention Matching Network with Normalized Hard Sample Mining](https://mlsanity.com/paper/2103.15452/) (2021)
- [SelfKG: Self-Supervised Entity Alignment in Knowledge Graphs](https://mlsanity.com/paper/2203.01044/) (2022)
- [A Benchmark and Comprehensive Survey on Knowledge Graph Entity Alignment via Representation Learning](https://mlsanity.com/paper/2103.15059/) (2021)
- [Lifelong Embedding Learning and Transfer for Growing Knowledge Graphs](https://mlsanity.com/paper/2211.15845/) (2022)
- [From Alignment to Assignment: Frustratingly Simple Unsupervised Entity Alignment](https://mlsanity.com/paper/2109.02363/) (2021)
- [Neural Multi-Hop Reasoning With Logical Rules on Biomedical Knowledge Graphs](https://mlsanity.com/paper/2103.10367/) (2021)
- [Knowing the No-match: Entity Alignment with Dangling Cases](https://mlsanity.com/paper/2106.02248/) (2021)
- [ClusterEA: Scalable Entity Alignment with Stochastic Training and Normalized Mini-batch Similarities](https://mlsanity.com/paper/2205.10312/) (2022)
- [OntoEA: Ontology-guided Entity Alignment via Joint Knowledge Graph Embedding](https://mlsanity.com/paper/2105.07688/) (2021)
- [Unsupervised Knowledge Graph Alignment by Probabilistic Reasoning and Semantic Embedding](https://mlsanity.com/paper/2105.05596/) (2021)
- [LightEA: A Scalable, Robust, and Interpretable Entity Alignment Framework via Three-view Label Propagation](https://mlsanity.com/paper/2210.10436/) (2022)
- [MKGL: Mastery of a Three-Word Language](https://mlsanity.com/paper/2410.07526/) (2024)
- [A Fused Gromov-Wasserstein Framework for Unsupervised Knowledge Graph Entity Alignment](https://mlsanity.com/paper/2305.06574/) (2023)
- [I Know What You Do Not Know: Knowledge Graph Embedding via Co-distillation Learning](https://mlsanity.com/paper/2208.09828/) (2022)
- [Bilinear Scoring Function Search for Knowledge Graph Learning](https://mlsanity.com/paper/2107.00184/) (2021)
- [Are Negative Samples Necessary in Entity Alignment? An Approach with High Performance, Scalability and Robustness](https://mlsanity.com/paper/2108.05278/) (2021)
- [Large-scale Entity Alignment via Knowledge Graph Merging, Partitioning and Embedding](https://mlsanity.com/paper/2208.11125/) (2022)
- [Informed Multi-context Entity Alignment](https://mlsanity.com/paper/2201.00304/) (2022)
- [Revisit and Outstrip Entity Alignment: A Perspective of Generative Models](https://mlsanity.com/paper/2305.14651/) (2023)
- [Two Heads Are Better Than One: Integrating Knowledge from Knowledge Graphs and Large Language Models for Entity Alignment](https://mlsanity.com/paper/2401.16960/) (2024)
- [Reinforcement Learning based Collective Entity Alignment with Adaptive Features](https://mlsanity.com/paper/2101.01353/) (2021)
- [Explainable Biomedical Recommendations via Reinforcement Learning Reasoning on Knowledge Graphs](https://mlsanity.com/paper/2111.10625/) (2021)
- [Interactive Contrastive Learning for Self-supervised Entity Alignment](https://mlsanity.com/paper/2201.06225/) (2022)
- [Ensemble Semi-supervised Entity Alignment via Cycle-teaching](https://mlsanity.com/paper/2203.06308/) (2022)
- [KGTuner: Efficient Hyper-parameter Search for Knowledge Graph Learning](https://mlsanity.com/paper/2205.02460/) (2022)
- [Deep Active Alignment of Knowledge Graph Entities and Schemata](https://mlsanity.com/paper/2304.04389/) (2023)

## Abstract (arXiv)

We study the problem of knowledge graph (KG) embedding. A widely-established assumption to this problem is that similar entities are likely to have similar relational roles. However, existing related methods derive KG embeddings mainly based on triple-level learning, which lack the capability of capturing long-term relational dependencies of entities. Moreover, triple-level learning is insufficient for the propagation of semantic information among entities, especially for the case of cross-KG embedding. In this paper, we propose recurrent skipping networks (RSNs), which employ a skipping mechanism to bridge the gaps between entities. RSNs integrate recurrent neural networks (RNNs) with residual learning to efficiently capture the long-term relational dependencies within and between KGs. We design an end-to-end framework to support RSNs on different tasks. Our experimental results showed that RSNs outperformed state-of-the-art embedding-based methods for entity alignment and achieved competitive performance for KG completion.