Block-Diagonal Orthogonal Relation and Matrix Entity for Knowledge Graph Embedding
Not on the map. Why?
Abstract (arXiv)
The primary aim of Knowledge Graph embeddings (KGE) is to learn low-dimensional representations of entities and relations for predicting missing facts. While rotation-based methods like RotatE and QuatE perform well in KGE, they face two challenges: limited model flexibility requiring proportional increases in relation size with entity dimension, and difficulties in generalizing the model for higher-dimensional rotations. To address these issues, we introduce OrthogonalE, a novel KGE model employing matrices for entities and block-diagonal orthogonal matrices with Riemannian optimization for relations. This approach enhances the generality and flexibility of KGE models. The experimental results indicate that our new KGE model, OrthogonalE, is both general and flexible, significantly outperforming state-of-the-art KGE models while substantially reducing the number of relation parameters.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 23 of its 46 references that are in the map. First posted on arXiv 11 Jan 2024.
Builds on
23 of 46 references.
References · 23
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2014Embedding Entities and Relations for Learning and Inference in Knowledge Basescited by 929
- 2016Complex Embeddings for Simple Link Predictioncited by 897
- 2019RotatE: Knowledge Graph Embedding by Relational Rotation in Complex Spacecited by 893
- 2017Convolutional 2D Knowledge Graph Embeddingscited by 729
- 2019Quaternion Knowledge Graph Embeddingscited by 175
- 2018Poincar'e GloVe: Hyperbolic Word Embeddingscited by 155
- 2019Cheap Orthogonal Constraints in Neural Networks: A Simple Parametrization of the Orthogonal and Unitary Groupcited by 133
- 2019Multi-relational Poincar'e Graph Embeddingscited by 126
- 2020Geoopt: Riemannian Optimization in PyTorchcited by 109
- 2016First-order Methods for Geodesically Convex Optimizationcited by 92
- 2016Full-Capacity Unitary Recurrent Neural Networkscited by 90
11 more
- 2017On orthogonality and learning recurrent networks with long term dependenciescited by 82
- 2017Orthogonal Recurrent Neural Networks with Scaled Cayley Transformcited by 82
- 2020HittER: Hierarchical Transformers for Knowledge Graph Embeddingscited by 54
- 2019Orthogonal Relation Transforms with Graph Context Modeling for Knowledge Graph Embeddingcited by 38
- 2019Leveraging Knowledge Bases in LSTMs for Improving Machine Readingcited by 37
- 2017Riemannian approach to batch normalizationcited by 35
- 2021Fast and accurate optimization on the orthogonal manifold without retractioncited by 35
- 2022Unsupervised Learning of Equivariant Structure from Sequencescited by 15
- 2021HopfE: Knowledge Graph Representation Learning using Inverse Hopf Fibrationscited by 9
- 2023Logical Entity Representation in Knowledge-Graphs for Differentiable Rule Learningcited by 8
- 2020DensE: An Enhanced Non-commutative Representation for Knowledge Graph Embedding with Adaptive Semantic Hierarchycited by 7
Built on by
Citing papers per year: 2026: 1.
1 paper.