OKGIT: Open Knowledge Graph Link Prediction with Implicit Types
Not on the map. Why?
Abstract (arXiv)
Open Knowledge Graphs (OpenKG) refer to a set of (head noun phrase, relation phrase, tail noun phrase) triples such as (tesla, return to, new york) extracted from a corpus using OpenIE tools. While OpenKGs are easy to bootstrap for a domain, they are very sparse and far from being directly usable in an end task. Therefore, the task of predicting new facts, i.e., link prediction, becomes an important step while using these graphs in downstream tasks such as text comprehension, question answering, and web search query recommendation. Learning embeddings for OpenKGs is one approach for link prediction that has received some attention lately. However, on careful examination, we found that current OpenKG link prediction algorithms often predict noun phrases (NPs) with incompatible types for given noun and relation phrases. We address this problem in this work and propose OKGIT that improves OpenKG link prediction using novel type compatibility score and type regularization. With extensive experiments on multiple datasets, we show that the proposed method achieves state-of-the-art performance while producing type compatible NPs in the link prediction task.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 11 of its 25 references that are in the map. First posted on arXiv 24 Jun 2021.
Builds on
11 of 25 references.
References · 11
- 2017Attention Is All You Needcited by 60,361
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2019Language Models as Knowledge Bases?cited by 1,936
- 2019SpanBERT: Improving Pre-training by Representing and Predicting Spanscited by 834
- 2017Convolutional 2D Knowledge Graph Embeddingscited by 730
- 2019KG-BERT: BERT for Knowledge Graph Completioncited by 324
- 2018Ultra-Fine Entity Typingcited by 87
- 2019CoKE: Contextualized Knowledge Graph Embeddingcited by 30
- 2019CESI: Canonicalizing Open Knowledge Bases using Embeddings and Side Informationcited by 28
- 2020Improving Entity Linking by Modeling Latent Entity Type Informationcited by 18
- 2016Relation Schema Induction using Tensor Factorization with Side Informationcited by 5
Built on by
Citing papers per year: 2021: 1; 2022: 3; 2023: 0; 2024: 2.
6 papers.
- 2022A Review of Knowledge Graph Completioncited by 8
- 2022mOKB6: A Multilingual Open Knowledge Base Completion Benchmarkcited by 7
- 2021Knowledge Base Completion Meets Transfer Learningcited by 4
- 2024KC-GenRe: A Knowledge-constrained Generative Re-ranking Method Based on Large Language Models for Knowledge Graph Completioncited by 1
- 2022Alleviating Sparsity of Open Knowledge Graphs with Ternary Contrastive Learningcited by 0
- 2024Pre-training and Diagnosing Knowledge Base Completion Modelscited by 0
- 2024KC-GenRe: A Knowledge-constrained Generative Re-ranking Method Based on Large Language Models for Knowledge Graph Completion26 Mar 2024
- 2024Pre-training and Diagnosing Knowledge Base Completion Models27 Jan 2024
- 2022mOKB6: A Multilingual Open Knowledge Base Completion Benchmark13 Nov 2022
- 2022Alleviating Sparsity of Open Knowledge Graphs with Ternary Contrastive Learning8 Nov 2022
- 2022A Review of Knowledge Graph Completion24 Aug 2022
- 2021Knowledge Base Completion Meets Transfer Learning30 Aug 2021