mlsanityData to 7 Oct 2026

Triple Classification for Scholarly Knowledge Graph Completion

arXiv 2111.11845 ↗First posted 23 Nov 2021cs.CL cs.DLcited by 5

Not on the map. Why?

Abstract (arXiv)

Scholarly Knowledge Graphs (KGs) provide a rich source of structured information representing knowledge encoded in scientific publications. With the sheer volume of published scientific literature comprising a plethora of inhomogeneous entities and relations to describe scientific concepts, these KGs are inherently incomplete. We present exBERT, a method for leveraging pre-trained transformer language models to perform scholarly knowledge graph completion. We model triples of a knowledge graph as text and perform triple classification (i.e., belongs to KG or not). The evaluation shows that exBERT outperforms other baselines on three scholarly KG completion datasets in the tasks of triple classification, link prediction, and relation prediction. Furthermore, we present two scholarly datasets as resources for the research community, collected from public KGs and online resources.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 24 of its 48 references that are in the map. First posted on arXiv 23 Nov 2021.

Builds on

24 of 48 references.

References · 24

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,462
  3. 2016Enriching Word Vectors with Subword Informationcited by 1,578
  4. 2019SciBERT: A Pretrained Language Model for Scientific Textcited by 1,404
  5. 2019PEGASUS: Pre-training with Extracted Gap-sentences for Abstractive Summarizationcited by 1,100
  6. 2014Embedding Entities and Relations for Learning and Inference in Knowledge Basescited by 929
  7. 2016Complex Embeddings for Simple Link Predictioncited by 897
  8. 2019RotatE: Knowledge Graph Embedding by Relational Rotation in Complex Spacecited by 893
  9. 2017Convolutional 2D Knowledge Graph Embeddingscited by 729
  10. 2019ERNIE: Enhanced Language Representation with Informative Entitiescited by 525
  11. 2019Composition-based Multi-Relational Graph Convolutional Networkscited by 395
  12. 2019KG-BERT: BERT for Knowledge Graph Completioncited by 323
12 more
  1. 2017A Comprehensive Survey of Graph Embedding: Problems, Techniques and Applicationscited by 260
  2. 2018SimplE Embedding for Link Prediction in Knowledge Graphscited by 195
  3. 2015Holographic Embeddings of Knowledge Graphscited by 181
  4. 2017A Novel Embedding Model for Knowledge Base Completion Based on Convolutional Neural Networkcited by 143
  5. 2018Construction of the Literature Graph in Semantic Scholarcited by 118
  6. 2020PyKEEN 1.0: A Python Library for Training and Evaluating Knowledge Graph Embeddingscited by 77
  7. 2020PairRE: Knowledge Graph Embeddings via Paired Relation Vectorscited by 67
  8. 2019KBQA: Learning Question Answering over QA Corpora and Knowledge Basescited by 44
  9. 2016ProjE: Embedding Projection for Knowledge Graph Completioncited by 26
  10. 2020Evaluating the Impact of Knowledge Graph Context on Entity Disambiguation Modelscited by 22
  11. 2020Question Answering on Scholarly Knowledge Graphscited by 7
  12. 2019Soft Marginal TransE for Scholarly Knowledge Graph Completioncited by 1

Built on by

Cited by year

Citing papers per year: 2022: 3; 2023: 0; 2024: 2.

5 papers.

  1. 2022Language Models as Knowledge Embeddingscited by 14
  2. 2024Large Language Model Enhanced Knowledge Representation Learning: A Surveycited by 6
  3. 2024Textual Entailment for Effective Triple Validation in Object Predictioncited by 2
  4. 2022GRAPHYP: A Scientific Knowledge Graph with Manifold Subnetworks of Communities. Detection of Scholarly Disputes in Adversarial Information Routescited by 0
  5. 2022MORTY: Structured Summarization for Targeted Information Extraction from Scholarly Articlescited by 0