mlsanityData to 7 Oct 2026

Path-based knowledge reasoning with textual semantic information for medical knowledge graph completion

arXiv 2105.13074 ↗First posted 27 May 2021cs.AI cs.CLcited by 4

Not on the map. Why?

Abstract (arXiv)

Background Knowledge graphs (KGs), especially medical knowledge graphs, are often significantly incomplete, so it necessitating a demand for medical knowledge graph completion (MedKGC). MedKGC can find new facts based on the exited knowledge in the KGs. The path-based knowledge reasoning algorithm is one of the most important approaches to this task. This type of method has received great attention in recent years because of its high performance and interpretability. In fact, traditional methods such as path ranking algorithm (PRA) take the paths between an entity pair as atomic features. However, the medical KGs are very sparse, which makes it difficult to model effective semantic representation for extremely sparse path features. The sparsity in the medical KGs is mainly reflected in the long-tailed distribution of entities and paths. Previous methods merely consider the context structure in the paths of the knowledge graph and ignore the textual semantics of the symbols in the path. Therefore, their performance cannot be further improved due to the two aspects of entity sparseness and path sparseness. To address the above issues, this paper proposes two novel path-based reasoning methods to solve the sparsity issues of entity and path respectively, which adopts the textual semantic information of entities and paths for MedKGC. By using the pre-trained model BERT, combining the textual semantic representations of the entities and the relationships, we model the task of symbolic reasoning in the medical KG as a numerical computing issue in textual semantic representation.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 17 of its 30 references that are in the map. First posted on arXiv 27 May 2021.

Builds on

17 of 30 references.

References · 17

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2020Language Models are Few-Shot Learnerscited by 32,199
  4. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  5. 2015Distilling the Knowledge in a Neural Networkcited by 10,076
  6. 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,462
  7. 2019XLNet: Generalized Autoregressive Pretraining for Language Understandingcited by 2,801
  8. 2018Deep contextualized word representationscited by 2,285
  9. 2016Complex Embeddings for Simple Link Predictioncited by 897
  10. 2019ERNIE: Enhanced Language Representation with Informative Entitiescited by 525
  11. 2019KG-BERT: BERT for Knowledge Graph Completioncited by 323
  12. 2020Text-to-Text Pre-Training for Data-to-Text Taskscited by 104
5 more
  1. 2017Analogical Inference for Multi-Relational Embeddingscited by 69
  2. 2016Chains of Reasoning over Entities, Relations, and Text using Recurrent Neural Networkscited by 37
  3. 2015Compositional Vector Space Models for Knowledge Base Completioncited by 33
  4. 2017Learning to generate one-sentence biographies from Wikidatacited by 13
  5. 2018DOLORES: Deep Contextualized Knowledge Graph Embeddingscited by 11

Built on by

Cited by year

Citing papers per year: 2022: 1; 2023: 3.

4 papers.