Node-based Knowledge Graph Contrastive Learning for Medical Relationship Prediction
Not on the map. Why?
Abstract (arXiv)
The embedding of Biomedical Knowledge Graphs (BKGs) generates robust representations, valuable for a variety of artificial intelligence applications, including predicting drug combinations and reasoning disease-drug relationships. Meanwhile, contrastive learning (CL) is widely employed to enhance the distinctiveness of these representations. However, constructing suitable contrastive pairs for CL, especially within Knowledge Graphs (KGs), has been challenging. In this paper, we proposed a novel node-based contrastive learning method for knowledge graph embedding, NC-KGE. NC-KGE enhances knowledge extraction in embeddings and speeds up training convergence by constructing appropriate contrastive node pairs on KGs. This scheme can be easily integrated with other knowledge graph embedding (KGE) methods. For downstream task such as biochemical relationship prediction, we have incorporated a relation-aware attention mechanism into NC-KGE, focusing on the semantic relationships and node interactions. Extensive experiments show that NC-KGE performs competitively with state-of-the-art models on public datasets like FB15k-237 and WN18RR. Particularly in biomedical relationship prediction tasks, NC-KGE outperforms all baselines on datasets such as PharmKG8k-28, DRKG17k-21, and BioKG72k-14, especially in predicting drug combination relationships. We release our code at https://github.com/zhi520/NC-KGE.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 30 of its 53 references that are in the map. First posted on arXiv 16 Oct 2023.
Builds on
30 of 53 references.
References · 30
- 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 5,045
- 2017Modeling Relational Data with Graph Convolutional Networkscited by 1,694
- 2020Graph Contrastive Learning with Augmentationscited by 1,208
- 2014Embedding Entities and Relations for Learning and Inference in Knowledge Basescited by 932
- 2016Complex Embeddings for Simple Link Predictioncited by 902
- 2019RotatE: Knowledge Graph Embedding by Relational Rotation in Complex Spacecited by 898
- 2017Convolutional 2D Knowledge Graph Embeddingscited by 730
- 2020Deep Graph Contrastive Representation Learningcited by 539
- 2019KG-BERT: BERT for Knowledge Graph Completioncited by 324
- 2019TuckER: Tensor Factorization for Knowledge Graph Completioncited by 290
- 2018SimplE Embedding for Link Prediction in Knowledge Graphscited by 195
- 2015Holographic Embeddings of Knowledge Graphscited by 181
18 more
- 2019Quaternion Knowledge Graph Embeddingscited by 175
- 2018End-to-end Structure-Aware Convolutional Networks for Knowledge Base Completioncited by 136
- 2019Learning Hierarchy-Aware Knowledge Graph Embeddings for Link Predictioncited by 133
- 2019Learning Attention-based Embeddings for Relation Prediction in Knowledge Graphscited by 125
- 2022SimKGC: Simple Contrastive Knowledge Graph Completion with Pre-trained Language Modelscited by 91
- 2021AutoGCL: Automated Graph Contrastive Learning via Learnable View Generatorscited by 73
- 2017Analogical Inference for Multi-Relational Embeddingscited by 69
- 2020PairRE: Knowledge Graph Embeddings via Paired Relation Vectorscited by 67
- 2020Inductive Entity Representations from Text via Link Predictioncited by 62
- 2019InteractE: Improving Convolution-based Knowledge Graph Embeddings by Increasing Feature Interactionscited by 58
- 2022Knowledge Graph Contrastive Learning Based on Relation-Symmetrical Structurecited by 43
- 2022HousE: Knowledge Graph Embedding with Householder Parameterizationcited by 29
- 2021A Survey of Knowledge Graph Embedding and Their Applicationscited by 17
- 2021How Does Knowledge Graph Embedding Extrapolate to Unseen Data: A Semantic Evidence Viewcited by 17
- 2020Knowledge Graph Embeddings and Explainable AIcited by 15
- 2021Highly Efficient Knowledge Graph Embedding Learning with Orthogonal Procrustes Analysiscited by 10
- 2022Graph Contrastive Learning with Implicit Augmentationscited by 7
- 2022MEKER: Memory Efficient Knowledge Embedding Representation for Link Prediction and Question Answeringcited by 4
Built on by
Not cited yet.