Multimodal Contrastive Representation Learning in Augmented Biomedical Knowledge Graphs
Not on the map. Why?
Abstract (arXiv)
Biomedical Knowledge Graphs (BKGs) integrate diverse datasets to elucidate complex relationships within the biomedical field. Effective link prediction on these graphs can uncover valuable connections, such as potential novel drug-disease relations. We introduce a novel multimodal approach that unifies embeddings from specialized Language Models (LMs) with Graph Contrastive Learning (GCL) to enhance intra-entity relationships while employing a Knowledge Graph Embedding (KGE) model to capture inter-entity relationships for effective link prediction. To address limitations in existing BKGs, we present PrimeKG++, an enriched knowledge graph incorporating multimodal data, including biological sequences and textual descriptions for each entity type. By combining semantic and relational information in a unified representation, our approach demonstrates strong generalizability, enabling accurate link predictions even for unseen nodes. Experimental results on PrimeKG++ and the DrugBank drug-target interaction dataset demonstrate the effectiveness and robustness of our method across diverse biomedical datasets. Our source code, pre-trained models, and data are publicly available at https://github.com/HySonLab/BioMedKG
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 28 of its 46 references that are in the map. First posted on arXiv 3 Jan 2025.
Builds on
28 of 46 references.
References · 28
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2019BioBERT: a pre-trained biomedical language representation model for biomedical text miningcited by 1,935
- 2019Language Models as Knowledge Bases?cited by 1,922
- 2017Modeling Relational Data with Graph Convolutional Networkscited by 1,684
- 2018Deep Graph Infomaxcited by 1,101
- 2014Embedding Entities and Relations for Learning and Inference in Knowledge Basescited by 929
- 2016Complex Embeddings for Simple Link Predictioncited by 897
- 2019RotatE: Knowledge Graph Embedding by Relational Rotation in Complex Spacecited by 893
- 2020Contrastive Multi-View Representation Learning on Graphscited by 651
- 2019GraphSAINT: Graph Sampling Based Inductive Learning Methodcited by 618
- 2020Deep Graph Contrastive Representation Learningcited by 535
16 more
- 2018Modeling polypharmacy side effects with graph convolutional networkscited by 237
- 2020Graph Representation Learning via Graphical Mutual Information Maximizationcited by 217
- 2021Large-Scale Chemical Language Representations Capture Molecular Structure and Propertiescited by 203
- 2024LLaMA Beyond English: An Empirical Study on Language Capability Transfercited by 94
- 2021Pre-trained Language Models in Biomedical Domain: A Systematic Surveycited by 87
- 2022Knowledge Graph Contrastive Learning for Recommendationcited by 69
- 2022Rethinking and Scaling Up Graph Contrastive Learning: An Extremely Efficient Approach with Group Discriminationcited by 67
- 2024Instruction-tuned Language Models are Better Knowledge Learnerscited by 54
- 2022Multi-modal Contrastive Representation Learning for Entity Alignmentcited by 37
- 2024NativE: Multi-modal Knowledge Graph Completion in the Wildcited by 23
- 2022BARTSmiles: Generative Masked Language Models for Molecular Representationscited by 18
- 2024Can Language Models Act as Knowledge Bases at Scale?cited by 17
- 2023Large Knowledge Model: Perspectives and Challengescited by 12
- 2023Otter-Knowledge: benchmarks of multimodal knowledge graph representation learning from different sources for drug discoverycited by 10
- 2023BioBLP: A Modular Framework for Learning on Multimodal Biomedical Knowledge Graphscited by 5
- 2022Predicting Drug-Drug Interactions using Deep Generative Models on Graphscited by 4
Built on by
Citing papers per year: 2025: 2; 2026: 1.
3 papers.
- 2025Advances in Protein Representation Learning: Methods, Applications, and Future Directionscited by 3
- 2025Thin Bridges for Drug Text Alignment: Lightweight Contrastive Learning for Target Specific Drug Retrievalcited by 0
- 2026PrimeKG-CL: A Continual Graph Learning Benchmark on Evolving Biomedical Knowledge Graphscited by 0
- 2026PrimeKG-CL: A Continual Graph Learning Benchmark on Evolving Biomedical Knowledge Graphs11 May 2026
- 2025Thin Bridges for Drug Text Alignment: Lightweight Contrastive Learning for Target Specific Drug Retrieval30 Sep 2025
- 2025Advances in Protein Representation Learning: Methods, Applications, and Future Directions20 Mar 2025