Contextualized Structural Self-supervised Learning for Ontology Matching
Not on the map. Why?
Abstract (arXiv)
Ontology matching (OM) entails the identification of semantic relationships between concepts within two or more knowledge graphs (KGs) and serves as a critical step in integrating KGs from various sources. Recent advancements in deep OM models have harnessed the power of transformer-based language models and the advantages of knowledge graph embedding. Nevertheless, these OM models still face persistent challenges, such as a lack of reference alignments, runtime latency, and unexplored different graph structures within an end-to-end framework. In this study, we introduce a novel self-supervised learning OM framework with input ontologies, called LaKERMap. This framework capitalizes on the contextual and structural information of concepts by integrating implicit knowledge into transformers. Specifically, we aim to capture multiple structural contexts, encompassing both local and global interactions, by employing distinct training objectives. To assess our methods, we utilize the Bio-ML datasets and tasks. The findings from our innovative approach reveal that LaKERMap surpasses state-of-the-art systems in terms of alignment quality and inference time. Our models and codes are available here: https://github.com/ellenzhuwang/lakermap.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 11 of its 31 references that are in the map. First posted on arXiv 5 Oct 2023.
Builds on
11 of 31 references.
References · 11
- 2017Attention Is All You Needcited by 60,361
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,375
- 2020Domain-Specific Language Model Pretraining for Biomedical Natural Language Processingcited by 1,009
- 2019Publicly Available Clinical BERT Embeddingscited by 1,002
- 2021BERTMap: A BERT-based Ontology Alignment Systemcited by 46
- 2022Contrastive Language-Image Pre-Training with Knowledge Graphscited by 34
- 2022Machine Learning-Friendly Biomedical Datasets for Equivalence and Subsumption Ontology Matchingcited by 22
- 2021Matching with Transformers in MELTcited by 2
Built on by
Citing papers per year: 2024: 1; 2025: 1.
2 papers.
- 2024LLMs4OM: Matching Ontologies with Large Language Modelscited by 22
- 2025OntoAligner Meets Knowledge Graph Embedding Alignerscited by 1
- 2025OntoAligner Meets Knowledge Graph Embedding Aligners30 Sep 2025
- 2024LLMs4OM: Matching Ontologies with Large Language Models16 Apr 2024