Matching with Transformers in MELT
Not on the map. Why?
Abstract (arXiv)
One of the strongest signals for automated matching of ontologies and knowledge graphs are the textual descriptions of the concepts. The methods that are typically applied (such as character- or token-based comparisons) are relatively simple, and therefore do not capture the actual meaning of the texts. With the rise of transformer-based language models, text comparison based on meaning (rather than lexical features) is possible. In this paper, we model the ontology matching task as classification problem and present approaches based on transformer models. We further provide an easy to use implementation in the MELT framework which is suited for ontology and knowledge graph matching. We show that a transformer-based filter helps to choose the correct correspondences given a high-recall alignment and already achieves a good result with simple alignment post-processing methods.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 10 of its 20 references that are in the map. First posted on arXiv 15 Sep 2021.
Builds on
10 of 20 references.
References · 10
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
- 2019ALBERT: A Lite BERT for Self-supervised Learning of Language Representationscited by 2,772
- 2018Tune: A Research Platform for Distributed Model Selection and Trainingcited by 395
- 2017Population Based Training of Neural Networkscited by 351
- 2020The Knowledge Graph Track at OAEI -- Gold Standards, Baselines, and the Golden Hammer Biascited by 9
- 2020Supervised Ontology and Instance Matching with MELTcited by 5
- 2020Visual Analysis of Ontology Matching Results with the MELT Dashboardcited by 3
Built on by
Citing papers per year: 2022: 1; 2023: 1.
2 papers.