# The Knowledge Graph Track at OAEI -- Gold Standards, Baselines, and the Golden Hammer Bias

arXiv: https://arxiv.org/abs/2002.10283 · HTML: https://mlsanity.com/paper/2002.10283/

## Key facts

- Cited by 9 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 24 Feb 2020.

## Built on by (most cited first, 9 of 9)

- [OLaLa: Ontology Matching with Large Language Models](https://mlsanity.com/paper/2311.03837/) (2023)
- [Stratified Data Integration](https://mlsanity.com/paper/2105.09432/) (2021)
- [Towards Entity Alignment in the Open World: An Unsupervised Approach](https://mlsanity.com/paper/2101.10535/) (2021)
- [Matching with Transformers in MELT](https://mlsanity.com/paper/2109.07401/) (2021)
- [Gollum: A Gold Standard for Large Scale Multi Source Knowledge Graph Matching](https://mlsanity.com/paper/2209.07479/) (2022)
- [Evaluation of Pipelines for Data Integration into Knowledge Graphs](https://mlsanity.com/paper/2605.22304/) (2026)
- [Full Triple Matcher: Integrating all triple elements between heterogeneous Knowledge Graphs](https://mlsanity.com/paper/2507.22914/) (2025)
- [FLORA: Unsupervised Knowledge Graph Alignment by Fuzzy Logic](https://mlsanity.com/paper/2510.20467/) (2025)
- [Semantic Networks as Clues: A Theoretical Foundation and Process Optimization for Semantic Network Construction](https://mlsanity.com/paper/2608.01936/) (2026)

## Abstract (arXiv)

The Ontology Alignment Evaluation Initiative (OAEI) is an annual evaluation of ontology matching tools. In 2018, we have started the Knowledge Graph track, whose goal is to evaluate the simultaneous matching of entities and schemas of large-scale knowledge graphs. In this paper, we discuss the design of the track and two different strategies of gold standard creation. We analyze results and experiences obtained in first editions of the track, and, by revealing a hidden task, we show that all tools submitted to the track (and probably also to other tracks) suffer from a bias which we name the golden hammer bias.