mlsanityData to 7 Oct 2026

A Self-matching Training Method with Annotation Embedding Models for Ontology Subsumption Prediction

arXiv 2402.16278 ↗First posted 26 Feb 2024cs.AI cs.CL cs.LGcited by 2

Not on the map. Why?

Abstract (arXiv)

Recently, ontology embeddings representing entities in a low-dimensional space have been proposed for ontology completion. However, the ontology embeddings for concept subsumption prediction do not address the difficulties of similar and isolated entities and fail to extract the global information of annotation axioms from an ontology. In this paper, we propose a self-matching training method for the two ontology embedding models: Inverted-index Matrix Embedding (InME) and Co-occurrence Matrix Embedding (CoME). The two embeddings capture the global and local information in annotation axioms by means of the occurring locations of each word in a set of axioms and the co-occurrences of words in each axiom. The self-matching training method increases the robustness of the concept subsumption prediction when predicted superclasses are similar to subclasses and are isolated to other entities in an ontology. Our evaluation experiments show that the self-matching training method with InME outperforms the existing ontology embeddings for the GO and FoodOn ontologies and that the method with the concatenation of CoME and OWL2Vec* outperforms them for the HeLiS ontology.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 18 of its 47 references that are in the map. First posted on arXiv 26 Feb 2024.

Builds on

18 of 47 references.

References · 18

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,346
  3. 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,462
  4. 2014Embedding Entities and Relations for Learning and Inference in Knowledge Basescited by 929
  5. 2016Complex Embeddings for Simple Link Predictioncited by 897
  6. 2019RotatE: Knowledge Graph Embedding by Relational Rotation in Complex Spacecited by 893
  7. 2015Holographic Embeddings of Knowledge Graphscited by 181
  8. 2019Learning Hierarchy-Aware Knowledge Graph Embeddings for Link Predictioncited by 133
  9. 2020OWL2Vec*: Embedding of OWL Ontologiescited by 63
  10. 2019EL Embeddings: Geometric construction of models for the Description Logic EL ++cited by 48
  11. 2023Making Large Language Models Perform Better in Knowledge Graph Completioncited by 48
  12. 2023Exploring Large Language Models for Knowledge Graph Completioncited by 43
6 more
  1. 2021Modeling Heterogeneous Hierarchies with Relation-specific Hyperbolic Conescited by 38
  2. 2022Contextual Semantic Embeddings for Ontology Subsumption Predictioncited by 31
  3. 2018OPA2Vec: combining formal and informal content of biomedical ontologies to improve similarity-based predictioncited by 25
  4. 2022Faithiful Embeddings for EL++ Knowledge Basescited by 25
  5. 2023Dual Box Embeddings for the Description Logic EL++cited by 21
  6. 2018Onto2Vec: joint vector-based representation of biological entities and their ontology-based annotationscited by 18

Built on by

Cited by year

Citing papers per year: 2024: 2.

2 papers.