mlsanityData to 7 Oct 2026

Automated and Explainable Ontology Extension Based on Deep Learning: A Case Study in the Chemical Domain

arXiv 2109.09202 ↗First posted 19 Sep 2021cs.AIcited by 3

Not on the map. Why?

Abstract (arXiv)

Reference ontologies provide a shared vocabulary and knowledge resource for their domain. Manual construction enables them to maintain a high quality, allowing them to be widely accepted across their community. However, the manual development process does not scale for large domains. We present a new methodology for automatic ontology extension and apply it to the ChEBI ontology, a prominent reference ontology for life sciences chemistry. We trained a Transformer-based deep learning model on the leaf node structures from the ChEBI ontology and the classes to which they belong. The model is then capable of automatically classifying previously unseen chemical structures. The proposed model achieved an overall F1 score of 0.80, an improvement of 6 percentage points over our previous results on the same dataset. Additionally, we demonstrate how visualizing the model's attention weights can help to explain the results by providing insight into how the model made its decisions.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 12 of its 49 references that are in the map. First posted on arXiv 19 Sep 2021.

Builds on

12 of 49 references.

References · 12

  1. 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,346
  2. 2018Explaining Explanations: An Overview of Interpretability of Machine Learningcited by 508
  3. 2019Is Attention Interpretable?cited by 387
  4. 2020ChemBERTa: Large-Scale Self-Supervised Pretraining for Molecular Property Predictioncited by 332
  5. 2019A Multiscale Visualization of Attention in the Transformer Modelcited by 292
  6. 2020Logical Neural Networkscited by 118
  7. 2019Learning to Deceive with Attention-Based Explanationscited by 111
  8. 2020BERTology Meets Biology: Interpreting Attention in Protein Language Modelscited by 85
  9. 2017"Found in Translation": Predicting Outcomes of Complex Organic Chemistry Reactions using Neural Sequence-to-Sequence Modelscited by 54
  10. 2017SMILES2Vec: An Interpretable General-Purpose Deep Neural Network for Predicting Chemical Propertiescited by 30
  11. 2021Learning Description Logic Ontologies. Five Approaches. Where Do They Stand?cited by 12
  12. 2019Interrogating the Explanatory Power of Attention in Neural Machine Translationcited by 7

Built on by

Cited by year

Citing papers per year: 2022: 2; 2023: 0; 2024: 0; 2025: 1.

3 papers.