mlsanityData to 7 Oct 2026

Hierarchical Retrieval with Out-Of-Vocabulary Queries: A Case Study on SNOMED CT

arXiv 2511.16698 ↗First posted 17 Nov 2025cs.CL cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

SNOMED CT is a biomedical ontology with a hierarchical representation, modelling terminological concepts at a large scale. Knowledge retrieval in SNOMED CT is critical for its application but often proves challenging due to linguistic ambiguity, synonymy, polysemy, and so on. This problem is exacerbated when the queries are out-of-vocabulary (OOV), i.e., lacking any equivalent matches in the ontology. In this work, we focus on the problem of hierarchical concept retrieval from SNOMED CT with OOV queries, and propose an approach driven by utilising language model-based ontology embeddings, which represent hierarchical concepts in a hyperbolic space for enabling efficient subsumption inference between a textual query and an arbitrary concept. For evaluation, we construct three datasets where OOV queries are annotated against SNOMED CT concepts, testing the retrieval of the most specific subsumers and their less relevant ancestors. We find that our method outperforms the baselines, including SBERT, SapBERT, and two lexical matching methods. While evaluated against SNOMED CT, the approach is generalisable and can be extended to other ontologies. We release all the experiment codes and datasets at https://github.com/jonathondilworth/HR-OOV-SNOMED-CT.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 18 of its 32 references that are in the map. First posted on arXiv 17 Nov 2025.

Builds on

18 of 32 references.

References · 18

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  3. 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,462
  4. 2017Poincar'e Embeddings for Learning Hierarchical Representationscited by 674
  5. 2024Benchmarking Retrieval-Augmented Generation for Medicinecited by 326
  6. 2020Self-Alignment Pretraining for Biomedical Entity Representationscited by 233
  7. 2020OWL2Vec*: Embedding of OWL Ontologiescited by 63
  8. 2024Language Models as Hierarchy Encoderscited by 26
  9. 2018OPA2Vec: combining formal and informal content of biomedical ontologies to improve similarity-based predictioncited by 25
  10. 2023Language Model Analysis for Ontology Subsumption Inferencecited by 25
  11. 2023DeepOnto: A Python Package for Ontology Engineering with Deep Learningcited by 20
  12. 2024Ontology Embedding: A Survey of Methods, Applications and Resourcescited by 12
6 more
  1. 2023Reveal the Unknown: Out-of-Knowledge-Base Mention Discovery with Entity Linkingcited by 7
  2. 2023Ontology Enrichment from Texts: A Biomedical Dataset for Concept Discovery and Placementcited by 7
  3. 2024SNOBERT: A Benchmark for clinical notes entity linking in the SNOMED CT clinical terminologycited by 4
  4. 2025Language Models as Ontology Encoderscited by 4
  5. 2025Hierarchical Retrieval: The Geometry and a Pretrain-Finetune Recipecited by 4
  6. 2024A Language Model based Framework for New Concept Placement in Ontologiescited by 3

Built on by

Not cited yet.