mlsanityData to 7 Oct 2026

Zero-shot Medical Entity Retrieval without Annotation: Learning From Rich Knowledge Graph Semantics

arXiv 2105.12682 ↗First posted 26 May 2021cs.CL cs.AIcited by 4

Not on the map. Why?

Abstract (arXiv)

Medical entity retrieval is an integral component for understanding and communicating information across various health systems. Current approaches tend to work well on specific medical domains but generalize poorly to unseen sub-specialties. This is of increasing concern under a public health crisis as new medical conditions and drug treatments come to light frequently. Zero-shot retrieval is challenging due to the high degree of ambiguity and variability in medical corpora, making it difficult to build an accurate similarity measure between mentions and concepts. Medical knowledge graphs (KG), however, contain rich semantics including large numbers of synonyms as well as its curated graphical structures. To take advantage of this valuable information, we propose a suite of learning tasks designed for training efficient zero-shot entity retrieval models. Without requiring any human annotation, our knowledge graph enriched architecture significantly outperforms common zero-shot benchmarks including BM25 and Clinical BERT with 7% to 30% higher recall across multiple major medical ontologies, such as UMLS, SNOMED, and ICD-10.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 10 of its 15 references that are in the map. First posted on arXiv 26 May 2021.

Builds on

10 of 15 references.

References · 10

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2019BioBERT: a pre-trained biomedical language representation model for biomedical text miningcited by 1,935
  4. 2019Publicly Available Clinical BERT Embeddingscited by 995
  5. 2020Pre-training Tasks for Embedding-based Large-scale Retrievalcited by 153
  6. 2019Scalable Zero-shot Entity Linking with Dense Entity Retrievalcited by 85
  7. 2019MedMentions: A Large Biomedical Corpus Annotated with UMLS Conceptscited by 79
  8. 2020COMETA: A Corpus for Medical Entity Linking in the Social Mediacited by 49
  9. 2020COVID-19 Knowledge Graph: Accelerating Information Retrieval and Discovery for Scientific Literaturecited by 14
  10. 2019LATTE: Latent Type Modeling for Biomedical Entity Linkingcited by 11

Built on by

Cited by year

Citing papers per year: 2022: 3; 2023: 0; 2024: 1.

4 papers.