Zero-shot Medical Entity Retrieval without Annotation: Learning From Rich Knowledge Graph Semantics
Not on the map. Why?
Abstract (arXiv)
Medical entity retrieval is an integral component for understanding and communicating information across various health systems. Current approaches tend to work well on specific medical domains but generalize poorly to unseen sub-specialties. This is of increasing concern under a public health crisis as new medical conditions and drug treatments come to light frequently. Zero-shot retrieval is challenging due to the high degree of ambiguity and variability in medical corpora, making it difficult to build an accurate similarity measure between mentions and concepts. Medical knowledge graphs (KG), however, contain rich semantics including large numbers of synonyms as well as its curated graphical structures. To take advantage of this valuable information, we propose a suite of learning tasks designed for training efficient zero-shot entity retrieval models. Without requiring any human annotation, our knowledge graph enriched architecture significantly outperforms common zero-shot benchmarks including BM25 and Clinical BERT with 7% to 30% higher recall across multiple major medical ontologies, such as UMLS, SNOMED, and ICD-10.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 10 of its 15 references that are in the map. First posted on arXiv 26 May 2021.
Builds on
10 of 15 references.
References · 10
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2019BioBERT: a pre-trained biomedical language representation model for biomedical text miningcited by 1,935
- 2019Publicly Available Clinical BERT Embeddingscited by 995
- 2020Pre-training Tasks for Embedding-based Large-scale Retrievalcited by 153
- 2019Scalable Zero-shot Entity Linking with Dense Entity Retrievalcited by 85
- 2019MedMentions: A Large Biomedical Corpus Annotated with UMLS Conceptscited by 79
- 2020COMETA: A Corpus for Medical Entity Linking in the Social Mediacited by 49
- 2020COVID-19 Knowledge Graph: Accelerating Information Retrieval and Discovery for Scientific Literaturecited by 14
- 2019LATTE: Latent Type Modeling for Biomedical Entity Linkingcited by 11
Built on by
Citing papers per year: 2022: 3; 2023: 0; 2024: 1.
4 papers.
- 2022Knowledge Injected Prompt Based Fine-tuning for Multi-label Few-shot ICD Codingcited by 40
- 2022Detection, Disambiguation, Re-ranking: Autoregressive Entity Linking as a Multi-Task Problemcited by 11
- 2022Entity Anchored ICD Codingcited by 3
- 2024Efficient Biomedical Entity Linking: Clinical Text Standardization with Low-Resource Techniquescited by 0
- 2024Efficient Biomedical Entity Linking: Clinical Text Standardization with Low-Resource Techniques24 May 2024
- 2022Knowledge Injected Prompt Based Fine-tuning for Multi-label Few-shot ICD Coding7 Oct 2022
- 2022Entity Anchored ICD Coding15 Aug 2022
- 2022Detection, Disambiguation, Re-ranking: Autoregressive Entity Linking as a Multi-Task Problem12 Apr 2022