mlsanityData to 7 Oct 2026

Efficient Biomedical Entity Linking: Clinical Text Standardization with Low-Resource Techniques

arXiv 2405.15134 ↗First posted 24 May 2024cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Clinical text is rich in information, with mentions of treatment, medication and anatomy among many other clinical terms. Multiple terms can refer to the same core concepts which can be referred as a clinical entity. Ontologies like the Unified Medical Language System (UMLS) are developed and maintained to store millions of clinical entities including the definitions, relations and other corresponding information. These ontologies are used for standardization of clinical text by normalizing varying surface forms of a clinical term through Biomedical entity linking. With the introduction of transformer-based language models, there has been significant progress in Biomedical entity linking. In this work, we focus on learning through synonym pairs associated with the entities. As compared to the existing approaches, our approach significantly reduces the training data and resource consumption. Moreover, we propose a suite of context-based and context-less reranking techniques for performing the entity disambiguation. Overall, we achieve similar performance to the state-of-the-art zero-shot and distant supervised entity linking techniques on the Medmentions dataset, the largest annotated dataset on UMLS, without any domain-based training. Finally, we show that retrieval performance alone might not be sufficient as an evaluation metric and introduce an article level quantitative and qualitative analysis to reveal further insights on the performance of entity linking methods.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 12 of its 24 references that are in the map. First posted on arXiv 24 May 2024.

Builds on

12 of 24 references.

References · 12

  1. 2017Attention Is All You Needcited by 59,932
  2. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  3. 2019BioBERT: a pre-trained biomedical language representation model for biomedical text miningcited by 1,935
  4. 2020MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformerscited by 1,414
  5. 2020Domain-Specific Language Model Pretraining for Biomedical Natural Language Processingcited by 996
  6. 2019ScispaCy: Fast and Robust Models for Biomedical Natural Language Processingcited by 244
  7. 2020Self-Alignment Pretraining for Biomedical Entity Representationscited by 233
  8. 2017Efficient Natural Language Response Suggestion for Smart Replycited by 228
  9. 2019MedMentions: A Large Biomedical Corpus Annotated with UMLS Conceptscited by 79
  10. 2022Generative Biomedical Entity Linking via Knowledge Base-Guided Pre-training and Synonyms-Aware Fine-tuningcited by 34
  11. 2021Knowledge-Rich Self-Supervision for Biomedical Entity Linkingcited by 31
  12. 2021Zero-shot Medical Entity Retrieval without Annotation: Learning From Rich Knowledge Graph Semanticscited by 4

Built on by

Not cited yet.