Biomedical Named Entity Recognition via Dictionary-based Synonym Generalization
Not on the map. Why?
Abstract (arXiv)
Biomedical named entity recognition is one of the core tasks in biomedical natural language processing (BioNLP). To tackle this task, numerous supervised/distantly supervised approaches have been proposed. Despite their remarkable success, these approaches inescapably demand laborious human effort. To alleviate the need of human effort, dictionary-based approaches have been proposed to extract named entities simply based on a given dictionary. However, one downside of existing dictionary-based approaches is that they are challenged to identify concept synonyms that are not listed in the given dictionary, which we refer as the synonym generalization problem. In this study, we propose a novel Synonym Generalization (SynGen) framework that recognizes the biomedical concepts contained in the input text using span-based predictions. In particular, SynGen introduces two regularization terms, namely, (1) a synonym distance regularizer; and (2) a noise perturbation regularizer, to minimize the synonym generalization error. To demonstrate the effectiveness of our approach, we provide a theoretical analysis of the bound of synonym generalization error. We extensively evaluate our approach on a wide range of benchmarks and the results verify that SynGen outperforms previous dictionary-based models by notable margins. Lastly, we provide a detailed analysis to further reveal the merits and inner-workings of our approach.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 30 of its 59 references that are in the map. First posted on arXiv 22 May 2023.
Builds on
30 of 59 references.
References · 30
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2019BioBERT: a pre-trained biomedical language representation model for biomedical text miningcited by 1,947
- 2020Sharpness-Aware Minimization for Efficiently Improving Generalizationcited by 1,417
- 2019SciBERT: A Pretrained Language Model for Scientific Textcited by 1,414
- 2020Domain-Specific Language Model Pretraining for Biomedical Natural Language Processingcited by 1,009
- 2018Multi-Task Identification of Entities, Relations, and Coreference for Scientific Knowledge Graph Constructioncited by 322
- 2019Entity, Relation, and Event Extraction with Contextualized Span Representationscited by 262
- 2017End-to-end Neural Coreference Resolutioncited by 241
- 2020Self-Alignment Pretraining for Biomedical Entity Representationscited by 237
- 2022Towards Understanding Sharpness-Aware Minimizationcited by 146
- 2021Sharpness-Aware Minimization Improves Language Model Generalizationcited by 108
- 2019A General Framework for Information Extraction using Dynamic Span Graphscited by 93
18 more
- 2020BOND: BERT-Assisted Open-Domain Named Entity Recognition with Distant Supervisioncited by 91
- 2017Automated Phrase Mining from Massive Text Corporacited by 70
- 2018Learning Named Entity Tagger using Domain-Specific Dictionarycited by 65
- 2020COMETA: A Corpus for Medical Entity Linking in the Social Mediacited by 50
- 2020Named Entity Recognition without Labelled Data: A Weak Supervision Approachcited by 46
- 2021Distantly-Supervised Named Entity Recognition with Noise-Robust Learning and Language Model Augmented Self-Trainingcited by 41
- 2020Biomedical Named Entity Recognition at Scalecited by 30
- 2017SwellShark: A Generative Model for Biomedical Named Entity Recognition without Labeled Datacited by 28
- 2018Cross-type Biomedical Named Entity Recognition with Deep Multi-Task Learningcited by 28
- 2021Learning Domain-Specialised Representations for Cross-Lingual Biomedical Entity Linkingcited by 28
- 2020HunFlair: An Easy-to-Use Tool for State-of-the-Art Biomedical Named Entity Recognitioncited by 26
- 2020Biomedical named entity recognition using BERT in the machine reading comprehension frameworkcited by 22
- 2022Distantly Supervised Named Entity Recognition via Confidence-Based Multi-Class Positive and Unlabeled Learningcited by 21
- 2021skweak: Weak Supervision Made Easy for NLPcited by 17
- 2017Unsupervised Aspect Term Extraction with B-LSTM & CRF using Automatically Labelled Datasetscited by 12
- 2021Improving Distantly-Supervised Named Entity Recognition with Self-Collaborative Denoising Learningcited by 11
- 2021End-to-end Biomedical Entity Linking with Span-based Dictionary Matchingcited by 5
- 2019Integrating Dictionary Feature into A Deep Learning Model for Disease Named Entity Recognitioncited by 1
Built on by
Citing papers per year: 2024: 1; 2025: 1; 2026: 1.
3 papers.
- 2024VerifiNER: Verification-augmented NER via Knowledge-grounded Reasoning with Large Language Modelscited by 3
- 2026TWIX: a Two-Stage Approach for End-To-End Named Entity Recognition and Relation Extractioncited by 1
- 2025Extracting Structured Requirements from Unstructured Building Technical Specifications for Building Information Modelingcited by 0
- 2026TWIX: a Two-Stage Approach for End-To-End Named Entity Recognition and Relation Extraction1 Sep 2026
- 2025Extracting Structured Requirements from Unstructured Building Technical Specifications for Building Information Modeling19 Aug 2025
- 2024VerifiNER: Verification-augmented NER via Knowledge-grounded Reasoning with Large Language Models28 Feb 2024