mlsanityData to 14 Oct 2026

Boosting Adverse Drug Event Normalization on Social Media: General-Purpose Model Initialization and Biomedical Semantic Text Similarity Benefit Zero-Shot Linking in Informal Contexts

arXiv 2308.00157 ↗First posted 31 Jul 2023cs.CLcited by 2

Not on the map. Why?

Abstract (arXiv)

Biomedical entity linking, also known as biomedical concept normalization, has recently witnessed the rise to prominence of zero-shot contrastive models. However, the pre-training material used for these models has, until now, largely consisted of specialist biomedical content such as MIMIC-III clinical notes (Johnson et al., 2016) and PubMed papers (Sayers et al., 2021; Gao et al., 2020). While the resulting in-domain models have shown promising results for many biomedical tasks, adverse drug event normalization on social media texts has so far remained challenging for them (Portelli et al., 2022). In this paper, we propose a new approach for adverse drug event normalization on social media relying on general-purpose model initialization via BioLORD (Remy et al., 2022) and a semantic-text-similarity fine-tuning named STS. Our experimental results on several social media datasets demonstrate the effectiveness of our proposed approach, by achieving state-of-the-art performance. Based on its strong performance across all the tested datasets, we believe this work could emerge as a turning point for the task of adverse drug event normalization on social media and has the potential to serve as a benchmark for future research in the field.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 10 of its 26 references that are in the map. First posted on arXiv 31 Jul 2023.

Builds on

10 of 26 references.

References · 10

  1. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
  2. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  3. 2020The Pile: An 800GB Dataset of Diverse Text for Language Modelingcited by 2,411
  4. 2020Domain-Specific Language Model Pretraining for Biomedical Natural Language Processingcited by 1,009
  5. 2020Self-Alignment Pretraining for Biomedical Entity Representationscited by 237
  6. 2020Biomedical Entity Representations with Synonym Marginalizationcited by 61
  7. 2020CODER: Knowledge infused cross-lingual medical term embedding for term normalizationcited by 55
  8. 2018MedSTS: A Resource for Clinical Semantic Textual Similaritycited by 39
  9. 2022BioLORD: Learning Ontological Representations from Definitions (for Biomedical Concepts and their Textual Descriptions)cited by 21
  10. 2022Generalizing over Long Tail Concepts for Medical Term Normalizationcited by 8

Built on by

Cited by year

Citing papers per year: 2023: 1; 2024: 1.

2 papers.