mlsanityData to 14 Oct 2026

Improving Adverse Drug Event Extraction with SpanBERT on Different Text Typologies

arXiv 2105.08882 ↗First posted 19 May 2021cs.CL cs.LGcited by 7

Not on the map. Why?

Abstract (arXiv)

In recent years, Internet users are reporting Adverse Drug Events (ADE) on social media, blogs and health forums. Because of the large volume of reports, pharmacovigilance is seeking to resort to NLP to monitor these outlets. We propose for the first time the use of the SpanBERT architecture for the task of ADE extraction: this new version of the popular BERT transformer showed improved capabilities with multi-token text spans. We validate our hypothesis with experiments on two datasets (SMM4H and CADEC) with different text typologies (tweets and blog posts), finding that SpanBERT combined with a CRF outperforms all the competitors on both of them.

Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 8 of its 25 references that are in the map. First posted on arXiv 19 May 2021.

Builds on

8 of 25 references.

References · 8

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2019BioBERT: a pre-trained biomedical language representation model for biomedical text miningcited by 1,947
  3. 2016Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translationcited by 1,475
  4. 2019SpanBERT: Improving Pre-training by Representing and Predicting Spanscited by 834
  5. 2019Span-based Joint Entity and Relation Extraction with Transformer Pre-trainingcited by 133
  6. 2020An Effective Transition-based Model for Discontinuous NERcited by 33
  7. 2020Dissecting Span Identification Tasks with Performance Predictioncited by 13
  8. 2018Neural DrugNetcited by 1

Built on by

Cited by year

Citing papers per year: 2021: 2; 2022: 2; 2023: 0; 2024: 2; 2025: 1.

7 papers.

  1. 2021Exploring a Unified Sequence-To-Sequence Transformer for Medical Product Safety Monitoring in Social Mediacited by 9
  2. 2021NADE: A Benchmark for Robust Adverse Drug Events Extraction in Face of Negationscited by 5
  3. 2022Increasing Adverse Drug Events extraction robustness on social media: case study on negation and speculationcited by 3
  4. 2022AILAB-Udine@SMM4H 22: Limits of Transformers and BERT Ensemblescited by 2
  5. 2024MultiADE: A Multi-domain Benchmark for Adverse Drug Event Extractioncited by 1
  6. 2024DistALANER: Distantly Supervised Active Learning Augmented Named Entity Recognition in the Open Source Software Ecosystemcited by 0
  7. 2025RA-MTR: A Retrieval Augmented Multi-Task Reader based Approach for Inspirational Quote Extraction from Long Documentscited by 0