mlsanityData to 7 Oct 2026

Extracting Medication Changes in Clinical Narratives using Pre-trained Language Models

arXiv 2208.08417 ↗First posted 17 Aug 2022cs.CLcited by 4

Not on the map. Why?

Abstract (arXiv)

An accurate and detailed account of patient medications, including medication changes within the patient timeline, is essential for healthcare providers to provide appropriate patient care. Healthcare providers or the patients themselves may initiate changes to patient medication. Medication changes take many forms, including prescribed medication and associated dosage modification. These changes provide information about the overall health of the patient and the rationale that led to the current care. Future care can then build on the resulting state of the patient. This work explores the automatic extraction of medication change information from free-text clinical notes. The Contextual Medication Event Dataset (CMED) is a corpus of clinical notes with annotations that characterize medication changes through multiple change-related attributes, including the type of change (start, stop, increase, etc.), initiator of the change, temporality, change likelihood, and negation. Using CMED, we identify medication mentions in clinical text and propose three novel high-performing BERT-based systems that resolve the annotated medication change characteristics. We demonstrate that our proposed systems improve medication change classification performance over the initial work exploring CMED.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 13 of its 53 references that are in the map. First posted on arXiv 17 Aug 2022.

Builds on

13 of 53 references.

References · 13

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2019BioBERT: a pre-trained biomedical language representation model for biomedical text miningcited by 1,935
  3. 2017Decoupled Weight Decay Regularizationcited by 1,722
  4. 2020Domain-Specific Language Model Pretraining for Biomedical Natural Language Processingcited by 996
  5. 2019Publicly Available Clinical BERT Embeddingscited by 995
  6. 2019Transfer Learning in Biomedical Natural Language Processing: An Evaluation of BERT and ELMo on Ten Benchmarking Datasetscited by 298
  7. 2019ScispaCy: Fast and Robust Models for Biomedical Natural Language Processingcited by 244
  8. 2019Span-based Joint Entity and Relation Extraction with Transformer Pre-trainingcited by 132
  9. 2020A Frustratingly Easy Approach for Entity and Relation Extractioncited by 37
  10. 2017Drug-Drug Interaction Extraction from Biomedical Text Using Long Short Term Memory Networkcited by 7
  11. 2020Toward Understanding Clinical Context of Medication Change Events in Clinical Narrativescited by 6
  12. 2020Learning the grammar of drug prescription: recurrent neural network grammars for medication information extraction in clinical textscited by 2
1 more
  1. 2021Neural Medication Extraction: A Comparison of Recent Models in Supervised and Semi-supervised Learning Settingscited by 2

Built on by

Cited by year

Citing papers per year: 2023: 1; 2024: 2; 2025: 1.

4 papers.