Extracting Medication Changes in Clinical Narratives using Pre-trained Language Models
Not on the map. Why?
Abstract (arXiv)
An accurate and detailed account of patient medications, including medication changes within the patient timeline, is essential for healthcare providers to provide appropriate patient care. Healthcare providers or the patients themselves may initiate changes to patient medication. Medication changes take many forms, including prescribed medication and associated dosage modification. These changes provide information about the overall health of the patient and the rationale that led to the current care. Future care can then build on the resulting state of the patient. This work explores the automatic extraction of medication change information from free-text clinical notes. The Contextual Medication Event Dataset (CMED) is a corpus of clinical notes with annotations that characterize medication changes through multiple change-related attributes, including the type of change (start, stop, increase, etc.), initiator of the change, temporality, change likelihood, and negation. Using CMED, we identify medication mentions in clinical text and propose three novel high-performing BERT-based systems that resolve the annotated medication change characteristics. We demonstrate that our proposed systems improve medication change classification performance over the initial work exploring CMED.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 13 of its 53 references that are in the map. First posted on arXiv 17 Aug 2022.
Builds on
13 of 53 references.
References · 13
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2019BioBERT: a pre-trained biomedical language representation model for biomedical text miningcited by 1,935
- 2017Decoupled Weight Decay Regularizationcited by 1,722
- 2020Domain-Specific Language Model Pretraining for Biomedical Natural Language Processingcited by 996
- 2019Publicly Available Clinical BERT Embeddingscited by 995
- 2019Transfer Learning in Biomedical Natural Language Processing: An Evaluation of BERT and ELMo on Ten Benchmarking Datasetscited by 298
- 2019ScispaCy: Fast and Robust Models for Biomedical Natural Language Processingcited by 244
- 2019Span-based Joint Entity and Relation Extraction with Transformer Pre-trainingcited by 132
- 2020A Frustratingly Easy Approach for Entity and Relation Extractioncited by 37
- 2017Drug-Drug Interaction Extraction from Biomedical Text Using Long Short Term Memory Networkcited by 7
- 2020Toward Understanding Clinical Context of Medication Change Events in Clinical Narrativescited by 6
- 2020Learning the grammar of drug prescription: recurrent neural network grammars for medication information extraction in clinical textscited by 2
Built on by
Citing papers per year: 2023: 1; 2024: 2; 2025: 1.
4 papers.
- 2024Large Language Model Capabilities in Perioperative Risk Prediction and Prognosticationcited by 11
- 2024Zero- and Few-shot Named Entity Recognition and Text Expansion in Medication Prescriptions using ChatGPTcited by 1
- 2025Scalable Medication Extraction and Discontinuation Identification from Electronic Health Records Using Large Language Modelscited by 1
- 2023MasonNLP+ at SemEval-2023 Task 8: Extracting Medical Questions, Experiences and Claims from Social Media using Knowledge-Augmented Pre-trained Language Modelscited by 0
- 2025Scalable Medication Extraction and Discontinuation Identification from Electronic Health Records Using Large Language Models10 Jun 2025
- 2024Zero- and Few-shot Named Entity Recognition and Text Expansion in Medication Prescriptions using ChatGPT26 Sep 2024
- 2024Large Language Model Capabilities in Perioperative Risk Prediction and Prognostication3 Jan 2024
- 2023MasonNLP+ at SemEval-2023 Task 8: Extracting Medical Questions, Experiences and Claims from Social Media using Knowledge-Augmented Pre-trained Language Models26 Apr 2023