ADEQA: A Question Answer based approach for joint ADE-Suspect Extraction using Sequence-To-Sequence Transformers
Not on the map. Why?
Abstract (arXiv)
Early identification of Adverse Drug Events (ADE) is critical for taking prompt actions while introducing new drugs into the market. These ADEs information are available through various unstructured data sources like clinical study reports, patient health records, social media posts, etc. Extracting ADEs and the related suspect drugs using machine learning is a challenging task due to the complex linguistic relations between drug ADE pairs in textual data and unavailability of large corpus of labelled datasets. This paper introduces ADEQA, a question-answer(QA) based approach using quasi supervised labelled data and sequence-to-sequence transformers to extract ADEs, drug suspects and the relationships between them. Unlike traditional QA models, natural language generation (NLG) based models don't require extensive token level labelling and thereby reduces the adoption barrier significantly. On a public ADE corpus, we were able to achieve state-of-the-art results with an F1 score of 94% on establishing the relationships between ADEs and the respective suspects.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 18 of its 37 references that are in the map. First posted on arXiv 20 Dec 2024.
Builds on
18 of 37 references.
References · 18
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
- 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,016
- 2019BioBERT: a pre-trained biomedical language representation model for biomedical text miningcited by 1,935
- 2016Neural Architectures for Named Entity Recognitioncited by 548
- 2015Bidirectional LSTM-CRF Models for Sequence Taggingcited by 544
- 2021Structured Prediction as Translation between Augmented Natural Languagescited by 183
- 2019Span-based Joint Entity and Relation Extraction with Transformer Pre-trainingcited by 132
- 2019Entity-Relation Extraction as Multi-Turn Question Answeringcited by 96
- 2020Two are Better than One: Joint Entity and Relation Extraction with Table-Sequence Encoderscited by 87
6 more
- 2018Design Challenges and Misconceptions in Neural Sequence Labelingcited by 28
- 2021Imposing Relation Structure in Language-Model Embeddings Using Contrastive Learningcited by 9
- 2021Exploring a Unified Sequence-To-Sequence Transformer for Medical Product Safety Monitoring in Social Mediacited by 9
- 2021Deeper Clinical Document Understanding Using Relation Extractioncited by 7
- 2020Deeper Task-Specificity Improves Joint Entity and Relation Extractioncited by 6
- 2018An Attentive Sequence Model for Adverse Drug Event Extraction from Biomedical Textcited by 1
Built on by
Not cited yet.