Knowledge-augmented Graph Neural Networks with Concept-aware Attention for Adverse Drug Event Detection
Not on the map. Why?
Abstract (arXiv)
Adverse drug events (ADEs) are an important aspect of drug safety. Various texts such as biomedical literature, drug reviews, and user posts on social media and medical forums contain a wealth of information about ADEs. Recent studies have applied word embedding and deep learning -based natural language processing to automate ADE detection from text. However, they did not explore incorporating explicit medical knowledge about drugs and adverse reactions or the corresponding feature learning. This paper adopts the heterogenous text graph which describes relationships between documents, words and concepts, augments it with medical knowledge from the Unified Medical Language System, and proposes a concept-aware attention mechanism which learns features differently for the different types of nodes in the graph. We further utilize contextualized embeddings from pretrained language models and convolutional graph neural networks for effective feature representation and relational learning. Experiments on four public datasets show that our model achieves performance competitive to the recent advances and the concept-aware attention consistently outperforms other attention mechanisms.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 18 of its 67 references that are in the map. First posted on arXiv 25 Jan 2023.
Builds on
18 of 67 references.
References · 18
- 2017Attention Is All You Needcited by 60,361
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
- 2017Graph Attention Networkscited by 8,923
- 2019BioBERT: a pre-trained biomedical language representation model for biomedical text miningcited by 1,947
- 2020Domain-Specific Language Model Pretraining for Biomedical Natural Language Processingcited by 1,009
- 2019Publicly Available Clinical BERT Embeddingscited by 1,002
- 2020A Survey on Knowledge Graphs: Representation, Acquisition and Applicationscited by 643
- 2020BERTweet: A pre-trained language model for English Tweetscited by 346
- 2018Graph Convolutional Networks for Text Classificationcited by 345
6 more
- 2020LUKE: Deep Contextualized Entity Representations with Entity-aware Self-attentioncited by 326
- 2017A Structured Self-attentive Sentence Embeddingcited by 318
- 2020Every Document Owns Its Structure: Inductive Text Classification via Graph Neural Networkscited by 77
- 2021BertGCN: Transductive Text Classification by Combining GCN and BERTcited by 74
- 2020Drug-disease Graph: Predicting Adverse Drug Reaction Signals via Graph Neural Network with Clinical Datacited by 4
- 2021Neural Text Classification and Stacked Heterogeneous Embeddings for Named Entity Recognition in SMM4H 2021cited by 2
Built on by
Not cited yet.