Review of Natural Language Processing in Pharmacology
Not on the map. Why?
Abstract (arXiv)
Natural language processing (NLP) is an area of artificial intelligence that applies information technologies to process the human language, understand it to a certain degree, and use it in various applications. This area has rapidly developed in the last few years and now employs modern variants of deep neural networks to extract relevant patterns from large text corpora. The main objective of this work is to survey the recent use of NLP in the field of pharmacology. As our work shows, NLP is a highly relevant information extraction and processing approach for pharmacology. It has been used extensively, from intelligent searches through thousands of medical documents to finding traces of adversarial drug interactions in social media. We split our coverage into five categories to survey modern NLP methodology, commonly addressed tasks, relevant textual data, knowledge bases, and useful programming libraries. We split each of the five categories into appropriate subcategories, describe their main properties and ideas, and summarize them in a tabular form. The resulting survey presents a comprehensive overview of the area, useful to practitioners and interested observers.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 58 of its 258 references that are in the map. First posted on arXiv 22 Aug 2022.
Builds on
58 of 258 references.
References · 58
- 2017Attention Is All You Needcited by 60,361
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,555
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,070
- 2018GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understandingcited by 4,899
- 2019Parameter-Efficient Transfer Learning for NLPcited by 4,236
- 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
- 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,935
- 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,474
- 2018Deep contextualized word representationscited by 2,290
38 more
- 2019BioBERT: a pre-trained biomedical language representation model for biomedical text miningcited by 1,947
- 2020Don't Stop Pretraining: Adapt Language Models to Domains and Taskscited by 1,565
- 2019SciBERT: A Pretrained Language Model for Scientific Textcited by 1,414
- 2019Publicly Available Clinical BERT Embeddingscited by 1,002
- 2019Attention is not Explanationcited by 929
- 2020A Primer in BERTology: What we know about how BERT workscited by 815
- 2020AdapterFusion: Non-Destructive Task Composition for Transfer Learningcited by 788
- 2019Attention is not not Explanationcited by 636
- 2020Knowledge Graphscited by 621
- 2019ClinicalBERT: Modeling Clinical Notes and Predicting Hospital Readmissioncited by 493
- 2019Fooling LIME and SHAP: Adversarial Attacks on Post hoc Explanation Methodscited by 443
- 2018AllenNLP: A Deep Semantic Natural Language Processing Platformcited by 347
- 2019Transfer Learning in Biomedical Natural Language Processing: An Evaluation of BERT and ELMo on Ten Benchmarking Datasetscited by 299
- 2018A Survey on Deep Learning for Named Entity Recognitioncited by 282
- 2020Self-Alignment Pretraining for Biomedical Entity Representationscited by 237
- 2020CORD-19: The COVID-19 Open Research Datasetcited by 180
- 2021Post-hoc Interpretability for Neural NLP: A Surveycited by 156
- 2017PubMed 200k RCT: a Dataset for Sequential Sentence Classification in Medical Abstractscited by 124
- 2019Adaptation of Deep Bidirectional Multilingual Transformers for Russian Languagecited by 109
- 2020Shapley explainability on the data manifoldcited by 88
- 2020CharacterBERT: Reconciling ELMo and BERT for Word-Level Open-Vocabulary Representations From Characterscited by 87
- 2020Multi-domain Clinical Natural Language Processing with MedCAT: the Medical Concept Annotation Toolkitcited by 66
- 2020CODER: Knowledge infused cross-lingual medical term embedding for term normalizationcited by 55
- 2020UmlsBERT: Clinical Domain Knowledge Augmentation of Contextual Embeddings Using the Unified Medical Language System Metathesauruscited by 53
- 2020Effective Transfer Learning for Identifying Similar Questions: Matching User Questions to COVID-19 FAQscited by 48
- 2021A Review of Biomedical Datasets Relating to Drug Discovery: A Knowledge Graph Perspectivecited by 38
- 2019A Model to Search for Synthesizable Moleculescited by 37
- 2019CASTER: Predicting Drug Interactions with Chemical Substructure Representationcited by 24
- 2017dna2vec: Consistent vector representations of variable-length k-merscited by 16
- 2022LingYi: Medical Conversational Question Answering System based on Multi-modal Knowledge Graphscited by 15
- 2021Mixture-of-Partitions: Infusing Large Biomedical Knowledge Graphs into BERTcited by 14
- 2019Robustly Extracting Medical Knowledge from EHRs: A Case Study of Learning a Health Knowledge Graphcited by 12
- 2020Comprehensive Named Entity Recognition on CORD-19 with Distant or Weak Supervisioncited by 12
- 2020The Russian Drug Reaction Corpus and Neural Models for Drug Reactions and Effectiveness Detection in User Reviewscited by 11
- 2020Answering Questions on COVID-19 in Real-Timecited by 11
- 2019Many Faces of Feature Importance: Comparing Built-in and Post-hoc Feature Importance in Text Classificationcited by 10
- 2019Healthcare NER Models Using Language Model Pretrainingcited by 8
- 2020Explaining Black-box Models for Biomedical Text Classificationcited by 7
50 most cited of 58 All 58 (JSON)
Built on by
Citing papers per year: 2024: 1; 2025: 1; 2026: 1.
3 papers.