mlsanityData to 14 Oct 2026

Review of Natural Language Processing in Pharmacology

arXiv 2208.10228 ↗First posted 22 Aug 2022cs.CL cs.LG q-bio.BMcited by 3

Not on the map. Why?

Abstract (arXiv)

Natural language processing (NLP) is an area of artificial intelligence that applies information technologies to process the human language, understand it to a certain degree, and use it in various applications. This area has rapidly developed in the last few years and now employs modern variants of deep neural networks to extract relevant patterns from large text corpora. The main objective of this work is to survey the recent use of NLP in the field of pharmacology. As our work shows, NLP is a highly relevant information extraction and processing approach for pharmacology. It has been used extensively, from intelligent searches through thousands of medical documents to finding traces of adversarial drug interactions in social media. We split our coverage into five categories to survey modern NLP methodology, commonly addressed tasks, relevant textual data, knowledge bases, and useful programming libraries. We split each of the five categories into appropriate subcategories, describe their main properties and ideas, and summarize them in a tabular form. The resulting survey presents a comprehensive overview of the area, useful to practitioners and interested observers.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 58 of its 258 references that are in the map. First posted on arXiv 22 Aug 2022.

Builds on

58 of 258 references.

References · 58

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
  4. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
  5. 2017A Unified Approach to Interpreting Model Predictionscited by 6,555
  6. 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,070
  7. 2018GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understandingcited by 4,899
  8. 2019Parameter-Efficient Transfer Learning for NLPcited by 4,236
  9. 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
  10. 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,935
  11. 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,474
  12. 2018Deep contextualized word representationscited by 2,290
38 more
  1. 2019BioBERT: a pre-trained biomedical language representation model for biomedical text miningcited by 1,947
  2. 2020Don't Stop Pretraining: Adapt Language Models to Domains and Taskscited by 1,565
  3. 2019SciBERT: A Pretrained Language Model for Scientific Textcited by 1,414
  4. 2019Publicly Available Clinical BERT Embeddingscited by 1,002
  5. 2019Attention is not Explanationcited by 929
  6. 2020A Primer in BERTology: What we know about how BERT workscited by 815
  7. 2020AdapterFusion: Non-Destructive Task Composition for Transfer Learningcited by 788
  8. 2019Attention is not not Explanationcited by 636
  9. 2020Knowledge Graphscited by 621
  10. 2019ClinicalBERT: Modeling Clinical Notes and Predicting Hospital Readmissioncited by 493
  11. 2019Fooling LIME and SHAP: Adversarial Attacks on Post hoc Explanation Methodscited by 443
  12. 2018AllenNLP: A Deep Semantic Natural Language Processing Platformcited by 347
  13. 2019Transfer Learning in Biomedical Natural Language Processing: An Evaluation of BERT and ELMo on Ten Benchmarking Datasetscited by 299
  14. 2018A Survey on Deep Learning for Named Entity Recognitioncited by 282
  15. 2020Self-Alignment Pretraining for Biomedical Entity Representationscited by 237
  16. 2020CORD-19: The COVID-19 Open Research Datasetcited by 180
  17. 2021Post-hoc Interpretability for Neural NLP: A Surveycited by 156
  18. 2017PubMed 200k RCT: a Dataset for Sequential Sentence Classification in Medical Abstractscited by 124
  19. 2019Adaptation of Deep Bidirectional Multilingual Transformers for Russian Languagecited by 109
  20. 2020Shapley explainability on the data manifoldcited by 88
  21. 2020CharacterBERT: Reconciling ELMo and BERT for Word-Level Open-Vocabulary Representations From Characterscited by 87
  22. 2020Multi-domain Clinical Natural Language Processing with MedCAT: the Medical Concept Annotation Toolkitcited by 66
  23. 2020CODER: Knowledge infused cross-lingual medical term embedding for term normalizationcited by 55
  24. 2020UmlsBERT: Clinical Domain Knowledge Augmentation of Contextual Embeddings Using the Unified Medical Language System Metathesauruscited by 53
  25. 2020Effective Transfer Learning for Identifying Similar Questions: Matching User Questions to COVID-19 FAQscited by 48
  26. 2021A Review of Biomedical Datasets Relating to Drug Discovery: A Knowledge Graph Perspectivecited by 38
  27. 2019A Model to Search for Synthesizable Moleculescited by 37
  28. 2019CASTER: Predicting Drug Interactions with Chemical Substructure Representationcited by 24
  29. 2017dna2vec: Consistent vector representations of variable-length k-merscited by 16
  30. 2022LingYi: Medical Conversational Question Answering System based on Multi-modal Knowledge Graphscited by 15
  31. 2021Mixture-of-Partitions: Infusing Large Biomedical Knowledge Graphs into BERTcited by 14
  32. 2019Robustly Extracting Medical Knowledge from EHRs: A Case Study of Learning a Health Knowledge Graphcited by 12
  33. 2020Comprehensive Named Entity Recognition on CORD-19 with Distant or Weak Supervisioncited by 12
  34. 2020The Russian Drug Reaction Corpus and Neural Models for Drug Reactions and Effectiveness Detection in User Reviewscited by 11
  35. 2020Answering Questions on COVID-19 in Real-Timecited by 11
  36. 2019Many Faces of Feature Importance: Comparing Built-in and Post-hoc Feature Importance in Text Classificationcited by 10
  37. 2019Healthcare NER Models Using Language Model Pretrainingcited by 8
  38. 2020Explaining Black-box Models for Biomedical Text Classificationcited by 7

50 most cited of 58 All 58 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 1; 2025: 1; 2026: 1.

3 papers.