# A Comparison of Word Embeddings for the Biomedical Natural Language Processing

arXiv: https://arxiv.org/abs/1802.00400 · HTML: https://mlsanity.com/paper/1802.00400/

## Key facts

- Cited by 29 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 1 Feb 2018.

## Built on by (most cited first, 29 of 29)

- [AttentionViz: A Global View of Transformer Attention](https://mlsanity.com/paper/2305.03210/) (2023)
- [AMMU : A Survey of Transformer-based Biomedical Pretrained Language Models](https://mlsanity.com/paper/2105.00827/) (2021)
- [Learning Domain-Specialised Representations for Cross-Lingual Biomedical Entity Linking](https://mlsanity.com/paper/2105.14398/) (2021)
- [COVID-19 sentiment analysis via deep learning during the rise of novel cases](https://mlsanity.com/paper/2104.10662/) (2021)
- [Pretrained Domain-Specific Language Model for General Information Retrieval Tasks in the AEC Domain](https://mlsanity.com/paper/2203.04729/) (2022)
- [Improving the robustness and accuracy of biomedical language models through adversarial training](https://mlsanity.com/paper/2111.08529/) (2021)
- [A Hybrid Approach to Measure Semantic Relatedness in Biomedical Concepts](https://mlsanity.com/paper/2101.10196/) (2021)
- [Deep Learning, Natural Language Processing, and Explainable Artificial Intelligence in the Biomedical Domain](https://mlsanity.com/paper/2202.12678/) (2022)
- [Machine learning in bioprocess development: From promise to practice](https://mlsanity.com/paper/2210.02200/) (2022)
- [Rationale production to support clinical decision-making](https://mlsanity.com/paper/2111.07611/) (2021)
- [A Context-Enhanced De-identification System](https://mlsanity.com/paper/2102.08513/) (2021)
- [Active learning for medical code assignment](https://mlsanity.com/paper/2104.05741/) (2021)
- [A Survey On Neural Word Embeddings](https://mlsanity.com/paper/2110.01804/) (2021)
- [A Comprehensive Analysis of Static Word Embeddings for Turkish](https://mlsanity.com/paper/2405.07778/) (2024)
- [Multi-Label Annotation of Chest Abdomen Pelvis Computed Tomography Text Reports Using Deep Learning](https://mlsanity.com/paper/2102.02959/) (2021)
- [Transfer Learning in Electronic Health Records through Clinical Concept Embedding](https://mlsanity.com/paper/2107.12919/) (2021)
- [A Comprehensive Comparison of Word Embeddings in Event & Entity Coreference Resolution](https://mlsanity.com/paper/2110.05115/) (2021)
- [Leveraging knowledge graphs to update scientific word embeddings using latent semantic imputation](https://mlsanity.com/paper/2210.15358/) (2022)
- [Assessing biomedical knowledge robustness in large language models by query-efficient sampling attacks](https://mlsanity.com/paper/2402.10527/) (2024)
- [DKE-Research at SemEval-2024 Task 2: Incorporating Data Augmentation with Generative Models and Biomedical Knowledge to Enhance Inference Robustness](https://mlsanity.com/paper/2404.09206/) (2024)
- [Attraction-Repulsion Swarming: A Generalized Framework of t-SNE via Force Normalization and Tunable Interactions](https://mlsanity.com/paper/2411.10617/) (2024)
- [Less Context, Same Performance: A RAG Framework for Resource-Efficient LLM-Based Clinical NLP](https://mlsanity.com/paper/2505.20320/) (2025)
- [Unlocking Electronic Health Records: A Hybrid Graph RAG Approach to Safe Clinical AI for Patient QA](https://mlsanity.com/paper/2602.00009/) (2025)
- [Beyond Accuracy: Measuring Representation Capacity of Embeddings to Preserve Structural and Contextual Information](https://mlsanity.com/paper/2309.11294/) (2023)
- [An Interpretable Deep-Learning Framework for Predicting Hospital Readmissions From Electronic Health Records](https://mlsanity.com/paper/2310.10187/) (2023)
- [Predicting ATP binding sites in protein sequences using Deep Learning and Natural Language Processing](https://mlsanity.com/paper/2402.01829/) (2024)
- [Word Embedding Techniques for Classification of Star Ratings](https://mlsanity.com/paper/2504.13653/) (2025)
- [Enhancing Clinical Text Classification via Fine-Tuned DRAGON Longformer Models](https://mlsanity.com/paper/2507.09470/) (2025)
- [CaresAI at CT-DEB26: Detecting Dosing Errors In Clinical Trials Using Domain-Specific Transformer Embeddings and Classification Models](https://mlsanity.com/paper/2606.30236/) (2026)

## Abstract (arXiv)

Word embeddings have been widely used in biomedical Natural Language Processing (NLP) applications as they provide vector representations of words capturing the semantic properties of words and the linguistic relationship between words. Many biomedical applications use different textual resources (e.g., Wikipedia and biomedical articles) to train word embeddings and apply these word embeddings to downstream biomedical applications. However, there has been little work on evaluating the word embeddings trained from these resources.In this study, we provide an empirical evaluation of word embeddings trained from four different resources, namely clinical notes, biomedical publications, Wikipedia, and news. We performed the evaluation qualitatively and quantitatively. For the qualitative evaluation, we manually inspected five most similar medical words to a given set of target medical words, and then analyzed word embeddings through the visualization of those word embeddings. For the quantitative evaluation, we conducted both intrinsic and extrinsic evaluation. Based on the evaluation results, we can draw the following conclusions. First, the word embeddings trained on clinical notes and biomedical publications can capture the semantics of medical terms better, and find more relevant similar medical terms, and are closer to human experts' judgments, compared to these trained on Wikipedia and news. Second, there does not exist a consistent global ranking of word embedding quality for downstream biomedical NLP applications. However, adding word embeddings as extra features will improve results on most downstream tasks. Finally, the word embeddings trained on biomedical domain corpora do not necessarily have better performance than those trained on other general domain corpora for any downstream biomedical NLP tasks.