A Survey for Large Language Models in Biomedicine
Not on the map. Why?
Abstract (arXiv)
Recent breakthroughs in large language models (LLMs) offer unprecedented natural language understanding and generation capabilities. However, existing surveys on LLMs in biomedicine often focus on specific applications or model architectures, lacking a comprehensive analysis that integrates the latest advancements across various biomedical domains. This review, based on an analysis of 484 publications sourced from databases including PubMed, Web of Science, and arXiv, provides an in-depth examination of the current landscape, applications, challenges, and prospects of LLMs in biomedicine, distinguishing itself by focusing on the practical implications of these models in real-world biomedical contexts. Firstly, we explore the capabilities of LLMs in zero-shot learning across a broad spectrum of biomedical tasks, including diagnostic assistance, drug discovery, and personalized medicine, among others, with insights drawn from 137 key studies. Then, we discuss adaptation strategies of LLMs, including fine-tuning methods for both uni-modal and multi-modal LLMs to enhance their performance in specialized biomedical contexts where zero-shot fails to achieve, such as medical question answering and efficient processing of biomedical literature. Finally, we discuss the challenges that LLMs face in the biomedicine domain including data privacy concerns, limited model interpretability, issues with dataset quality, and ethics due to the sensitive nature of biomedical data, the need for highly reliable model outputs, and the ethical implications of deploying AI in healthcare. To address these challenges, we also identify future research directions of LLM in biomedicine including federated learning methods to preserve data privacy and integrating explainable AI methodologies to enhance the transparency of LLMs.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 75 of its 149 references that are in the map. First posted on arXiv 29 Aug 2024.
Builds on
75 of 149 references.
References · 75
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2023GPT-4 Technical Reportcited by 18,132
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
- 2020Measuring Massive Multitask Language Understandingcited by 7,768
- 2016Layer Normalizationcited by 5,579
- 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,040
38 more
- 2021Zero-Shot Text-to-Image Generationcited by 4,276
- 2019Parameter-Efficient Transfer Learning for NLPcited by 4,195
- 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,355
- 2022Constitutional AI: Harmlessness from AI Feedbackcited by 2,950
- 2019BioBERT: a pre-trained biomedical language representation model for biomedical text miningcited by 1,935
- 2022Large Language Models Encode Clinical Knowledgecited by 1,807
- 2020What Disease does this Patient Have? A Large-scale Open Domain Question Answering Dataset from Medical Examscited by 1,324
- 2019PubMedQA: A Dataset for Biomedical Research Question Answeringcited by 1,271
- 2021GLM: General Language Model Pretraining with Autoregressive Blank Infillingcited by 1,026
- 2023A Comprehensive Overview of Large Language Modelscited by 639
- 2023Instruction Tuning for Large Language Models: A Surveycited by 617
- 2022BioGPT: Generative Pre-trained Transformer for Biomedical Text Generation and Miningcited by 531
- 2022MedMCQA : A Large-scale Multi-Subject Multi-Choice Dataset for Medical domain Question Answeringcited by 525
- 2023BiomedCLIP: a multimodal biomedical foundation model pretrained from fifteen million scientific image-text pairscited by 506
- 2024Large Language Models: A Surveycited by 506
- 2020PathVQA: 30000+ Questions for Medical Visual Question Answeringcited by 467
- 2021SLAKE: A Semantically-Labeled Knowledge-Enhanced Dataset for Medical Visual Question Answeringcited by 444
- 2023Towards Expert-Level Medical Question Answering with Large Language Modelscited by 382
- 2023ChatDoctor: A Medical Chat Model Fine-Tuned on a Large Language Model Meta-AI (LLaMA) Using Medical Domain Knowledgecited by 324
- 2023Towards Generalist Biomedical AIcited by 286
- 2023MedAlpaca -- An Open-Source Collection of Medical Conversational AI Models and Training Datacited by 282
- 2023MEDITRON-70B: Scaling Medical Pretraining for Large Language Modelscited by 272
- 2022GatorTron: A Large Clinical Language Model to Unlock Patient Information from Unstructured Electronic Health Recordscited by 238
- 2024Capabilities of Gemini Models in Medicinecited by 231
- 2023HuatuoGPT, towards Taming Language Model to Be a Doctorcited by 211
- 2023MedCPT: Contrastive Pre-trained Transformers with Large-scale PubMed Search Logs for Zero-shot Biomedical Information Retrievalcited by 182
- 2023HuaTuo: Tuning LLaMA Model with Chinese Medical Knowledgecited by 161
- 2023A Study of Generative Large Language Model for Medical Research and Healthcarecited by 160
- 2023DoctorGLM: Fine-tuning your Chinese Doctor is not a Herculean Taskcited by 130
- 2024OpenFedLLM: Training Large Language Models on Decentralized Private Data via Federated Learningcited by 124
- 2023A Survey of Large Language Models in Medicine: Progress, Application, and Challengecited by 123
- 2023Zhongjing: Enhancing the Chinese Medical Capabilities of Large Language Model through Expert Feedback and Real-world Multi-turn Dialoguecited by 118
- 2023BioMedGPT: Open Multimodal Generative Pre-trained Transformer for BioMedicinecited by 99
- 2023HuatuoGPT-II, One-stage Training for Medical Adaption of LLMscited by 91
- 2024Towards Building Multilingual Language Model for Medicinecited by 91
- 2023Benchmarking Large Language Models on CMExam -- A Comprehensive Chinese Medical Exam Datasetcited by 90
- 2023DISC-MedLLM: Bridging General Large Language Models and Real-World Medical Consultationcited by 89
- 2023AlpaCare:Instruction-tuned Large Language Models for Medical Applicationcited by 88
50 most cited of 75 All 75 (JSON)
Built on by
Citing papers per year: 2025: 1.
1 paper.
- 2025A Survey of LLM × DATAcited by 4
- 2025A Survey of LLM × DATA24 May 2025
Similar, not cited
Close in wording, no citation either way
- 2023Benchmarking large language models for biomedical natural language processing applications and recommendations
- 2024Biomedical Large Languages Models Seem not to be Superior to Generalist Models on Unseen Medical Data
- 2024The Limited Impact of Medical Adaptation of Large Language and Vision-Language Models
- 2024LLMs in Biomedicine: A study on clinical Named Entity Recognition
- 2023Evaluation of ChatGPT Family of Models for Biomedical Reasoning and Classification
- 2024A Comprehensive Survey of Large Language Models and Multimodal Large Language Models in Medicine
- 2024A Review on Scientific Knowledge Extraction using Large Language Models in Biomedical Sciences
- 2024Survey on Reasoning Capabilities and Accessibility of Large Language Models Using Biology-related Questions