mlsanityData to 7 Oct 2026

A Survey for Large Language Models in Biomedicine

arXiv 2409.00133 ↗First posted 29 Aug 2024cs.CL cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

Recent breakthroughs in large language models (LLMs) offer unprecedented natural language understanding and generation capabilities. However, existing surveys on LLMs in biomedicine often focus on specific applications or model architectures, lacking a comprehensive analysis that integrates the latest advancements across various biomedical domains. This review, based on an analysis of 484 publications sourced from databases including PubMed, Web of Science, and arXiv, provides an in-depth examination of the current landscape, applications, challenges, and prospects of LLMs in biomedicine, distinguishing itself by focusing on the practical implications of these models in real-world biomedical contexts. Firstly, we explore the capabilities of LLMs in zero-shot learning across a broad spectrum of biomedical tasks, including diagnostic assistance, drug discovery, and personalized medicine, among others, with insights drawn from 137 key studies. Then, we discuss adaptation strategies of LLMs, including fine-tuning methods for both uni-modal and multi-modal LLMs to enhance their performance in specialized biomedical contexts where zero-shot fails to achieve, such as medical question answering and efficient processing of biomedical literature. Finally, we discuss the challenges that LLMs face in the biomedicine domain including data privacy concerns, limited model interpretability, issues with dataset quality, and ethics due to the sensitive nature of biomedical data, the need for highly reliable model outputs, and the ethical implications of deploying AI in healthcare. To address these challenges, we also identify future research directions of LLM in biomedicine including federated learning methods to preserve data privacy and integrating explainable AI methodologies to enhance the transparency of LLMs.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 75 of its 149 references that are in the map. First posted on arXiv 29 Aug 2024.

Builds on

75 of 149 references.

References · 75

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  3. 2020Language Models are Few-Shot Learnerscited by 32,199
  4. 2023GPT-4 Technical Reportcited by 18,132
  5. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  6. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  7. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  8. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  9. 2020Measuring Massive Multitask Language Understandingcited by 7,768
  10. 2016Layer Normalizationcited by 5,579
  11. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
  12. 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,040
38 more
  1. 2021Zero-Shot Text-to-Image Generationcited by 4,276
  2. 2019Parameter-Efficient Transfer Learning for NLPcited by 4,195
  3. 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,355
  4. 2022Constitutional AI: Harmlessness from AI Feedbackcited by 2,950
  5. 2019BioBERT: a pre-trained biomedical language representation model for biomedical text miningcited by 1,935
  6. 2022Large Language Models Encode Clinical Knowledgecited by 1,807
  7. 2020What Disease does this Patient Have? A Large-scale Open Domain Question Answering Dataset from Medical Examscited by 1,324
  8. 2019PubMedQA: A Dataset for Biomedical Research Question Answeringcited by 1,271
  9. 2021GLM: General Language Model Pretraining with Autoregressive Blank Infillingcited by 1,026
  10. 2023A Comprehensive Overview of Large Language Modelscited by 639
  11. 2023Instruction Tuning for Large Language Models: A Surveycited by 617
  12. 2022BioGPT: Generative Pre-trained Transformer for Biomedical Text Generation and Miningcited by 531
  13. 2022MedMCQA : A Large-scale Multi-Subject Multi-Choice Dataset for Medical domain Question Answeringcited by 525
  14. 2023BiomedCLIP: a multimodal biomedical foundation model pretrained from fifteen million scientific image-text pairscited by 506
  15. 2024Large Language Models: A Surveycited by 506
  16. 2020PathVQA: 30000+ Questions for Medical Visual Question Answeringcited by 467
  17. 2021SLAKE: A Semantically-Labeled Knowledge-Enhanced Dataset for Medical Visual Question Answeringcited by 444
  18. 2023Towards Expert-Level Medical Question Answering with Large Language Modelscited by 382
  19. 2023ChatDoctor: A Medical Chat Model Fine-Tuned on a Large Language Model Meta-AI (LLaMA) Using Medical Domain Knowledgecited by 324
  20. 2023Towards Generalist Biomedical AIcited by 286
  21. 2023MedAlpaca -- An Open-Source Collection of Medical Conversational AI Models and Training Datacited by 282
  22. 2023MEDITRON-70B: Scaling Medical Pretraining for Large Language Modelscited by 272
  23. 2022GatorTron: A Large Clinical Language Model to Unlock Patient Information from Unstructured Electronic Health Recordscited by 238
  24. 2024Capabilities of Gemini Models in Medicinecited by 231
  25. 2023HuatuoGPT, towards Taming Language Model to Be a Doctorcited by 211
  26. 2023MedCPT: Contrastive Pre-trained Transformers with Large-scale PubMed Search Logs for Zero-shot Biomedical Information Retrievalcited by 182
  27. 2023HuaTuo: Tuning LLaMA Model with Chinese Medical Knowledgecited by 161
  28. 2023A Study of Generative Large Language Model for Medical Research and Healthcarecited by 160
  29. 2023DoctorGLM: Fine-tuning your Chinese Doctor is not a Herculean Taskcited by 130
  30. 2024OpenFedLLM: Training Large Language Models on Decentralized Private Data via Federated Learningcited by 124
  31. 2023A Survey of Large Language Models in Medicine: Progress, Application, and Challengecited by 123
  32. 2023Zhongjing: Enhancing the Chinese Medical Capabilities of Large Language Model through Expert Feedback and Real-world Multi-turn Dialoguecited by 118
  33. 2023BioMedGPT: Open Multimodal Generative Pre-trained Transformer for BioMedicinecited by 99
  34. 2023HuatuoGPT-II, One-stage Training for Medical Adaption of LLMscited by 91
  35. 2024Towards Building Multilingual Language Model for Medicinecited by 91
  36. 2023Benchmarking Large Language Models on CMExam -- A Comprehensive Chinese Medical Exam Datasetcited by 90
  37. 2023DISC-MedLLM: Bridging General Large Language Models and Real-World Medical Consultationcited by 89
  38. 2023AlpaCare:Instruction-tuned Large Language Models for Medical Applicationcited by 88

50 most cited of 75 All 75 (JSON)

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2023Benchmarking large language models for biomedical natural language processing applications and recommendations
  2. 2024Biomedical Large Languages Models Seem not to be Superior to Generalist Models on Unseen Medical Data
  3. 2024The Limited Impact of Medical Adaptation of Large Language and Vision-Language Models
  4. 2024LLMs in Biomedicine: A study on clinical Named Entity Recognition
  5. 2023Evaluation of ChatGPT Family of Models for Biomedical Reasoning and Classification
  6. 2024A Comprehensive Survey of Large Language Models and Multimodal Large Language Models in Medicine
  7. 2024A Review on Scientific Knowledge Extraction using Large Language Models in Biomedical Sciences
  8. 2024Survey on Reasoning Capabilities and Accessibility of Large Language Models Using Biology-related Questions