Advances in Large Language Models for Medicine
Not on the map. Why?
Abstract (arXiv)
Artificial intelligence (AI) technology has advanced rapidly in recent years, with large language models (LLMs) emerging as a significant breakthrough. LLMs are increasingly making an impact across various industries, with the medical field standing out as the most prominent application area. This paper systematically reviews the up-to-date research progress of LLMs in the medical field, providing an in-depth analysis of training techniques for large medical models, their adaptation in healthcare settings, related applications, as well as their strengths and limitations. Furthermore, it innovatively categorizes medical LLMs into three distinct types based on their training methodologies and classifies their evaluation approaches into two categories. Finally, the study proposes solutions to existing challenges and outlines future research directions based on identified issues in the field of medical LLMs. By systematically reviewing previous and advanced research findings, we aim to highlight the necessity of developing medical LLMs, provide a deeper understanding of their current state of development, and offer clear guidance for subsequent research.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 83 of its 180 references that are in the map. First posted on arXiv 23 Sep 2025.
Builds on
83 of 180 references.
References · 83
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2023GPT-4 Technical Reportcited by 18,396
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,326
- 2019Parameter-Efficient Transfer Learning for NLPcited by 4,236
- 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,915
38 more
- 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,795
- 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,780
- 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,212
- 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,191
- 2019BioBERT: a pre-trained biomedical language representation model for biomedical text miningcited by 1,947
- 2023Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflectioncited by 1,839
- 2022Large Language Models Encode Clinical Knowledgecited by 1,830
- 2023LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One Daycited by 1,305
- 2021GLM: General Language Model Pretraining with Autoregressive Blank Infillingcited by 1,031
- 2020Domain-Specific Language Model Pretraining for Biomedical Natural Language Processingcited by 1,009
- 2022Interleaving Retrieval with Chain-of-Thought Reasoning for Knowledge-Intensive Multi-Step Questionscited by 923
- 2023A Survey on Multimodal Large Language Modelscited by 909
- 2023Baichuan 2: Open Large-scale Language Modelscited by 670
- 2023C-Pack: Packed Resources For General Chinese Embeddingscited by 578
- 2022BioGPT: Generative Pre-trained Transformer for Biomedical Text Generation and Miningcited by 538
- 2020Evaluation: from precision, recall and F-measure to ROC, informedness, markedness and correlationcited by 425
- 2023Med-Flamingo: a Multimodal Medical Few-shot Learnercited by 392
- 2023A Survey of Hallucination in Large Foundation Modelscited by 368
- 2024Benchmarking Retrieval-Augmented Generation for Medicinecited by 331
- 2023Can Generalist Foundation Models Outcompete Special-Purpose Tuning? Case Study in Medicinecited by 329
- 2023ChatDoctor: A Medical Chat Model Fine-Tuned on a Large Language Model Meta-AI (LLaMA) Using Medical Domain Knowledgecited by 325
- 2023LLM-Adapters: An Adapter Family for Parameter-Efficient Fine-Tuning of Large Language Modelscited by 324
- 2023GPT4RoI: Instruction Tuning Large Language Model on Region-of-Interestcited by 302
- 2024BioMistral: A Collection of Open-Source Pretrained Large Language Models for Medical Domainscited by 301
- 2023MedAlpaca -- An Open-Source Collection of Medical Conversational AI Models and Training Datacited by 286
- 2022GatorTron: A Large Clinical Language Model to Unlock Patient Information from Unstructured Electronic Health Recordscited by 238
- 2023HuatuoGPT, towards Taming Language Model to Be a Doctorcited by 214
- 2023Multimodal Large Language Models: A Surveycited by 195
- 2023A Survey of Large Language Models for Healthcare: from Data, Technology, and Applications to Accountability and Ethicscited by 163
- 2023HuaTuo: Tuning LLaMA Model with Chinese Medical Knowledgecited by 162
- 2020MedDialog: Two Large-scale Medical Dialogue Datasetscited by 161
- 2023Large Language Models for Code: Security Hardening and Adversarial Testingcited by 155
- 2023Large Language Models for Robotics: A Surveycited by 133
- 2023DoctorGLM: Fine-tuning your Chinese Doctor is not a Herculean Taskcited by 131
- 2023DeID-GPT: Zero-shot Medical Text De-Identification by GPT-4cited by 130
- 2023Large Language Models in Law: A Surveycited by 128
- 2023A Survey of Large Language Models in Medicine: Progress, Application, and Challengecited by 124
- 2023Zhongjing: Enhancing the Chinese Medical Capabilities of Large Language Model through Expert Feedback and Real-world Multi-turn Dialoguecited by 119
50 most cited of 83 All 83 (JSON)
Built on by
Citing papers per year: 2026: 1.
1 paper.