Large Language Models Illuminate a Progressive Pathway to Artificial Healthcare Assistant: A Review
Not on the map. Why?
Abstract (arXiv)
With the rapid development of artificial intelligence, large language models (LLMs) have shown promising capabilities in mimicking human-level language comprehension and reasoning. This has sparked significant interest in applying LLMs to enhance various aspects of healthcare, ranging from medical education to clinical decision support. However, medicine involves multifaceted data modalities and nuanced reasoning skills, presenting challenges for integrating LLMs. This paper provides a comprehensive review on the applications and implications of LLMs in medicine. It begins by examining the fundamental applications of general-purpose and specialized LLMs, demonstrating their utilities in knowledge retrieval, research support, clinical workflow automation, and diagnostic assistance. Recognizing the inherent multimodality of medicine, the review then focuses on multimodal LLMs, investigating their ability to process diverse data types like medical imaging and EHRs to augment diagnostic accuracy. To address LLMs' limitations regarding personalization and complex clinical reasoning, the paper explores the emerging development of LLM-powered autonomous agents for healthcare. Furthermore, it summarizes the evaluation methodologies for assessing LLMs' reliability and safety in medical contexts. Overall, this review offers an extensive analysis on the transformative potential of LLMs in modern medicine. It also highlights the pivotal need for continuous optimizations and ethical oversight before these models can be effectively integrated into clinical practice. Visit https://github.com/mingze-yuan/Awesome-LLM-Healthcare for an accompanying GitHub repository containing latest papers.
Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 102 of its 187 references that are in the map. First posted on arXiv 3 Nov 2023.
Builds on
102 of 187 references.
References · 102
- 2017Attention Is All You Needcited by 60,361
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2023GPT-4 Technical Reportcited by 18,396
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
38 more
- 2022Large Language Models are Zero-Shot Reasonerscited by 4,374
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
- 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
- 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,780
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,211
- 2022Constitutional AI: Harmlessness from AI Feedbackcited by 3,050
- 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,724
- 2023MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Modelscited by 2,711
- 2023A Survey of Large Language Modelscited by 2,576
- 2023G-Eval: NLG Evaluation using GPT-4 with Better Human Alignmentcited by 2,276
- 2023A Survey on Large Language Model based Autonomous Agentscited by 2,242
- 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,071
- 2022Large Language Models Encode Clinical Knowledgecited by 1,830
- 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,808
- 2023The Rise and Potential of Large Language Model Based Agents: A Surveycited by 1,439
- 2022Least-to-Most Prompting Enables Complex Reasoning in Large Language Modelscited by 1,407
- 2023LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One Daycited by 1,305
- 2023A Survey on Evaluation of Large Language Modelscited by 1,242
- 2023PaLM 2 Technical Reportcited by 1,162
- 2021Perceiver: General Perception with Iterative Attentioncited by 1,104
- 2021GLM: General Language Model Pretraining with Autoregressive Blank Infillingcited by 1,031
- 2023A Survey on Multimodal Large Language Modelscited by 909
- 2017An Overview of Multi-Task Learning in Deep Neural Networkscited by 803
- 2022Out of One, Many: Using Language Models to Simulate Human Samplescited by 752
- 2022OFA: Unifying Architectures, Tasks, and Modalities Through a Simple Sequence-to-Sequence Learning Frameworkcited by 745
- 2023Can Large Language Models Be an Alternative to Human Evaluations?cited by 734
- 2023Scaling Vision Transformers to 22 Billion Parameterscited by 694
- 2023Instruction Tuning with GPT-4cited by 686
- 2023The Dawn of LMMs: Preliminary Explorations with GPT-4V(ision)cited by 681
- 2023Capabilities of GPT-4 on Medical Challenge Problemscited by 638
- 2023Instruction Tuning for Large Language Models: A Surveycited by 623
- 2022AudioLM: a Language Modeling Approach to Audio Generationcited by 616
- 2022Towards Reasoning in Large Language Models: A Surveycited by 596
- 2022MedCLIP: Contrastive Learning from Unpaired Medical Images and Textcited by 570
- 2023OpenFlamingo: An Open-Source Framework for Training Large Autoregressive Vision-Language Modelscited by 565
- 2023MemoryBank: Enhancing Large Language Models with Long-Term Memorycited by 556
- 2022GIT: A Generative Image-to-text Transformer for Vision and Languagecited by 537
50 most cited of 102 All 102 (JSON)
Built on by
Citing papers per year: 2023: 1; 2024: 4; 2025: 3.
8 papers.
- 2024CS-Bench: A Comprehensive Benchmark for Large Language Models towards Computer Science Masterycited by 30
- 2023GeoLocator: a location-integrated large multimodal model for inferring geo-privacycited by 13
- 2025TAMA: A Human-AI Collaborative Thematic Analysis Framework Using Multi-Agent LLMs for Clinical Interviewscited by 9
- 2024Q-Adapter: Customizing Pre-trained LLMs to New Preferences with Forgetting Mitigationcited by 7
- 2024Revolutionizing Database Q&A with Large Language Models: Comprehensive Benchmark and Evaluationcited by 7
- 2025Loki's Dance of Illusions: A Comprehensive Survey of Hallucination in Large Language Modelscited by 7
- 2024The Tug of War Within: Mitigating the Fairness-Privacy Conflicts in Large Language Modelscited by 5
- 2025Brain Imaging Foundation Models, Are We There Yet? A Systematic Review of Foundation Models for Brain Imaging and Biomedical Researchcited by 0
- 2025Brain Imaging Foundation Models, Are We There Yet? A Systematic Review of Foundation Models for Brain Imaging and Biomedical Research16 Jun 2025
- 2025Loki's Dance of Illusions: A Comprehensive Survey of Hallucination in Large Language Models6 Jun 2025
- 2025TAMA: A Human-AI Collaborative Thematic Analysis Framework Using Multi-Agent LLMs for Clinical Interviews26 Mar 2025
- 2024The Tug of War Within: Mitigating the Fairness-Privacy Conflicts in Large Language Models22 Oct 2024
- 2024Revolutionizing Database Q&A with Large Language Models: Comprehensive Benchmark and Evaluation5 Sep 2024
- 2024Q-Adapter: Customizing Pre-trained LLMs to New Preferences with Forgetting Mitigation4 Jul 2024
- 2024CS-Bench: A Comprehensive Benchmark for Large Language Models towards Computer Science Mastery12 Jun 2024
- 2023GeoLocator: a location-integrated large multimodal model for inferring geo-privacy21 Nov 2023
Similar, not cited
Close in wording, no citation either way
- 2025A Survey of LLM-based Agents in Medicine: How far are we from Baymax?
- 2026Aligning Clinical Needs and AI Capabilities: A Survey on LLMs for Medical Reasoning
- 2024A Comprehensive Survey of Large Language Models and Multimodal Large Language Models in Medicine
- 2025Reasoning LLMs in the Medical Domain: A Literature Survey
- 2025Performance of Large Language Models in Supporting Medical Diagnosis and Treatment
- 2025Medical Reasoning in the Era of LLMs: A Systematic Review of Enhancement Techniques and Applications
- 2025Multimodal Large Language Models for Medicine: A Comprehensive Survey
- 2024Entry-level guide to the use of large language models for medical research