mlsanityData to 14 Oct 2026

Large Language Models Illuminate a Progressive Pathway to Artificial Healthcare Assistant: A Review

arXiv 2311.01918 ↗First posted 3 Nov 2023cs.CL cs.AI cs.LGcited by 8

Not on the map. Why?

Abstract (arXiv)

With the rapid development of artificial intelligence, large language models (LLMs) have shown promising capabilities in mimicking human-level language comprehension and reasoning. This has sparked significant interest in applying LLMs to enhance various aspects of healthcare, ranging from medical education to clinical decision support. However, medicine involves multifaceted data modalities and nuanced reasoning skills, presenting challenges for integrating LLMs. This paper provides a comprehensive review on the applications and implications of LLMs in medicine. It begins by examining the fundamental applications of general-purpose and specialized LLMs, demonstrating their utilities in knowledge retrieval, research support, clinical workflow automation, and diagnostic assistance. Recognizing the inherent multimodality of medicine, the review then focuses on multimodal LLMs, investigating their ability to process diverse data types like medical imaging and EHRs to augment diagnostic accuracy. To address LLMs' limitations regarding personalization and complex clinical reasoning, the paper explores the emerging development of LLM-powered autonomous agents for healthcare. Furthermore, it summarizes the evaluation methodologies for assessing LLMs' reliability and safety in medical contexts. Overall, this review offers an extensive analysis on the transformative potential of LLMs in modern medicine. It also highlights the pivotal need for continuous optimizations and ethical oversight before these models can be effectively integrated into clinical practice. Visit https://github.com/mingze-yuan/Awesome-LLM-Healthcare for an accompanying GitHub repository containing latest papers.

Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 102 of its 187 references that are in the map. First posted on arXiv 3 Nov 2023.

Builds on

102 of 187 references.

References · 102

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  4. 2020Language Models are Few-Shot Learnerscited by 32,419
  5. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  6. 2023GPT-4 Technical Reportcited by 18,396
  7. 2022Training language models to follow instructions with human feedbackcited by 15,971
  8. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  9. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  10. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  11. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  12. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
38 more
  1. 2022Large Language Models are Zero-Shot Reasonerscited by 4,374
  2. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
  3. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
  4. 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
  5. 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,780
  6. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,211
  7. 2022Constitutional AI: Harmlessness from AI Feedbackcited by 3,050
  8. 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,724
  9. 2023MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Modelscited by 2,711
  10. 2023A Survey of Large Language Modelscited by 2,576
  11. 2023G-Eval: NLG Evaluation using GPT-4 with Better Human Alignmentcited by 2,276
  12. 2023A Survey on Large Language Model based Autonomous Agentscited by 2,242
  13. 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,071
  14. 2022Large Language Models Encode Clinical Knowledgecited by 1,830
  15. 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,808
  16. 2023The Rise and Potential of Large Language Model Based Agents: A Surveycited by 1,439
  17. 2022Least-to-Most Prompting Enables Complex Reasoning in Large Language Modelscited by 1,407
  18. 2023LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One Daycited by 1,305
  19. 2023A Survey on Evaluation of Large Language Modelscited by 1,242
  20. 2023PaLM 2 Technical Reportcited by 1,162
  21. 2021Perceiver: General Perception with Iterative Attentioncited by 1,104
  22. 2021GLM: General Language Model Pretraining with Autoregressive Blank Infillingcited by 1,031
  23. 2023A Survey on Multimodal Large Language Modelscited by 909
  24. 2017An Overview of Multi-Task Learning in Deep Neural Networkscited by 803
  25. 2022Out of One, Many: Using Language Models to Simulate Human Samplescited by 752
  26. 2022OFA: Unifying Architectures, Tasks, and Modalities Through a Simple Sequence-to-Sequence Learning Frameworkcited by 745
  27. 2023Can Large Language Models Be an Alternative to Human Evaluations?cited by 734
  28. 2023Scaling Vision Transformers to 22 Billion Parameterscited by 694
  29. 2023Instruction Tuning with GPT-4cited by 686
  30. 2023The Dawn of LMMs: Preliminary Explorations with GPT-4V(ision)cited by 681
  31. 2023Capabilities of GPT-4 on Medical Challenge Problemscited by 638
  32. 2023Instruction Tuning for Large Language Models: A Surveycited by 623
  33. 2022AudioLM: a Language Modeling Approach to Audio Generationcited by 616
  34. 2022Towards Reasoning in Large Language Models: A Surveycited by 596
  35. 2022MedCLIP: Contrastive Learning from Unpaired Medical Images and Textcited by 570
  36. 2023OpenFlamingo: An Open-Source Framework for Training Large Autoregressive Vision-Language Modelscited by 565
  37. 2023MemoryBank: Enhancing Large Language Models with Long-Term Memorycited by 556
  38. 2022GIT: A Generative Image-to-text Transformer for Vision and Languagecited by 537

50 most cited of 102 All 102 (JSON)

Built on by

Cited by year

Citing papers per year: 2023: 1; 2024: 4; 2025: 3.

8 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025A Survey of LLM-based Agents in Medicine: How far are we from Baymax?
  2. 2026Aligning Clinical Needs and AI Capabilities: A Survey on LLMs for Medical Reasoning
  3. 2024A Comprehensive Survey of Large Language Models and Multimodal Large Language Models in Medicine
  4. 2025Reasoning LLMs in the Medical Domain: A Literature Survey
  5. 2025Performance of Large Language Models in Supporting Medical Diagnosis and Treatment
  6. 2025Medical Reasoning in the Era of LLMs: A Systematic Review of Enhancement Techniques and Applications
  7. 2025Multimodal Large Language Models for Medicine: A Comprehensive Survey
  8. 2024Entry-level guide to the use of large language models for medical research