mlsanityData to 14 Oct 2026

Opportunities and Challenges for ChatGPT and Large Language Models in Biomedicine and Health

arXiv 2306.10070 ↗First posted 15 Jun 2023cs.CY cs.AI cs.CLcited by 118

Not on the map. Why?

Abstract (arXiv)

ChatGPT has drawn considerable attention from both the general public and domain experts with its remarkable text generation capabilities. This has subsequently led to the emergence of diverse applications in the field of biomedicine and health. In this work, we examine the diverse applications of large language models (LLMs), such as ChatGPT, in biomedicine and health. Specifically we explore the areas of biomedical information retrieval, question answering, medical text summarization, information extraction, and medical education, and investigate whether LLMs possess the transformative power to revolutionize these tasks or whether the distinct complexities of biomedical domain presents unique challenges. Following an extensive literature survey, we find that significant advances have been made in the field of text generation tasks, surpassing the previous state-of-the-art methods. For other applications, the advances have been modest. Overall, LLMs have not yet revolutionized biomedicine, but recent rapid progress indicates that such methods hold great potential to provide valuable means for accelerating discovery and improving health. We also find that the use of LLMs, like ChatGPT, in the fields of biomedicine and health entails various risks and challenges, including fabricated information in its generated responses, as well as legal and privacy concerns associated with sensitive patient data. We believe this survey can provide a comprehensive and timely overview to biomedical researchers and healthcare practitioners on the opportunities and challenges associated with using ChatGPT and other LLMs for transforming biomedicine and health.

Key facts. Cited by 118 papers in the map (data through 14 Oct 2026). Builds on 65 of its 143 references that are in the map. First posted on arXiv 15 Jun 2023.

Builds on

65 of 143 references.

References · 65

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2020Language Models are Few-Shot Learnerscited by 32,419
  4. 2022Training language models to follow instructions with human feedbackcited by 15,971
  5. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  6. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  7. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  8. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
  9. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
  10. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,326
  11. 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
  12. 2022Scaling Instruction-Finetuned Language Modelscited by 3,024
38 more
  1. 2023A Survey of Large Language Modelscited by 2,576
  2. 2022Emergent Abilities of Large Language Modelscited by 2,512
  3. 2020The Pile: An 800GB Dataset of Diverse Text for Language Modelingcited by 2,411
  4. 2022Survey of Hallucination in Natural Language Generationcited by 2,075
  5. 2019BioBERT: a pre-trained biomedical language representation model for biomedical text miningcited by 1,947
  6. 2022Large Language Models Encode Clinical Knowledgecited by 1,830
  7. 2020What Disease does this Patient Have? A Large-scale Open Domain Question Answering Dataset from Medical Examscited by 1,356
  8. 2019PubMedQA: A Dataset for Biomedical Research Question Answeringcited by 1,288
  9. 2020Domain-Specific Language Model Pretraining for Biomedical Natural Language Processingcited by 1,009
  10. 2022Galactica: A Large Language Model for Sciencecited by 744
  11. 2021BARTScore: Evaluating Generated Text as Text Generationcited by 722
  12. 2022PAL: Program-aided Language Modelscited by 652
  13. 2023Capabilities of GPT-4 on Medical Challenge Problemscited by 638
  14. 2019MIMIC-CXR-JPG, a large publicly available database of labeled chest radiographscited by 597
  15. 2022MedMCQA : A Large-scale Multi-Subject Multi-Choice Dataset for Medical domain Question Answeringcited by 543
  16. 2022BioGPT: Generative Pre-trained Transformer for Biomedical Text Generation and Miningcited by 538
  17. 2018A Discourse-Aware Attention Model for Abstractive Summarization of Long Documentscited by 478
  18. 2023Harnessing the Power of LLMs in Practice: A Survey on ChatGPT and Beyondcited by 411
  19. 2023Towards Expert-Level Medical Question Answering with Large Language Modelscited by 384
  20. 2021Persistent Anti-Muslim Bias in Large Language Modelscited by 377
  21. 2023GPTScore: Evaluate as You Desirecited by 361
  22. 2020CheXbert: Combining Automatic Labelers and Expert Annotations for Accurate Radiology Report Labeling Using BERTcited by 337
  23. 2023Evaluating Verifiability in Generative Search Enginescited by 303
  24. 2023Tool Learning with Foundation Modelscited by 302
  25. 2023MedAlpaca -- An Open-Source Collection of Medical Conversational AI Models and Training Datacited by 286
  26. 2022Large Language Models are Few-Shot Clinical Information Extractorscited by 207
  27. 2022Are Large Pre-Trained Language Models Leaking Your Personal Information?cited by 200
  28. 2022Can large language models reason about medical questions?cited by 194
  29. 2023HuaTuo: Tuning LLaMA Model with Chinese Medical Knowledgecited by 162
  30. 2021Understanding the Capabilities, Limitations, and Societal Impact of Large Language Modelscited by 160
  31. 2022Deep Bidirectional Language-Knowledge Graph Pretrainingcited by 156
  32. 2019Predictive Biases in Natural Language Processing Models: A Conceptual Framework and Overviewcited by 137
  33. 2023DoctorGLM: Fine-tuning your Chinese Doctor is not a Herculean Taskcited by 131
  34. 2023Almanac: Retrieval-Augmented Language Models for Clinical Medicinecited by 123
  35. 2023GeneGPT: Augmenting Large Language Models with Domain Tools for Improved Access to Biomedical Informationcited by 117
  36. 2023ChatCAD: Interactive Computer-Aided Diagnosis on Medical Image using Large Language Modelscited by 116
  37. 2022ChatGPT Makes Medicine Easy to Swallow: An Exploratory Case Study on Simplified Radiology Reportscited by 101
  38. 2022Thinking about GPT-3 In-Context Learning for Biomedical IE? Think Againcited by 83

50 most cited of 65 All 65 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 13; 2024: 49; 2025: 36; 2026: 20.

118 papers.

Sort:

By area:

  1. 2024Benchmarking Retrieval-Augmented Generation for Medicinecited by 331
  2. 2023MedAgents: Large Language Models as Collaborators for Zero-shot Medical Reasoningcited by 316
  3. 2023MEDITRON-70B: Scaling Medical Pretraining for Large Language Modelscited by 274
  4. 2023MedCPT: Contrastive Pre-trained Transformers with Large-scale PubMed Search Logs for Zero-shot Biomedical Information Retrievalcited by 185
  5. 2023A Survey of Large Language Models for Healthcare: from Data, Technology, and Applications to Accountability and Ethicscited by 163
  6. 2023Large language models in healthcare and medical domain: A reviewcited by 127
  7. 2023A Survey of Large Language Models in Medicine: Progress, Application, and Challengecited by 124
  8. 2024A Comprehensive Study of Jailbreak Attack versus Defense for Large Language Modelscited by 106
  9. 2024MedCalc-Bench: Evaluating Large Language Models for Medical Calculationscited by 70
  10. 2023Matching Patients to Clinical Trials with Large Language Modelscited by 69
  11. 2024Improving Retrieval-Augmented Generation in Medicine with Iterative Follow-up Questionscited by 54
  12. 2024Risks of AI Scientists: Prioritizing Safeguarding Over Autonomycited by 49
38 more
  1. 2024Automatic Interactive Evaluation for Large Language Models with State Aware Patient Simulatorcited by 39
  2. 2023Taiyi: A Bilingual Fine-Tuned Large Language Model for Diverse Biomedical Taskscited by 36
  3. 2024AgentMD: Empowering Language Agents for Risk Prediction with Large-Scale Clinical Tool Learningcited by 33
  4. 2024Hidden flaws behind expert-level accuracy of multimodal GPT-4 vision in medicinecited by 31
  5. 2024Unmasking and Quantifying Racial Bias of Large Language Models in Medical Report Generationcited by 31
  6. 2024A Survey of Conversational Searchcited by 22
  7. 2024MMedPO: Aligning Medical Vision-Language Models with Clinical-Aware Multimodal Preference Optimizationcited by 21
  8. 2024OLAPH: Improving Factuality in Biomedical Long-form Question Answeringcited by 20
  9. 2023PubMed and Beyond: Biomedical Literature Search in the Age of Artificial Intelligencecited by 16
  10. 2023Distilling Large Language Models for Matching Patients to Clinical Trialscited by 16
  11. 2024Prompt engineering paradigms for medical applications: scoping review and recommendations for better practicescited by 14
  12. 2024On the Vulnerability of Applying Retrieval-Augmented Generation within Knowledge-Intensive Application Domainscited by 14
  13. 2025Improving Automatic Evaluation of Large Language Models (LLMs) in Biomedical Relation Extraction via LLMs-as-the-Judgecited by 13
  14. 2024LLMs in Biomedicine: A study on clinical Named Entity Recognitioncited by 12
  15. 2023Large Language Models on Wikipedia-Style Survey Generation: an Evaluation in NLP Conceptscited by 11
  16. 2024Large Language Models in Biomedical and Health Informatics: A Review with Bibliometric Analysiscited by 10
  17. 2024Adversarial Attacks on Large Language Models in Medicinecited by 10
  18. 2025From Screens to Scenes: A Survey of Embodied AI in Healthcarecited by 10
  19. 2024GeneAgent: Self-verification Language Agent for Gene Set Knowledge Discovery using Domain Databasescited by 9
  20. 2024MedREQAL: Examining Medical Knowledge Recall of Large Language Models via Question Answeringcited by 9
  21. 2025Exploring Jailbreak Attacks on LLMs through Intent Concealment and Diversioncited by 9
  22. 2025TTPA: Token-level Tool-use Preference Alignment Training Framework with Fine-grained Evaluationcited by 9
  23. 2024A Perspective for Adapting Generalist AI to Specialized Medical AI Applications and Their Challengescited by 8
  24. 2024Leveraging Professional Radiologists' Expertise to Enhance LLMs' Evaluation for Radiology Reportscited by 7
  25. 2024Flexible and Adaptable Summarization via Expertise Separationcited by 7
  26. 2024LMOD: A Large Multimodal Ophthalmology Dataset and Benchmark for Large Vision-Language Modelscited by 7
  27. 2024Quality of Answers of Generative Large Language Models vs Peer Patients for Interpreting Lab Test Results for Lay Patients: Evaluation Studycited by 6
  28. 2024ScholarChemQA: Unveiling the Power of Language Models in Chemical Research Question Answeringcited by 6
  29. 2024SimSUM: Simulated Benchmark with Structured and Unstructured Medical Recordscited by 6
  30. 2025Scaling Up Biomedical Vision-Language Models: Fine-Tuning, Instruction Tuning, and Multi-Modal Learningcited by 6
  31. 2024Transforming Dental Diagnostics with Artificial Intelligence: Advanced Integration of ChatGPT and Large Language Models for Patient Carecited by 5
  32. 2024Unveiling Performance Challenges of Large Language Models in Low-Resource Healthcare: A Demographic Fairness Perspectivecited by 5
  33. 2025MedREK: Retrieval-Based Editing for Medical LLMs with Key-Aware Promptscited by 5
  34. 2024Bioinformatics and Biomedical Informatics with ChatGPT: Year One Reviewcited by 4
  35. 2024The current status of large language models in summarizing radiology report impressionscited by 4
  36. 2024What Affects the Stability of Tool Learning? An Empirical Study on the Robustness of Tool Learning Frameworkscited by 4
  37. 2025From Knowledge Generation to Knowledge Verification: Examining the BioMedical Generative Capabilities of ChatGPTcited by 4
  38. 2025Evaluating and Mitigating Bias in AI-Based Medical Text Generationcited by 4

50 most cited of 118 All 118 (JSON)