mlsanityData to 14 Oct 2026

ClinicalGPT: Large Language Models Finetuned with Diverse Medical Data and Comprehensive Evaluation

arXiv 2306.09968 ↗First posted 16 Jun 2023cs.CLcited by 88

Not on the map. Why?

Abstract (arXiv)

Large language models have exhibited exceptional performance on various Natural Language Processing (NLP) tasks, leveraging techniques such as the pre-training, and instruction fine-tuning. Despite these advances, their effectiveness in medical applications is limited, due to challenges such as factual inaccuracies, reasoning abilities, and lack grounding in real-world experience. In this study, we present ClinicalGPT, a language model explicitly designed and optimized for clinical scenarios. By incorporating extensive and diverse real-world data, such as medical records, domain-specific knowledge, and multi-round dialogue consultations in the training process, ClinicalGPT is better prepared to handle multiple clinical task. Furthermore, we introduce a comprehensive evaluation framework that includes medical knowledge question-answering, medical exams, patient consultations, and diagnostic analysis of medical records. Our results demonstrate that ClinicalGPT significantly outperforms other models in these tasks, highlighting the effectiveness of our approach in adapting large language models to the critical domain of healthcare.

Key facts. Cited by 88 papers in the map (data through 14 Oct 2026). Builds on 14 of its 27 references that are in the map. First posted on arXiv 16 Jun 2023.

Builds on

14 of 27 references.

References · 14

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2020Language Models are Few-Shot Learnerscited by 32,419
  3. 2022Training language models to follow instructions with human feedbackcited by 15,971
  4. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  5. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  6. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  7. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,326
  8. 2020Learning to summarize from human feedbackcited by 2,588
  9. 2022BLOOM: A 176B-Parameter Open-Access Multilingual Language Modelcited by 1,984
  10. 2021WebGPT: Browser-assisted question-answering with human feedbackcited by 1,745
  11. 2020What Disease does this Patient Have? A Large-scale Open Domain Question Answering Dataset from Medical Examscited by 1,356
  12. 2022LaMDA: Language Models for Dialog Applicationscited by 1,220
2 more
  1. 2015Aligning Books and Movies: Towards Story-like Visual Explanations by Watching Movies and Reading Bookscited by 1,043
  2. 2022GLM-130B: An Open Bilingual Pre-trained Modelcited by 843

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 15; 2024: 35; 2025: 28; 2026: 10.

88 papers.

Sort:

By area:

  1. 2024BioMistral: A Collection of Open-Source Pretrained Large Language Models for Medical Domainscited by 301
  2. 2023MetaTool Benchmark for Large Language Models: Deciding Whether to Use Tools and Which to Usecited by 217
  3. 2024Aya Dataset: An Open-Access Collection for Multilingual Instruction Tuningcited by 177
  4. 2023A Survey of Large Language Models for Healthcare: from Data, Technology, and Applications to Accountability and Ethicscited by 163
  5. 2023Large language models in healthcare and medical domain: A reviewcited by 127
  6. 2023A Survey of Large Language Models in Medicine: Progress, Application, and Challengecited by 124
  7. 2023Should we be going MAD? A Look at Multi-Agent Debate Strategies for LLMscited by 114
  8. 2024Benchmarking Large Language Models on Answering and Explaining Challenging Medical Questionscited by 109
  9. 2024A Comprehensive Survey of Large Language Models and Multimodal Large Language Models in Medicinecited by 45
  10. 2024MedExpQA: Multilingual Benchmarking of Large Language Models for Medical Question Answeringcited by 43
  11. 2025Improving Medical Large Vision-Language Models with Abnormal-Aware Feedbackcited by 42
  12. 2024Large Language Models for Medicine: A Surveycited by 38
38 more
  1. 2025A Survey of Scientific Large Language Models: From Data Foundations to Agent Frontierscited by 37
  2. 2023Taiyi: A Bilingual Fine-Tuned Large Language Model for Diverse Biomedical Taskscited by 36
  3. 2024A Survey on Medical Large Language Models: Technology, Application, Trustworthiness, and Future Directionscited by 34
  4. 2024OphCLIP: Hierarchical Retrieval-Augmented Learning for Ophthalmic Surgical Video-Language Pretrainingcited by 29
  5. 2023ChatHome: Development and Evaluation of a Domain-Specific Language Model for Home Renovationcited by 25
  6. 2023AI-TA: Towards an Intelligent Question-Answer Teaching Assistant using Open-Source LLMscited by 22
  7. 2024Multilingual Large Language Models: A Systematic Surveycited by 18
  8. 2024Leveraging Biomolecule and Natural Language through Multi-Modal Learning: A Surveycited by 17
  9. 2024Large Language Model Benchmarks in Medical Taskscited by 17
  10. 2024A Survey on Large Language Models from General Purpose to Medical Applications: Datasets, Methodologies, and Evaluationscited by 16
  11. 2025Multimodal Large Language Models for Medicine: A Comprehensive Surveycited by 16
  12. 2024Medical mT5: An Open-Source Multilingual Text-to-Text LLM for The Medical Domaincited by 15
  13. 2024Large Language Models in the Clinic: A Comprehensive Benchmarkcited by 13
  14. 2024Open Challenges and Opportunities in Federated Foundation Models Towards Biomedical Healthcarecited by 12
  15. 2024StockGPT: A GenAI Model for Stock Prediction and Tradingcited by 11
  16. 2025Autonomous Agents for Scientific Discovery: Orchestrating Scientists, Language, Code, and Physicscited by 11
  17. 2025MedGUIDE: Benchmarking Clinical Decision-Making in Large Language Modelscited by 10
  18. 2024Integrating Physician Diagnostic Logic into Large Language Models: Preference Learning from Process Feedbackcited by 9
  19. 2024Geneverse: A collection of Open-source Multimodal Large Language Models for Genomic and Proteomic Researchcited by 9
  20. 2023Large Language Models Illuminate a Progressive Pathway to Artificial Healthcare Assistant: A Reviewcited by 8
  21. 2024From Text to Multimodality: Exploring the Evolution and Impact of Large Language Models in Medical Practicecited by 8
  22. 2025Measuring Bias or Measuring the Task: Understanding the Brittle Nature of LLM Gender Biasescited by 8
  23. 2023TCM-GPT: Efficient Pre-training of Large Language Models for Domain Adaptation in Traditional Chinese Medicinecited by 7
  24. 2023BioLORD-2023: Semantic Textual Representations Fusing LLM and Clinical Knowledge Graph Insightscited by 7
  25. 2024A Survey of Pre-trained Language Models for Processing Scientific Textcited by 7
  26. 2026Epistemic Context Learning: Building Trust the Right Way in LLM-Based Multi-Agent Systemscited by 6
  27. 2024LLMs for Doctors: Leveraging Medical LLMs to Assist Doctors, Not Replace Themcited by 5
  28. 2024Mitigating Hallucinations of Large Language Models in Medical Information Extraction via Contrastive Decodingcited by 5
  29. 2023From Large Language Models to Knowledge Graphs for Biomarker Discovery in Cancercited by 4
  30. 2024Bioinformatics and Biomedical Informatics with ChatGPT: Year One Reviewcited by 4
  31. 2024Shimo Lab at "Discharge Me!": Discharge Summarization by Prompt-Driven Concatenation of Electronic Health Record Sectionscited by 4
  32. 2025Black-Box Behavioral Distillation Breaks Safety Alignment in Medical LLMscited by 4
  33. 2024Developing ChatGPT for Biology and Medicine: A Complete Review of Biomedical Question Answeringcited by 3
  34. 2025Boosting Large Language Models with Mask Fine-Tuningcited by 3
  35. 2025Generative AI for Healthcare: Fundamentals, Challenges, and Perspectivescited by 3
  36. 2026ResidencyRL: Reinforcement Learning in Simulated Clinical Environmentscited by 3
  37. 2024Evaluation of Language Models in the Medical Context Under Resource-Constrained Settingscited by 2
  38. 2024DALL-M: Context-Aware Clinical Data Augmentation with LLMscited by 2

50 most cited of 88 All 88 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2025ClinicalGPT-R1: Pushing reasoning capability of generalist disease diagnosis with large language model
  2. 2024Guiding Clinical Reasoning with Large Language Models via Knowledge Seeds
  3. 2023ChiMed-GPT: A Chinese Medical Large Language Model with Full Training Regime and Better Alignment to Human Preferences
  4. 2023The Potential and Pitfalls of using a Large Language Model such as ChatGPT or GPT-4 as a Clinical Assistant
  5. 2023Evaluation of ChatGPT Family of Models for Biomedical Reasoning and Classification
  6. 2023Aligning Large Language Models for Clinical Tasks
  7. 2025BRIDGE: Benchmarking Large Language Models for Understanding Real-world Clinical Practice Text
  8. 2023MEDITRON-70B: Scaling Medical Pretraining for Large Language Models