mlsanityData to 14 Oct 2026

HuatuoGPT, towards Taming Language Model to Be a Doctor

arXiv 2305.15075 ↗First posted 24 May 2023cs.CL cs.AIcited by 214

On the map: LLM alignment / RLHF / preference optimisation → Medical LLM alignment

Abstract (arXiv)

In this paper, we present HuatuoGPT, a large language model (LLM) for medical consultation. The core recipe of HuatuoGPT is to leverage both textitdistilled data from ChatGPT and textitreal-world data from doctors in the supervised fine-tuned stage. The responses of ChatGPT are usually detailed, well-presented and informative while it cannot perform like a doctor in many aspects, e.g. for integrative diagnosis. We argue that real-world data from doctors would be complementary to distilled data in the sense the former could tame a distilled language model to perform like doctors. To better leverage the strengths of both data, we train a reward model to align the language model with the merits that both data bring, following an RLAIF (reinforced learning from AI feedback) fashion. To evaluate and benchmark the models, we propose a comprehensive evaluation scheme (including automatic and manual metrics). Experimental results demonstrate that HuatuoGPT achieves state-of-the-art results in performing medical consultation among open-source LLMs in GPT-4 evaluation, human evaluation, and medical benchmark datasets. It is worth noting that by using additional real-world data and RLAIF, the distilled language model (i.e., HuatuoGPT) outperforms its teacher model ChatGPT in most cases. Our code, data, and models are publicly available at urlhttps://github.com/FreedomIntelligence/HuatuoGPT. The online demo is available at urlhttps://www.HuatuoGPT.cn/.

Key facts. Cited by 214 papers in the map (data through 14 Oct 2026). Placed in Medical LLM alignment, one of 10 directions in LLM alignment / RLHF / preference optimisation. Builds on 18 of its 29 references that are in the map. First posted on arXiv 24 May 2023.

Builds on

18 of 29 references.

References · 18

  1. 2022Training language models to follow instructions with human feedbackcited by 15,971
  2. 2022Constitutional AI: Harmlessness from AI Feedbackcited by 3,050
  3. 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,724
  4. 2020The Pile: An 800GB Dataset of Diverse Text for Language Modelingcited by 2,411
  5. 2022LaMDA: Language Models for Dialog Applicationscited by 1,220
  6. 2019DialoGPT: Large-Scale Generative Pre-training for Conversational Response Generationcited by 842
  7. 2023Instruction Tuning with GPT-4cited by 686
  8. 2022BioGPT: Generative Pre-trained Transformer for Biomedical Text Generation and Miningcited by 538
  9. 2023Towards Expert-Level Medical Question Answering with Large Language Modelscited by 384
  10. 2023MedAlpaca -- An Open-Source Collection of Medical Conversational AI Models and Training Datacited by 286
  11. 2023HuaTuo: Tuning LLaMA Model with Chinese Medical Knowledgecited by 162
  12. 2020MedDialog: Two Large-scale Medical Dialogue Datasetscited by 161
6 more
  1. 2023DoctorGLM: Fine-tuning your Chinese Doctor is not a Herculean Taskcited by 131
  2. 2021CBLUE: A Chinese Biomedical Language Understanding Evaluation Benchmarkcited by 101
  3. 2019End-to-End Knowledge-Routed Relational Dialogue System for Automatic Diagnosiscited by 70
  4. 2023Huatuo-26M, a Large-scale Chinese Medical QA Datasetcited by 46
  5. 2023Phoenix: Democratizing ChatGPT across Languagescited by 32
  6. 2022PanGu-Bot: Efficient Generative Dialogue Pre-training from Pre-trained Language Modelcited by 9

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 33; 2024: 70; 2025: 72; 2026: 39.

214 papers.

Sort:

By area:

  1. 2023The Rise and Potential of Large Language Model Based Agents: A Surveycited by 1,439
  2. 2024A Survey on Knowledge Distillation of Large Language Modelscited by 284
  3. 2023Using Human Feedback to Fine-tune Diffusion Models without Any Reward Modelcited by 252
  4. 2023Survey on Factuality in Large Language Models: Knowledge, Retrieval and Domain-Specificitycited by 206
  5. 2024HuatuoGPT-Vision, Towards Injecting Medical Visual Knowledge into Multimodal LLMs at Scalecited by 200
  6. 2023Recommender Systems in the Era of Large Language Models (LLMs)cited by 189
  7. 2023A Survey of Large Language Models for Healthcare: from Data, Technology, and Applications to Accountability and Ethicscited by 163
  8. 2023A Survey of Large Language Models in Medicine: Progress, Application, and Challengecited by 124
  9. 2023Zhongjing: Enhancing the Chinese Medical Capabilities of Large Language Model through Expert Feedback and Real-world Multi-turn Dialoguecited by 119
  10. 2023CMB: A Comprehensive Medical Benchmark in Chinesecited by 115
  11. 2024Benchmarking Large Language Models on Answering and Explaining Challenging Medical Questionscited by 109
  12. 2023HuatuoGPT-II, One-stage Training for Medical Adaption of LLMscited by 92
38 more
  1. 2023DISC-MedLLM: Bridging General Large Language Models and Real-World Medical Consultationcited by 90
  2. 2025Lifelong Learning of Large Language Model based Agents: A Roadmapcited by 83
  3. 2023EduChat: A Large-Scale Language Model-based Chatbot System for Intelligent Educationcited by 80
  4. 2024Foundation Model for Advancing Healthcare: Challenges, Opportunities, and Future Directionscited by 77
  5. 2025Agentic AI for Scientific Discovery: A Survey of Progress, Challenges, and Future Directionscited by 77
  6. 2025From AI for Science to Agentic Science: A Survey on Autonomous Scientific Discoverycited by 77
  7. 2023AceGPT, Localizing Large Language Models in Arabiccited by 75
  8. 2023Think-in-Memory: Recalling and Post-thinking Enable LLMs with Long-Term Memorycited by 64
  9. 2025Breaking the Exploration Bottleneck: Rubric-Scaffolded Reinforcement Learning for General LLM Reasoningcited by 63
  10. 2023LMFlow: An Extensible Toolkit for Finetuning and Inference of Large Foundation Modelscited by 60
  11. 2023"It's a Fair Game", or Is It? Examining How Users Navigate Disclosure Risks and Benefits When Using LLM-Based Conversational Agentscited by 60
  12. 2024Survey on Knowledge Distillation for Large Language Models: Methods, Evaluation, and Applicationcited by 56
  13. 2025A Comprehensive Survey of Reward Models: Taxonomy, Applications, Challenges, and Futurecited by 53
  14. 2024A Comprehensive Survey of Large Language Models and Multimodal Large Language Models in Medicinecited by 45
  15. 2023ChatCounselor: A Large Language Models for Mental Health Supportcited by 44
  16. 2024CoD, Towards an Interpretable Medical Agent using Chain of Diagnosiscited by 43
  17. 2025Baichuan-M1: Pushing the Medical Capability of Large Language Modelscited by 43
  18. 2023CLIP in Medical Imaging: A Surveycited by 40
  19. 2024FlowBench: Revisiting and Benchmarking Workflow-Guided Planning for LLM-based Agentscited by 40
  20. 2025MAM: Modular Multi-Agent Framework for Multi-Modal Medical Diagnosis via Role-Specialized Collaborationcited by 40
  21. 2024Automatic Interactive Evaluation for Large Language Models with State Aware Patient Simulatorcited by 39
  22. 2024TravelAgent: An AI Assistant for Personalized Travel Planningcited by 39
  23. 2024Apollo: A Lightweight Multilingual Medical LLM towards Democratizing Medical AI to 6B Peoplecited by 38
  24. 2025A Survey of Scientific Large Language Models: From Data Foundations to Agent Frontierscited by 37
  25. 2023Taiyi: A Bilingual Fine-Tuned Large Language Model for Diverse Biomedical Taskscited by 36
  26. 2025Beyond Distillation: Pushing the Limits of Medical LLM Reasoning with Minimalist Rule-Based RLcited by 36
  27. 2024A Survey on Medical Large Language Models: Technology, Application, Trustworthiness, and Future Directionscited by 34
  28. 2025Medical World Model: Generative Simulation of Tumor Evolution for Treatment Planningcited by 34
  29. 2025Generative to Agentic AI: Survey, Conceptualization, and Challengescited by 33
  30. 2024JMLR: Joint Medical LLM and Retrieval Training for Enhancing Reasoning and Professional Question Answering Capabilitycited by 32
  31. 2024OphCLIP: Hierarchical Retrieval-Augmented Learning for Ophthalmic Surgical Video-Language Pretrainingcited by 29
  32. 2024PsycoLLM: Enhancing LLM for Psychological Understanding and Evaluationcited by 26
  33. 2024Odyssey: Empowering Minecraft Agents with Open-World Skillscited by 26
  34. 2023BioInstruct: Instruction Tuning of Large Language Models for Biomedical Natural Language Processingcited by 25
  35. 2025CheatAgent: Attacking LLM-Empowered Recommender Systems via LLM Agentcited by 25
  36. 2024DrHouse: An LLM-empowered Diagnostic Reasoning System through Harnessing Outcomes from Sensor Data and Expert Knowledgecited by 24
  37. 2023GrammarGPT: Exploring Open-Source LLMs for Native Chinese Grammatical Error Correction with Supervised Fine-Tuningcited by 23
  38. 2025A Survey on Agentic Multimodal Large Language Modelscited by 23

50 most cited of 214 All 214 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2023ChiMed-GPT: A Chinese Medical Large Language Model with Full Training Regime and Better Alignment to Human Preferences
  2. 2024Hippocrates: An Open-Source Framework for Advancing Large Language Models in Healthcare
  3. 2023Evaluation of ChatGPT Family of Models for Biomedical Reasoning and Classification
  4. 2025Conversation AI Dialog for Medicare powered by Finetuning and Retrieval Augmented Generation
  5. 2023ClinicalGPT: Large Language Models Finetuned with Diverse Medical Data and Comprehensive Evaluation
  6. 2025Disentangling Reasoning and Knowledge in Medical Large Language Models
  7. 2024Benchmarking Large Language Models on Communicative Medical Coaching: a Novel System and Dataset
  8. 2026MedLLM: An Open Medical Language Model at the Sub-Billion Scale