mlsanityData to 14 Oct 2026

DoctorGLM: Fine-tuning your Chinese Doctor is not a Herculean Task

arXiv 2304.01097 ↗First posted 3 Apr 2023cs.CLcited by 131

Not on the map. Why?

Abstract (arXiv)

The recent progress of large language models (LLMs), including ChatGPT and GPT-4, in comprehending and responding to human instructions has been remarkable. Nevertheless, these models typically perform better in English and have not been explicitly trained for the medical domain, resulting in suboptimal precision in diagnoses, drug recommendations, and other medical advice. Additionally, training and deploying a dialogue model is still believed to be impossible for hospitals, hindering the promotion of LLMs. To tackle these challenges, we have collected databases of medical dialogues in Chinese with ChatGPT's help and adopted several techniques to train an easy-deploy LLM. Remarkably, we were able to fine-tune the ChatGLM-6B on a single A100 80G in 13 hours, which means having a healthcare-purpose LLM can be very affordable. DoctorGLM is currently an early-stage engineering attempt and contain various mistakes. We are sharing it with the broader community to invite feedback and suggestions to improve its healthcare-focused capabilities: https://github.com/xionghonglin/DoctorGLM.

Key facts. Cited by 131 papers in the map (data through 14 Oct 2026). Builds on 13 of its 16 references that are in the map. First posted on arXiv 3 Apr 2023.

Builds on

13 of 16 references.

References · 13

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2020Language Models are Few-Shot Learnerscited by 32,419
  4. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  5. 2019BioBERT: a pre-trained biomedical language representation model for biomedical text miningcited by 1,947
  6. 2022Large Language Models Encode Clinical Knowledgecited by 1,830
  7. 2021GLM: General Language Model Pretraining with Autoregressive Blank Infillingcited by 1,031
  8. 2020Domain-Specific Language Model Pretraining for Biomedical Natural Language Processingcited by 1,009
  9. 2019Publicly Available Clinical BERT Embeddingscited by 1,002
  10. 2022GLM-130B: An Open Bilingual Pre-trained Modelcited by 843
  11. 2021P-Tuning v2: Prompt Tuning Can Be Comparable to Fine-tuning Universally Across Scales and Taskscited by 689
  12. 2020The Tatoeba Translation Challenge -- Realistic Data Sets for Low Resource and Multilingual MTcited by 128
1 more
  1. 2023ChatCAD: Interactive Computer-Aided Diagnosis on Medical Image using Large Language Modelscited by 116

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 44; 2024: 56; 2025: 25; 2026: 6.

131 papers.

Sort:

By area:

  1. 2023LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One Daycited by 1,305
  2. 2024A Survey on the Memory Mechanism of Large Language Model based Agentscited by 634
  3. 2024A Survey on Knowledge Distillation of Large Language Modelscited by 284
  4. 2024Continual Learning of Large Language Models: A Comprehensive Surveycited by 234
  5. 2023HuatuoGPT, towards Taming Language Model to Be a Doctorcited by 214
  6. 2023Survey on Factuality in Large Language Models: Knowledge, Retrieval and Domain-Specificitycited by 206
  7. 2023Recommender Systems in the Era of Large Language Models (LLMs)cited by 189
  8. 2023A Survey of Large Language Models for Healthcare: from Data, Technology, and Applications to Accountability and Ethicscited by 163
  9. 2023HuaTuo: Tuning LLaMA Model with Chinese Medical Knowledgecited by 162
  10. 2023A Survey of Large Language Models in Medicine: Progress, Application, and Challengecited by 124
  11. 2023Zhongjing: Enhancing the Chinese Medical Capabilities of Large Language Model through Expert Feedback and Real-world Multi-turn Dialoguecited by 119
  12. 2023Opportunities and Challenges for ChatGPT and Large Language Models in Biomedicine and Healthcited by 118
38 more
  1. 2023CMB: A Comprehensive Medical Benchmark in Chinesecited by 115
  2. 2024AI Hospital: Benchmarking Large Language Models in a Multi-agent Medical Interaction Simulatorcited by 101
  3. 2023HuatuoGPT-II, One-stage Training for Medical Adaption of LLMscited by 92
  4. 2023Benchmarking Large Language Models on CMExam -- A Comprehensive Chinese Medical Exam Datasetcited by 91
  5. 2023DISC-MedLLM: Bridging General Large Language Models and Real-World Medical Consultationcited by 90
  6. 2024Foundation Model for Advancing Healthcare: Challenges, Opportunities, and Future Directionscited by 77
  7. 2023BianQue: Balancing the Questioning and Suggestion Ability of Health LLMs with Multi-turn Health Conversations Polished by ChatGPTcited by 65
  8. 2023XrayGPT: Chest Radiographs Summarization using Medical Vision-Language Modelscited by 61
  9. 2023Lawyer LLaMA Technical Reportcited by 54
  10. 2023Xiezhi: An Ever-Updating Benchmark for Holistic Domain Knowledge Evaluationcited by 52
  11. 2023Adapting Large Language Models to Domains via Reading Comprehensioncited by 50
  12. 2023NoteChat: A Dataset of Synthetic Doctor-Patient Conversations Conditioned on Clinical Notescited by 48
  13. 2024A Comprehensive Survey of Large Language Models and Multimodal Large Language Models in Medicinecited by 45
  14. 2024CoD, Towards an Interpretable Medical Agent using Chain of Diagnosiscited by 43
  15. 2023Radiology-Llama2: Best-in-Class Large Language Model for Radiologycited by 42
  16. 2025Self-Evolving Multi-Agent Simulations for Realistic Clinical Interactionscited by 40
  17. 2024Automatic Interactive Evaluation for Large Language Models with State Aware Patient Simulatorcited by 39
  18. 2024Large Language Models for Medicine: A Surveycited by 38
  19. 2025A Survey of Scientific Large Language Models: From Data Foundations to Agent Frontierscited by 37
  20. 2023Taiyi: A Bilingual Fine-Tuned Large Language Model for Diverse Biomedical Taskscited by 36
  21. 2023ChatCAD+: Towards a Universal and Reliable Interactive CAD using LLMscited by 35
  22. 2023OphGLM: Training an Ophthalmology Large Language-and-Vision Assistant based on Instructions and Dialoguecited by 34
  23. 2024A Survey on Medical Large Language Models: Technology, Application, Trustworthiness, and Future Directionscited by 34
  24. 2023MedBench: A Large-Scale Chinese Benchmark for Evaluating Medical Large Language Modelscited by 31
  25. 2023Adapting Large Language Models for Content Moderation: Pitfalls in Data Engineering and Supervised Fine-tuningcited by 29
  26. 2024PsycoLLM: Enhancing LLM for Psychological Understanding and Evaluationcited by 26
  27. 2023HyKGE: A Hypothesis Knowledge Graph Enhanced Framework for Accurate and Reliable Medical LLMs Responsescited by 25
  28. 2023Qilin-Med: Multi-stage Knowledge Injection Advanced Medical Large Language Modelcited by 24
  29. 2024Beyond Text: Frozen Large Language Models in Visual Signal Comprehensioncited by 23
  30. 2024PeFoMed: Parameter Efficient Fine-tuning of Multimodal Large Language Models for Medical Imagingcited by 22
  31. 2024LLM4PLC: Harnessing Large Language Models for Verifiable Programming of PLCs in Industrial Control Systemscited by 21
  32. 2024More Than Catastrophic Forgetting: Integrating General Capabilities For Domain-Specific LLMscited by 21
  33. 2023Holistic Evaluation of GPT-4V for Biomedical Imagingcited by 19
  34. 2024MedSyn: LLM-based Synthetic Medical Text Generation Frameworkcited by 19
  35. 2025Ask Patients with Patience: Enabling LLMs for Human-Centric Medical Dialogue with Grounded Reasoningcited by 19
  36. 2023Knowledge-tuning Large Language Models with Structured Medical Knowledge Bases for Reliable Response Generation in Chinesecited by 18
  37. 2024Multilingual Large Language Models: A Systematic Surveycited by 18
  38. 2024Healthcare Copilot: Eliciting the Power of General LLMs for Medical Consultationcited by 17

50 most cited of 131 All 131 (JSON)