mlsanityData to 7 Oct 2026

IIMedGPT: Promoting Large Language Model Capabilities of Medical Tasks by Efficient Human Preference Alignment

arXiv 2501.02869 ↗First posted 6 Jan 2025cs.CL cs.AIcited by 3

On the map: LLM alignment / RLHF / preference optimisation → Medical LLM alignment

Abstract (arXiv)

Recent researches of large language models(LLM), which is pre-trained on massive general-purpose corpora, have achieved breakthroughs in responding human queries. However, these methods face challenges including limited data insufficiency to support extensive pre-training and can not align responses with users' instructions. To address these issues, we introduce a medical instruction dataset, CMedINS, containing six medical instructions derived from actual medical tasks, which effectively fine-tunes LLM in conjunction with other data. Subsequently, We launch our medical model, IIMedGPT, employing an efficient preference alignment method, Direct preference Optimization(DPO). The results show that our final model outperforms existing medical models in medical dialogue.Datsets, Code and model checkpoints will be released upon acceptance.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Medical LLM alignment, one of 10 directions in LLM alignment / RLHF / preference optimisation. Builds on 24 of its 30 references that are in the map. First posted on arXiv 6 Jan 2025.

Builds on

24 of 30 references.

Closest ancestors · 2

Same direction, newest first

  1. 2023Zhongjing: Enhancing the Chinese Medical Capabilities of Large Language Model through Expert Feedback and Real-world Multi-turn Dialogue7 Aug
  2. 2023HuatuoGPT, towards Taming Language Model to Be a Doctor24 May

Other references · 22

  1. 2017Proximal Policy Optimization Algorithmscited by 14,441
  2. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  3. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
  4. 2022Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedbackcited by 3,634
  5. 2023A Survey of Large Language Modelscited by 2,537
  6. 2022BLOOM: A 176B-Parameter Open-Access Multilingual Language Modelcited by 1,968
  7. 2022Large Language Models Encode Clinical Knowledgecited by 1,807
  8. 2021Multitask Prompted Training Enables Zero-Shot Task Generalizationcited by 1,462
  9. 2021GLM: General Language Model Pretraining with Autoregressive Blank Infillingcited by 1,026
  10. 2023Baichuan 2: Open Large-scale Language Modelscited by 664
  11. 2023The Falcon Series of Open Language Modelscited by 526
  12. 2023The Curse of Recursion: Training on Generated Data Makes Models Forgetcited by 343
10 more
  1. 2023ChatDoctor: A Medical Chat Model Fine-Tuned on a Large Language Model Meta-AI (LLaMA) Using Medical Domain Knowledgecited by 324
  2. 2021Pre-Trained Models: Past, Present and Futurecited by 319
  3. 2023Efficient and Effective Text Encoding for Chinese LLaMA and Alpacacited by 302
  4. 2021Muppet: Massive Multi-task Representations with Pre-Finetuningcited by 192
  5. 2023HuaTuo: Tuning LLaMA Model with Chinese Medical Knowledgecited by 161
  6. 2019Mixout: Effective Regularization to Finetune Large-scale Pretrained Language Modelscited by 141
  7. 2023DoctorGLM: Fine-tuning your Chinese Doctor is not a Herculean Taskcited by 130
  8. 2022Fengshenbang 1.0: Being the Foundation of Chinese Cognitive Intelligencecited by 70
  9. 2021How Should Pre-Trained Language Models Be Fine-Tuned Towards Adversarial Robustness?cited by 49
  10. 2023Policy Optimization in RLHF: The Impact of Out-of-preference Datacited by 35

Built on by

Cited by year

Citing papers per year: 2025: 3.

3 papers.

  1. 2025A Survey on the Optimization of Large Language Model-based Agentscited by 45
  2. 2025The Rise of Small Language Models in Healthcare: A Comprehensive Surveycited by 18
  3. 2025Multimodal Large Language Models for Medicine: A Comprehensive Surveycited by 16

Similar, not cited

Close in wording, no citation either way

  1. 2026MedLLM: An Open Medical Language Model at the Sub-Billion Scale
  2. 2023ChiMed-GPT: A Chinese Medical Large Language Model with Full Training Regime and Better Alignment to Human Preferences
  3. 2023MEDITRON-70B: Scaling Medical Pretraining for Large Language Models
  4. 2024The Limited Impact of Medical Adaptation of Large Language and Vision-Language Models
  5. 2024RuleAlign: Making Large Language Models Better Physicians with Diagnostic Rule Alignment
  6. 2023Aligning Large Language Models for Clinical Tasks
  7. 2024A Survey for Large Language Models in Biomedicine
  8. 2023ClinicalGPT: Large Language Models Finetuned with Diverse Medical Data and Comprehensive Evaluation