mlsanityData to 14 Oct 2026

MedGo: A Chinese Medical Large Language Model

arXiv 2410.20428 ↗First posted 27 Oct 2024cs.CL cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Large models are a hot research topic in the field of artificial intelligence. Leveraging their generative capabilities has the potential to enhance the level and quality of medical services. In response to the limitations of current large language models, which often struggle with accuracy and have narrow capabilities in medical applications, this paper presents a Chinese medical large language model, MedGo. MedGo was trained using a combination of high quality unsupervised medical data, supervised data, and preference alignment data, aimed at enhancing both its versatility and precision in medical tasks. The model was evaluated through the public CBLUE benchmark and a manually constructed dataset ClinicalQA. The results demonstrate that MedGo achieved promising performance across various Chinese medical information processing tasks, achieved the first place in the CBLUE evaluation. Additionally, on our constructed dataset ClinicalQA, MedGo outperformed its base model Qwen2, highlighting its potential to improve both automated medical question answering and clinical decision support. These experimental results demonstrate that MedGo possesses strong information processing capabilities in the medical field. At present, we have successfully deployed MedGo at Shanghai East Hospital.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 31 of its 41 references that are in the map. First posted on arXiv 27 Oct 2024.

Builds on

31 of 41 references.

References · 31

  1. 2017Attention Is All You Needcited by 60,361
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  3. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  4. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
  5. 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,673
  6. 2019BioBERT: a pre-trained biomedical language representation model for biomedical text miningcited by 1,947
  7. 2019ZeRO: Memory Optimizations Toward Training Trillion Parameter Modelscited by 1,301
  8. 2023A Survey on Evaluation of Large Language Modelscited by 1,242
  9. 2024ChatGLM: A Family of Large Language Models from GLM-130B to GLM-4 All Toolscited by 1,121
  10. 2023Aligning Large Multimodal Models with Factually Augmented RLHFcited by 712
  11. 2023Baichuan 2: Open Large-scale Language Modelscited by 670
  12. 2019ClinicalBERT: Modeling Clinical Notes and Predicting Hospital Readmissioncited by 493
19 more
  1. 2024Capabilities of Gemini Models in Medicinecited by 237
  2. 2023Large Language Models in Finance: A Surveycited by 226
  3. 2023HuatuoGPT, towards Taming Language Model to Be a Doctorcited by 214
  4. 2019BPE-Dropout: Simple and Effective Subword Regularizationcited by 195
  5. 2022Can large language models reason about medical questions?cited by 194
  6. 2023A Study of Generative Large Language Model for Medical Research and Healthcarecited by 163
  7. 2023Large Language Models in Law: A Surveycited by 128
  8. 2023Large language models in healthcare and medical domain: A reviewcited by 127
  9. 2023Zhongjing: Enhancing the Chinese Medical Capabilities of Large Language Model through Expert Feedback and Real-world Multi-turn Dialoguecited by 119
  10. 2024MMedAgent: Learning to Use Medical Tools with Multi-modal Agentcited by 109
  11. 2021CBLUE: A Chinese Biomedical Language Understanding Evaluation Benchmarkcited by 101
  12. 2023AlpaCare:Instruction-tuned Large Language Models for Medical Applicationcited by 90
  13. 2023MentaLLaMA: Interpretable Mental Health Analysis on Social Media with Large Language Modelscited by 63
  14. 2022Understanding AdamW through Proximal Methods and Scale-Freenesscited by 46
  15. 2023ChiMed-GPT: A Chinese Medical Large Language Model with Full Training Regime and Better Alignment to Human Preferencescited by 43
  16. 2024Large Language Models for Medicine: A Surveycited by 38
  17. 2023Taiyi: A Bilingual Fine-Tuned Large Language Model for Diverse Biomedical Taskscited by 36
  18. 2022LingYi: Medical Conversational Question Answering System based on Multi-modal Knowledge Graphscited by 15
  19. 2024TCM-FTP: Fine-Tuning Large Language Models for Herbal Prescription Predictioncited by 4

Built on by

Not cited yet.