MedGo: A Chinese Medical Large Language Model
Not on the map. Why?
Abstract (arXiv)
Large models are a hot research topic in the field of artificial intelligence. Leveraging their generative capabilities has the potential to enhance the level and quality of medical services. In response to the limitations of current large language models, which often struggle with accuracy and have narrow capabilities in medical applications, this paper presents a Chinese medical large language model, MedGo. MedGo was trained using a combination of high quality unsupervised medical data, supervised data, and preference alignment data, aimed at enhancing both its versatility and precision in medical tasks. The model was evaluated through the public CBLUE benchmark and a manually constructed dataset ClinicalQA. The results demonstrate that MedGo achieved promising performance across various Chinese medical information processing tasks, achieved the first place in the CBLUE evaluation. Additionally, on our constructed dataset ClinicalQA, MedGo outperformed its base model Qwen2, highlighting its potential to improve both automated medical question answering and clinical decision support. These experimental results demonstrate that MedGo possesses strong information processing capabilities in the medical field. At present, we have successfully deployed MedGo at Shanghai East Hospital.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 31 of its 41 references that are in the map. First posted on arXiv 27 Oct 2024.
Builds on
31 of 41 references.
References · 31
- 2017Attention Is All You Needcited by 60,361
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
- 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,673
- 2019BioBERT: a pre-trained biomedical language representation model for biomedical text miningcited by 1,947
- 2019ZeRO: Memory Optimizations Toward Training Trillion Parameter Modelscited by 1,301
- 2023A Survey on Evaluation of Large Language Modelscited by 1,242
- 2024ChatGLM: A Family of Large Language Models from GLM-130B to GLM-4 All Toolscited by 1,121
- 2023Aligning Large Multimodal Models with Factually Augmented RLHFcited by 712
- 2023Baichuan 2: Open Large-scale Language Modelscited by 670
- 2019ClinicalBERT: Modeling Clinical Notes and Predicting Hospital Readmissioncited by 493
19 more
- 2024Capabilities of Gemini Models in Medicinecited by 237
- 2023Large Language Models in Finance: A Surveycited by 226
- 2023HuatuoGPT, towards Taming Language Model to Be a Doctorcited by 214
- 2019BPE-Dropout: Simple and Effective Subword Regularizationcited by 195
- 2022Can large language models reason about medical questions?cited by 194
- 2023A Study of Generative Large Language Model for Medical Research and Healthcarecited by 163
- 2023Large Language Models in Law: A Surveycited by 128
- 2023Large language models in healthcare and medical domain: A reviewcited by 127
- 2023Zhongjing: Enhancing the Chinese Medical Capabilities of Large Language Model through Expert Feedback and Real-world Multi-turn Dialoguecited by 119
- 2024MMedAgent: Learning to Use Medical Tools with Multi-modal Agentcited by 109
- 2021CBLUE: A Chinese Biomedical Language Understanding Evaluation Benchmarkcited by 101
- 2023AlpaCare:Instruction-tuned Large Language Models for Medical Applicationcited by 90
- 2023MentaLLaMA: Interpretable Mental Health Analysis on Social Media with Large Language Modelscited by 63
- 2022Understanding AdamW through Proximal Methods and Scale-Freenesscited by 46
- 2023ChiMed-GPT: A Chinese Medical Large Language Model with Full Training Regime and Better Alignment to Human Preferencescited by 43
- 2024Large Language Models for Medicine: A Surveycited by 38
- 2023Taiyi: A Bilingual Fine-Tuned Large Language Model for Diverse Biomedical Taskscited by 36
- 2022LingYi: Medical Conversational Question Answering System based on Multi-modal Knowledge Graphscited by 15
- 2024TCM-FTP: Fine-Tuning Large Language Models for Herbal Prescription Predictioncited by 4
Built on by
Not cited yet.