Diabetica: Adapting Large Language Model to Enhance Multiple Medical Tasks in Diabetes Care and Management
Not on the map. Why?
Abstract (arXiv)
Diabetes is a chronic disease with a significant global health burden, requiring multi-stakeholder collaboration for optimal management. Large language models (LLMs) have shown promise in various healthcare scenarios, but their effectiveness across diverse diabetes tasks remains unproven. Our study introduced a framework to train and validate diabetes-specific LLMs. We first developed a comprehensive data processing pipeline that includes data collection, filtering, augmentation and refinement. This created a high-quality, diabetes-specific dataset and evaluation benchmarks from scratch. Fine-tuned on the collected training dataset, our diabetes-specific LLM family demonstrated state-of-the-art proficiency in processing various diabetes tasks compared to other LLMs. Furthermore, clinical studies revealed the potential applications of our models in diabetes care, including providing personalized healthcare, assisting medical education, and streamlining clinical tasks. Generally, our introduced framework helps develop diabetes-specific LLMs and highlights their potential to enhance clinical practice and provide personalized, data-driven support for diabetes management across different end users. Our codes, benchmarks and models are available at https://github.com/waltonfuture/Diabetica.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 38 of its 62 references that are in the map. First posted on arXiv 20 Sep 2024.
Builds on
38 of 62 references.
References · 38
- 2023GPT-4 Technical Reportcited by 18,132
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2021Training Verifiers to Solve Math Word Problemscited by 9,743
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
- 2020Measuring Massive Multitask Language Understandingcited by 7,768
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
- 2023Qwen Technical Reportcited by 3,273
- 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,674
- 2020What Disease does this Patient Have? A Large-scale Open Domain Question Answering Dataset from Medical Examscited by 1,324
26 more
- 2023PaLM 2 Technical Reportcited by 1,154
- 2024Yi: Open Foundation Models by 01.AIcited by 706
- 2023C-Eval: A Multi-Level Multi-Discipline Chinese Evaluation Suite for Foundation Modelscited by 694
- 2023C-Pack: Packed Resources For General Chinese Embeddingscited by 556
- 2022MedMCQA : A Large-scale Multi-Subject Multi-Choice Dataset for Medical domain Question Answeringcited by 525
- 2023CMMLU: Measuring massive multitask language understanding in Chinesecited by 436
- 2024InternLM2 Technical Reportcited by 391
- 2023SemDeDup: Data-efficient learning at web-scale through semantic deduplicationcited by 295
- 2023MEDITRON-70B: Scaling Medical Pretraining for Large Language Modelscited by 272
- 2024Is DPO Superior to PPO for LLM Alignment? A Comprehensive Studycited by 262
- 2023Adapted Large Language Models Can Outperform Medical Experts in Clinical Text Summarizationcited by 244
- 2023D4: Improving LLM Pretraining via Document De-Duplication and Diversificationcited by 146
- 2023Zhongjing: Enhancing the Chinese Medical Capabilities of Large Language Model through Expert Feedback and Real-world Multi-turn Dialoguecited by 118
- 2023CMB: A Comprehensive Medical Benchmark in Chinesecited by 113
- 2024How to Train Data-Efficient LLMscited by 91
- 2024Towards Building Multilingual Language Model for Medicinecited by 91
- 2023Benchmarking Large Language Models on CMExam -- A Comprehensive Chinese Medical Exam Datasetcited by 90
- 2024Self-Distillation Bridges Distribution Gap in Language Model Fine-Tuningcited by 90
- 2023DISC-MedLLM: Bridging General Large Language Models and Real-World Medical Consultationcited by 89
- 2024Analyzing and Reducing Catastrophic Forgetting in Parameter Efficient Tuningcited by 59
- 2023Lawyer LLaMA Technical Reportcited by 54
- 2023Huatuo-26M, a Large-scale Chinese Medical QA Datasetcited by 46
- 2024Learning or Self-aligning? Rethinking Instruction Fine-tuningcited by 43
- 2024Apollo: A Lightweight Multilingual Medical LLM towards Democratizing Medical AI to 6B Peoplecited by 38
- 2024Closing the gap between open-source and commercial large language models for medical evidence summarizationcited by 21
- 2021DiaKG: an Annotated Diabetes Dataset for Medical Knowledge Graph Constructioncited by 5
Built on by
Citing papers per year: 2025: 1; 2026: 1.
2 papers.