mlsanityData to 7 Oct 2026

Diabetica: Adapting Large Language Model to Enhance Multiple Medical Tasks in Diabetes Care and Management

arXiv 2409.13191 ↗First posted 20 Sep 2024cs.CL cs.AI cs.CEcited by 2

Not on the map. Why?

Abstract (arXiv)

Diabetes is a chronic disease with a significant global health burden, requiring multi-stakeholder collaboration for optimal management. Large language models (LLMs) have shown promise in various healthcare scenarios, but their effectiveness across diverse diabetes tasks remains unproven. Our study introduced a framework to train and validate diabetes-specific LLMs. We first developed a comprehensive data processing pipeline that includes data collection, filtering, augmentation and refinement. This created a high-quality, diabetes-specific dataset and evaluation benchmarks from scratch. Fine-tuned on the collected training dataset, our diabetes-specific LLM family demonstrated state-of-the-art proficiency in processing various diabetes tasks compared to other LLMs. Furthermore, clinical studies revealed the potential applications of our models in diabetes care, including providing personalized healthcare, assisting medical education, and streamlining clinical tasks. Generally, our introduced framework helps develop diabetes-specific LLMs and highlights their potential to enhance clinical practice and provide personalized, data-driven support for diabetes management across different end users. Our codes, benchmarks and models are available at https://github.com/waltonfuture/Diabetica.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 38 of its 62 references that are in the map. First posted on arXiv 20 Sep 2024.

Builds on

38 of 62 references.

References · 38

  1. 2023GPT-4 Technical Reportcited by 18,132
  2. 2022Training language models to follow instructions with human feedbackcited by 15,712
  3. 2024The Llama 3 Herd of Modelscited by 14,192
  4. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  5. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  6. 2021Training Verifiers to Solve Math Word Problemscited by 9,743
  7. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
  8. 2020Measuring Massive Multitask Language Understandingcited by 7,768
  9. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
  10. 2023Qwen Technical Reportcited by 3,273
  11. 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,674
  12. 2020What Disease does this Patient Have? A Large-scale Open Domain Question Answering Dataset from Medical Examscited by 1,324
26 more
  1. 2023PaLM 2 Technical Reportcited by 1,154
  2. 2024Yi: Open Foundation Models by 01.AIcited by 706
  3. 2023C-Eval: A Multi-Level Multi-Discipline Chinese Evaluation Suite for Foundation Modelscited by 694
  4. 2023C-Pack: Packed Resources For General Chinese Embeddingscited by 556
  5. 2022MedMCQA : A Large-scale Multi-Subject Multi-Choice Dataset for Medical domain Question Answeringcited by 525
  6. 2023CMMLU: Measuring massive multitask language understanding in Chinesecited by 436
  7. 2024InternLM2 Technical Reportcited by 391
  8. 2023SemDeDup: Data-efficient learning at web-scale through semantic deduplicationcited by 295
  9. 2023MEDITRON-70B: Scaling Medical Pretraining for Large Language Modelscited by 272
  10. 2024Is DPO Superior to PPO for LLM Alignment? A Comprehensive Studycited by 262
  11. 2023Adapted Large Language Models Can Outperform Medical Experts in Clinical Text Summarizationcited by 244
  12. 2023D4: Improving LLM Pretraining via Document De-Duplication and Diversificationcited by 146
  13. 2023Zhongjing: Enhancing the Chinese Medical Capabilities of Large Language Model through Expert Feedback and Real-world Multi-turn Dialoguecited by 118
  14. 2023CMB: A Comprehensive Medical Benchmark in Chinesecited by 113
  15. 2024How to Train Data-Efficient LLMscited by 91
  16. 2024Towards Building Multilingual Language Model for Medicinecited by 91
  17. 2023Benchmarking Large Language Models on CMExam -- A Comprehensive Chinese Medical Exam Datasetcited by 90
  18. 2024Self-Distillation Bridges Distribution Gap in Language Model Fine-Tuningcited by 90
  19. 2023DISC-MedLLM: Bridging General Large Language Models and Real-World Medical Consultationcited by 89
  20. 2024Analyzing and Reducing Catastrophic Forgetting in Parameter Efficient Tuningcited by 59
  21. 2023Lawyer LLaMA Technical Reportcited by 54
  22. 2023Huatuo-26M, a Large-scale Chinese Medical QA Datasetcited by 46
  23. 2024Learning or Self-aligning? Rethinking Instruction Fine-tuningcited by 43
  24. 2024Apollo: A Lightweight Multilingual Medical LLM towards Democratizing Medical AI to 6B Peoplecited by 38
  25. 2024Closing the gap between open-source and commercial large language models for medical evidence summarizationcited by 21
  26. 2021DiaKG: an Annotated Diabetes Dataset for Medical Knowledge Graph Constructioncited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 1; 2026: 1.

2 papers.