mlsanityData to 14 Oct 2026

DRG-LLaMA : Tuning LLaMA Model to Predict Diagnosis-related Group for Hospitalized Patients

arXiv 2309.12625 ↗First posted 22 Sep 2023cs.AI cs.CLcited by 30

Not on the map. Why?

Abstract (arXiv)

In the U.S. inpatient payment system, the Diagnosis-Related Group (DRG) is pivotal, but its assignment process is inefficient. The study introduces DRG-LLaMA, an advanced large language model (LLM) fine-tuned on clinical notes to enhance DRGs assignment. Utilizing LLaMA as the foundational model and optimizing it through Low-Rank Adaptation (LoRA) on 236,192 MIMIC-IV discharge summaries, our DRG-LLaMA-7B model exhibited a noteworthy macro-averaged F1 score of 0.327, a top-1 prediction accuracy of 52.0%, and a macro-averaged Area Under the Curve (AUC) of 0.986, with a maximum input token length of 512. This model surpassed the performance of prior leading models in DRG prediction, showing a relative improvement of 40.3% and 35.7% in macro-averaged F1 score compared to ClinicalBERT and CAML, respectively. Applied to base DRG and complication or comorbidity (CC)/major complication or comorbidity (MCC) prediction, DRG-LLaMA achieved a top-1 prediction accuracy of 67.8% and 67.5%, respectively. Additionally, our findings indicate that DRG-LLaMA's performance correlates with increased model parameters and input context lengths.

Key facts. Cited by 30 papers in the map (data through 14 Oct 2026). Builds on 20 of its 60 references that are in the map. First posted on arXiv 22 Sep 2023.

Builds on

20 of 60 references.

References · 20

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2020Language Models are Few-Shot Learnerscited by 32,419
  3. 2022Training language models to follow instructions with human feedbackcited by 15,971
  4. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  5. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  6. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  7. 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,455
  8. 2019HuggingFace's Transformers: State-of-the-art Natural Language Processingcited by 2,218
  9. 2019BioBERT: a pre-trained biomedical language representation model for biomedical text miningcited by 1,947
  10. 2020Domain-Specific Language Model Pretraining for Biomedical Natural Language Processingcited by 1,009
  11. 2019Publicly Available Clinical BERT Embeddingscited by 1,002
  12. 2022LLM.int8(): 8-bit Matrix Multiplication for Transformers at Scalecited by 906
8 more
  1. 2023Capabilities of GPT-4 on Medical Challenge Problemscited by 638
  2. 2019ClinicalBERT: Modeling Clinical Notes and Predicting Hospital Readmissioncited by 493
  3. 2023Towards Expert-Level Medical Question Answering with Large Language Modelscited by 384
  4. 2023Towards Generalist Biomedical AIcited by 289
  5. 2018Explainable Prediction of Medical Codes from Clinical Textcited by 234
  6. 2023HuaTuo: Tuning LLaMA Model with Chinese Medical Knowledgecited by 162
  7. 2020Metrics for Multi-Class Classification: an Overviewcited by 143
  8. 2019DocBERT: BERT for Document Classificationcited by 68

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 1; 2024: 13; 2025: 13; 2026: 3.

30 papers.

Sort:

By area:

  1. 2023A Survey of Large Language Models in Medicine: Progress, Application, and Challengecited by 124
  2. 2024A Comprehensive Survey of Scientific Large Language Models and Their Applications in Scientific Discoverycited by 96
  3. 2024Zero Shot Health Trajectory Prediction Using Transformercited by 77
  4. 2024Health-LLM: Large Language Models for Health Prediction via Wearable Sensor Datacited by 66
  5. 2024A dataset and benchmark for hospital course summarization with adapted large language modelscited by 11
  6. 2024Towards Adapting Open-Source Large Language Models for Expert-Level Clinical Note Generationcited by 9
  7. 2024A Perspective for Adapting Generalist AI to Specialized Medical AI Applications and Their Challengescited by 8
  8. 2025Memorize and Rank: Elevating Large Language Models for Clinical Diagnosis Predictioncited by 8
  9. 2025Reinforcement Learning for Out-of-Distribution Reasoning in LLMs: An Empirical Study on Diagnosis-Related Group Codingcited by 7
  10. 2025MoMA: A Mixture-of-Multimodal-Agents Architecture for Enhancing Clinical Prediction Modellingcited by 7
  11. 2024Development and Testing of a Novel Large Language Model-Based Clinical Decision Support Systems for Medication Safety in 12 Clinical Specialtiescited by 5
  12. 2025From large language models to multimodal AI: A scoping review on the potential of generative AI in medicinecited by 5
18 more
  1. 2025Memorization in Large Language Models in Medicine: Prevalence, Characteristics, and Implicationscited by 5
  2. 2024Interpretable Differential Diagnosis with Dual-Inference Large Language Modelscited by 4
  3. 2024Toward Relieving Clinician Burden by Automatically Generating Progress Notes using Interim Hospital Datacited by 4
  4. 2024Entry-level guide to the use of large language models for medical researchcited by 3
  5. 2024Improving Medical Diagnostics with Vision-Language Models: Convex Hull-Based Uncertainty Analysiscited by 3
  6. 2025Intrinsic Model Weaknesses: How Priming Attacks Unveil Vulnerabilities in Large Language Modelscited by 3
  7. 2025Large Language Models for Healthcare Text Classification: A Systematic Reviewcited by 3
  8. 2024The Future of Intelligent Healthcare: A Systematic Analysis and Discussion on the Integration and Impact of Robots Using Large Language Models for Healthcarecited by 2
  9. 2024Rephrasing Electronic Health Records for Pretraining Clinical Language Modelscited by 2
  10. 2025MedGellan: LLM-Generated Medical Guidance to Support Physicianscited by 1
  11. 2026When Metrics Disagree: Automatic Similarity vs. LLM-as-a-Judge for Clinical Dialogue Evaluationcited by 1
  12. 2025Data Augmentation Techniques for Chinese Disease Name Normalizationcited by 0
  13. 2025A Multi-Modal Deep Learning Framework for Pan-Cancer Prognosiscited by 0
  14. 2025Review GIDE -- Restaurant Review Gastrointestinal Illness Detection and Extraction with Large Language Modelscited by 0
  15. 2025Leveraging LLMs for Predicting Unknown Diagnoses from Clinical Notescited by 0
  16. 2025The NordDRG AI Benchmark for Large Language Modelscited by 0
  17. 2026Accelerating Reproducible Research in Synthetic EHR Generationcited by 0
  18. 2026Hidden Data Challenges in Clinical Machine Learningcited by 0