mlsanityData to 14 Oct 2026

CPLLM: Clinical Prediction with Large Language Models

arXiv 2309.11295 ↗First posted 20 Sep 2023cs.CL cs.AI cs.LGcited by 34

Not on the map. Why?

Abstract (arXiv)

We present Clinical Prediction with Large Language Models (CPLLM), a method that involves fine-tuning a pre-trained Large Language Model (LLM) for clinical disease and readmission prediction. We utilized quantization and fine-tuned the LLM using prompts. For diagnosis prediction, we predict whether patients will be diagnosed with a target disease during their next visit or in the subsequent diagnosis, leveraging their historical diagnosis records. We compared our results to various baselines, including RETAIN, and Med-BERT, the current state-of-the-art model for disease prediction using temporal structured EHR data. In addition, We also evaluated CPLLM for patient hospital readmission prediction and compared our method's performance with benchmark baselines. Our experiments have shown that our proposed method, CPLLM, surpasses all the tested models in terms of PR-AUC and ROC-AUC metrics, showing state-of-the-art results for diagnosis prediction and patient hospital readmission prediction. Such a method can be easily implemented and integrated into the clinical process to help care providers estimate the next steps of patients

Key facts. Cited by 34 papers in the map (data through 14 Oct 2026). Builds on 28 of its 57 references that are in the map. First posted on arXiv 20 Sep 2023.

Builds on

28 of 57 references.

References · 28

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2023GPT-4 Technical Reportcited by 18,396
  4. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  5. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
  6. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  7. 2019Parameter-Efficient Transfer Learning for NLPcited by 4,236
  8. 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,418
  9. 2023A Survey of Large Language Modelscited by 2,576
  10. 2020DeBERTa: Decoding-enhanced BERT with Disentangled Attentioncited by 2,181
  11. 2022BLOOM: A 176B-Parameter Open-Access Multilingual Language Modelcited by 1,984
  12. 2022Large Language Models Encode Clinical Knowledgecited by 1,830
16 more
  1. 2023Harnessing the Power of LLMs in Practice: A Survey on ChatGPT and Beyondcited by 411
  2. 2023Augmented Language Models: a Surveycited by 403
  3. 2020Med-BERT: pre-trained contextualized embeddings on large-scale structured electronic health records for disease predictioncited by 373
  4. 2016RETAIN: An Interpretable Predictive Model for Healthcare using Reverse Time Attention Mechanismcited by 349
  5. 2019BEHRT: Transformer for Electronic Health Recordscited by 263
  6. 2022GatorTron: A Large Clinical Language Model to Unlock Patient Information from Unstructured Electronic Health Recordscited by 238
  7. 2022Large Language Models are Few-Shot Clinical Information Extractorscited by 207
  8. 2023Almanac: Retrieval-Augmented Language Models for Clinical Medicinecited by 123
  9. 2023Text Classification via Large Language Modelscited by 106
  10. 2020Language Models Are An Effective Patient Representation Learning Technique For Electronic Health Record Datacited by 87
  11. 2022Clinical-Longformer and Clinical-BigBird: Transformers for long clinical sequencescited by 69
  12. 2016Deepr: A Convolutional Net for Medical Recordscited by 60
  13. 2019ConCare: Personalized Clinical Feature Embedding via Capturing the Healthcare Contextcited by 56
  14. 2021Hi-BEHRT: Hierarchical Transformer-based model for accurate prediction of clinical events using multimodal longitudinal electronic health recordscited by 54
  15. 2022HealthPrompt: A Zero-shot Learning Paradigm for Clinical Natural Language Processingcited by 26
  16. 2023Federated Learning of Medical Concepts Embedding using BEHRTcited by 11

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 3; 2024: 12; 2025: 8; 2026: 11.

34 papers.

Sort:

By area:

  1. 2024Large Language Models(LLMs) on Tabular Data: Prediction, Generation, and Understanding -- A Surveycited by 159
  2. 2023A Survey of Large Language Models in Medicine: Progress, Application, and Challengecited by 124
  3. 2024A Comprehensive Survey of Large Language Models and Multimodal Large Language Models in Medicinecited by 45
  4. 2024Large Language Models in Cybersecurity: State-of-the-Artcited by 34
  5. 2025Large Language Models are Powerful Electronic Health Record Encoderscited by 26
  6. 2025Multimodal Large Language Models for Medicine: A Comprehensive Surveycited by 16
  7. 2025KERAP: A Knowledge-Enhanced Reasoning Approach for Accurate Zero-shot Diagnosis Prediction Using Multi-agent LLMscited by 12
  8. 2024ChatNVD: Advancing Cybersecurity Vulnerability Assessment with Large Language Modelscited by 11
  9. 2025Memorize and Rank: Elevating Large Language Models for Clinical Diagnosis Predictioncited by 8
  10. 2024MedConceptsQA: Open Source Medical Concepts QA Benchmarkcited by 6
  11. 2024Clinical Insights: A Comprehensive Review of Language Models in Medicinecited by 6
  12. 2026Retrieval-aligned Tabular Foundation Models Enable Robust Clinical Risk Prediction in Electronic Health Records Under Real-world Constraintscited by 4
22 more
  1. 2024MedPromptX: Grounded Multimodal Prompting for Chest X-ray Diagnosiscited by 3
  2. 2025Will Large Language Models Transform Clinical Prediction?cited by 3
  3. 2025Generalist Foundation Models Are Not Clinical Enough for Hospital Operationscited by 3
  4. 2023MedAI Dialog Corpus (MEDIC): Zero-Shot Classification of Doctor and AI Responses in Health Consultationscited by 2
  5. 2024Explainable Diagnosis Prediction through Neuro-Symbolic Integrationcited by 2
  6. 2026Reinforcement Learning Improves LLM Accuracy and Reasoning in Disease Classification from Radiology Reportscited by 2
  7. 2024A Survey for Large Language Models in Biomedicinecited by 1
  8. 2024Generative LLM Powered Conversational AI Application for Personalized Risk Assessment: A Case Study in COVID-19cited by 1
  9. 2025Advances in Large Language Models for Medicinecited by 1
  10. 2026Predicting Post-Traumatic Epilepsy from Clinical Records using Large Language Model Embeddingscited by 1
  11. 2026Policy-Driven CT-Agent: Modeling Phase-Aware Diagnostic Control for Clinically Consistent CT Reasoningcited by 1
  12. 2023Can-SAVE: Deploying Low-Cost and Population-Scale Cancer Screening via Survival Analysis Variables and EHRcited by 0
  13. 2024Towards Holistic Disease Risk Prediction using Small Language Modelscited by 0
  14. 2024Detecci'on Autom'atica de Patolog'ias en Notas Cl'inicas en Espa~nol Combinando Modelos de Lenguaje y Ontolog'ias M'edicoscited by 0
  15. 2025BrAIcht, a theatrical agent that speaks like Bertolt Brecht's characterscited by 0
  16. 2026Building Safe and Deployable Clinical Natural Language Processing under Temporal Leakage Constraintscited by 0
  17. 2026CLSGen: A Dual-Head Fine-Tuning Framework for Joint Probabilistic Classification and Verbalized Explanationcited by 0
  18. 2026What LLMs explain is not what they believe: Evaluating explanation sufficiency under models' own input beliefscited by 0
  19. 2026Trajectory-Aware Clinical Risk Prediction via Severity-Grounded Knowledge Graphs and Retrieval-Augmented Generationcited by 0
  20. 2026Structured Evidence Routing for Incident Risk Prediction from Multimodal Longitudinal EHRscited by 0
  21. 2026EHRAdapt: Adapting Pretrained Language Models to Electronic Health Records with Semantic Priors for Rare Clinical Eventscited by 0
  22. 2026GLoC-EHR: Evidence-Cited Clinical Reasoning over Global Context and Local EHR Eventscited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025BRIDGE: Benchmarking Large Language Models for Understanding Real-world Clinical Practice Text
  2. 2024Health-LLM: Personalized Retrieval-Augmented Disease Prediction System
  3. 2025Large Language Models with Temporal Reasoning for Longitudinal Clinical Summarization and Prediction
  4. 2025Benchmarking Open-Source Large Language Models on Healthcare Text Classification Tasks
  5. 2026Future Querying: Can LLMs Serve as Implicit Medical World Models?
  6. 2026A primer on evaluation methods for large language models in healthcare
  7. 2025Performance of Large Language Models in Supporting Medical Diagnosis and Treatment
  8. 2024D-NLP at SemEval-2024 Task 2: Evaluating Clinical Inference Capabilities of Large Language Models