Improving Fairness of Large Language Model-Based ICU Mortality Prediction via Case-Based Prompting
Not on the map. Why?
Abstract (arXiv)
Accurately predicting mortality risk in intensive care unit (ICU) patients is critical for clinical decision-making. Large language models (LLMs) are increasingly explored for clinical prediction using structured medical data, but their outputs may exhibit demographic disparities. Mitigating such disparities without degrading predictive performance remains challenging. We systematically investigate demographic bias in LLM-based ICU mortality prediction and propose Case-Based Prompting (CAP), a training-free framework designed to improve the empirical balance between predictive performance and subgroup fairness. CAP retrieves clinically similar historical misprediction and demographic-sensitive cases with known outcomes and incorporates them as case-level contextual evidence. We further evaluate model discrimination, subgroup fairness, and feature-dependence consistency. On MIMIC-IV, CAP improved AUROC from 0.806 to 0.873 and AUPRC from 0.497 to 0.694 compared with the Baseline Prompt. CAP also reduced several subgroup disparities, particularly for sex and White-Black comparisons, although age-related disparities remained non-negligible. Controlled demographic-information ablations showed that removing demographic information did not uniformly improve both predictive performance and subgroup fairness, indicating distinct performance-fairness patterns rather than a uniform benefit from demographic suppression. Feature-dependence analysis showed generally consistent expressed clinical factor patterns across demographic subgroups. These findings suggest that CAP is a promising inference-time strategy for LLM-based clinical prediction under the evaluated retrospective setting. Further validation across additional LLMs, external datasets, and prospective clinical scenarios is required before deployment.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 20 of its 78 references that are in the map. First posted on arXiv 17 Dec 2025.
Builds on
20 of 78 references.
References · 20
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2019A Survey on Bias and Fairness in Machine Learningcited by 1,911
- 2022Large Language Models Encode Clinical Knowledgecited by 1,807
- 2022Rethinking the Role of Demonstrations: What Makes In-Context Learning Work?cited by 1,413
- 2018A Survey Of Methods For Explaining Black Box Modelscited by 970
- 2019A Framework for Understanding Sources of Harm throughout the Machine Learning Life Cyclecited by 192
- 2023Large Language Models Are Latent Variable Models: Explaining and Finding Good Demonstrations for In-Context Learningcited by 149
- 2023Fairness-guided Few-shot Prompting for Large Language Modelscited by 53
- 2024Thinking Fair and Slow: On the Efficacy of Structured Prompts for Debiasing Language Modelscited by 44
- 2024Prompting Techniques for Reducing Social Bias in LLMs through System 1 and System 2 Cognitive Processescited by 38
- 2024Prompting Fairness: Integrating Causality to Debias Large Language Modelscited by 20
8 more
- 2023Co2PT: Mitigating Bias in Pre-trained Language Models through Counterfactual Contrastive Prompt Tuningcited by 15
- 2024Aligning (Medical) LLMs for (Counterfactual) Fairnesscited by 7
- 2025FairMedQA: Benchmarking Bias in Large Language Models for Medical Question Answeringcited by 6
- 2025Metric-Fair Prompting: Treating Similar Samples Similarlycited by 3
- 2023Dual-Teacher De-biasing Distillation Framework for Multi-domain Fake News Detectioncited by 2
- 2024Monitoring fairness in machine learning models that predict patient mortality in the ICUcited by 2
- 2025FAST-CAD: A Fairness-Aware Framework for Non-Contact Stroke Diagnosiscited by 2
- 2025FunnyNodules: A Customizable Medical Dataset Tailored for Evaluating Explainable AIcited by 2
Built on by
Not cited yet.