mlsanityData to 14 Oct 2026

Debias-CLR: A Contrastive Learning Based Debiasing Method for Algorithmic Fairness in Healthcare Applications

arXiv 2411.10544 ↗First posted 15 Nov 2024cs.LG cs.CYcited by 1

Not on the map. Why?

Abstract (arXiv)

Artificial intelligence based predictive models trained on the clinical notes can be demographically biased. This could lead to adverse healthcare disparities in predicting outcomes like length of stay of the patients. Thus, it is necessary to mitigate the demographic biases within these models. We proposed an implicit in-processing debiasing method to combat disparate treatment which occurs when the machine learning model predict different outcomes for individuals based on the sensitive attributes like gender, ethnicity, race, and likewise. For this purpose, we used clinical notes of heart failure patients and used diagnostic codes, procedure reports and physiological vitals of the patients. We used Clinical BERT to obtain feature embeddings within the diagnostic codes and procedure reports, and LSTM autoencoders to obtain feature embeddings within the physiological vitals. Then, we trained two separate deep learning contrastive learning frameworks, one for gender and the other for ethnicity to obtain debiased representations within those demographic traits. We called this debiasing framework Debias-CLR. We leveraged clinical phenotypes of the patients identified in the diagnostic codes and procedure reports in the previous study to measure fairness statistically. We found that Debias-CLR was able to reduce the Single-Category Word Embedding Association Test (SC-WEAT) effect size score when debiasing for gender and ethnicity. We further found that to obtain fair representations in the embedding space using Debias-CLR, the accuracy of the predictive models on downstream tasks like predicting length of stay of the patients did not get reduced as compared to using the un-debiased counterparts for training the predictive models. Hence, we conclude that our proposed approach, Debias-CLR is fair and representative in mitigating demographic biases and can reduce health disparities.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 20 of its 44 references that are in the map. First posted on arXiv 15 Nov 2024.

Builds on

20 of 44 references.

References · 20

  1. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
  2. 2016Equality of Opportunity in Supervised Learningcited by 2,007
  3. 2016Semantics derived automatically from language corpora contain human-like biasescited by 901
  4. 2020A Survey on Contrastive Self-supervised Learningcited by 554
  5. 2019ClinicalBERT: Modeling Clinical Notes and Predicting Hospital Readmissioncited by 493
  6. 2015Censoring Representations with an Adversarycited by 192
  7. 2019On the Fairness of Disentangled Representationscited by 144
  8. 2019Wasserstein Fair Classificationcited by 131
  9. 2020Hurtful Words: Quantifying Biases in Clinical Contextual Word Embeddingscited by 79
  10. 2021FairFil: Contrastive Neural Debiasing Method for Pretrained Text Encoderscited by 75
  11. 2019Putting Fairness Principles into Practice: Challenges, Metrics, and Improvementscited by 70
  12. 2020Learning Certified Individually Fair Representationscited by 69
8 more
  1. 2021Directional Bias Amplificationcited by 54
  2. 2023Time Series Contrastive Learning with Information-Aware Augmentationscited by 52
  3. 2021Contrastive Learning for Fair Representationscited by 34
  4. 2022Gender Bias in Word Embeddings: A Comprehensive Analysis of Frequency, Syntax, and Semanticscited by 24
  5. 2022Write It Like You See It: Detectable Differences in Clinical Notes By Race Lead To Differential Model Recommendationscited by 20
  6. 2022Leveraging Natural Learning Processing to Uncover Themes in Clinical Notes of Patients Admitted for Heart Failurecited by 2
  7. 2020Leveraging Natural Language Processing to Mine Issues on Twitter During the COVID-19 Pandemiccited by 1
  8. 2023Mining Themes in Clinical Notes to Identify Phenotypes and to Predict Length of Stay in Patients admitted with Heart Failurecited by 1

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.