Algorithm Fairness in AI for Medicine and Healthcare
Not on the map. Why?
Abstract (arXiv)
In the current development and deployment of many artificial intelligence (AI) systems in healthcare, algorithm fairness is a challenging problem in delivering equitable care. Recent evaluation of AI models stratified across race sub-populations have revealed inequalities in how patients are diagnosed, given treatments, and billed for healthcare costs. In this perspective article, we summarize the intersectional field of fairness in machine learning through the context of current issues in healthcare, outline how algorithmic biases (e.g. - image acquisition, genetic variation, intra-observer labeling variability) arise in current clinical workflows and their resulting healthcare disparities. Lastly, we also review emerging technology for mitigating bias via federated learning, disentanglement, and model explainability, and their role in AI-SaMD development.
Key facts. Cited by 21 papers in the map (data through 14 Oct 2026). Builds on 125 of its 325 references that are in the map. First posted on arXiv 1 Oct 2021.
Builds on
125 of 325 references.
References · 125
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
- 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,669
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,733
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,555
- 2017Axiomatic Attribution for Deep Networkscited by 3,384
- 2018Federated Optimization in Heterogeneous Networkscited by 2,987
- 2013Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Mapscited by 2,371
- 2013Visualizing and Understanding Convolutional Networkscited by 2,290
- 2016Equality of Opportunity in Supervised Learningcited by 2,007
- 2014Unsupervised Domain Adaptation by Backpropagationcited by 1,917
- 2016Federated Learning: Strategies for Improving Communication Efficiencycited by 1,475
38 more
- 2018Attention U-Net: Learning Where to Look for the Pancreascited by 1,435
- 2019CheXpert: A Large Chest Radiograph Dataset with Uncertainty Labels and Expert Comparisoncited by 1,423
- 2019Distributionally Robust Neural Networks for Group Shifts: On the Importance of Regularization for Worst-Case Generalizationcited by 1,247
- 2018Sanity Checks for Saliency Mapscited by 1,156
- 2018Federated Learning with Non-IID Datacited by 1,108
- 2018Attention-based Deep Multiple Instance Learningcited by 1,095
- 2018Challenging Common Assumptions in the Unsupervised Learning of Disentangled Representationscited by 941
- 2016InfoGAN: Interpretable Representation Learning by Information Maximizing Generative Adversarial Netscited by 860
- 2020Do We Really Need to Access the Source Data? Source Hypothesis Transfer for Unsupervised Domain Adaptationcited by 848
- 2019Towards Federated Learning at Scale: System Designcited by 832
- 2020Data Efficient and Weakly Supervised Computational Pathology on Whole Slide Imagescited by 745
- 2018Mitigating Unwanted Biases with Adversarial Learningcited by 663
- 2020The Future of Digital Health with Federated Learningcited by 633
- 2018Disentangling by Factorisingcited by 616
- 2018A Reductions Approach to Fair Classificationcited by 587
- 2016Inherent Trade-Offs in the Fair Determination of Risk Scorescited by 586
- 2017A systematic study of the class imbalance problem in convolutional neural networkscited by 513
- 2017Deep Gradient Compression: Reducing the Communication Bandwidth for Distributed Trainingcited by 478
- 2019Robust and Communication-Efficient Federated Learning from Non-IID Datacited by 419
- 2017Causal Effect Inference with Deep Latent-Variable Modelscited by 410
- 2017On Fairness and Calibrationcited by 406
- 2016Fairness Beyond Disparate Treatment & Disparate Impact: Learning Classification without Disparate Mistreatmentcited by 369
- 2018Learning Adversarially Fair and Transferable Representationscited by 353
- 2017The (Un)reliability of saliency methodscited by 333
- 2019Adapting Neural Networks for the Estimation of Treatment Effectscited by 287
- 2018Attention Gated Networks: Learning to Leverage Salient Regions in Medical Imagescited by 272
- 2017Variational Inference of Disentangled Latent Concepts from Unlabeled Observationscited by 241
- 2019Large Scale Adversarial Representation Learningcited by 239
- 2017Predict Responsibly: Improving Fairness and Accuracy by Learning to Defercited by 233
- 2015The Variational Fair Autoencodercited by 223
- 2017Emergence of Invariance and Disentanglement in Deep Representationscited by 215
- 2019Flexibly Fair Representation Learning by Disentanglementcited by 196
- 2020Fairness in Machine Learningcited by 194
- 2019Causality matters in medical imagingcited by 193
- 2019Privacy-preserving Federated Brain Tumour Segmentationcited by 169
- 2020Formalizing Trust in Artificial Intelligence: Prerequisites, Causes and Goals of Human Trust in AIcited by 167
- 2019Pathomic Fusion: An Integrated Framework for Fusing Histopathology and Genomic Features for Cancer Diagnosis and Prognosiscited by 165
- 2018FairGAN: Fairness-aware Generative Adversarial Networkscited by 164
50 most cited of 125 All 125 (JSON)
Built on by
Citing papers per year: 2022: 11; 2023: 7; 2024: 2; 2025: 0; 2026: 1.
21 papers.
Sort:
By area:
- 2022MEDFAIR: Benchmarking Fairness for Medical Imagingcited by 68
- 2022Guidelines and Evaluation of Clinical Explainable AI in Medical Image Analysiscited by 35
- 2023Fair Machine Unlearning: Data Removal while Mitigating Disparitiescited by 26
- 2022A Review of Causality for Learning Algorithms in Medical Image Analysiscited by 18
- 2023Improving Fairness in AI Models on Electronic Health Records: The Case for Federated Learning Methodscited by 17
- 2023A Review of the Role of Causality in Developing Trustworthy AI Systemscited by 14
- 2022Mitigating Health Disparities in EHR via Deconfoundercited by 7
- 2023Fairness Evaluation in Text Classification: Machine Learning Practitioner Perspectives of Individual and Group Fairnesscited by 7
- 2022Three Applications of Conformal Prediction for Rating Breast Density in Mammographycited by 6
- 2022Imputation Strategies Under Clinical Presence: Impact on Algorithmic Fairnesscited by 6
- 2022Enhancing Fairness of Visual Attribute Predictorscited by 3
- 2022A Survey on Preserving Fairness Guarantees in Changing Environmentscited by 2
9 more
- 2024Out-of-distribution Reject Option Method for Dataset Shift Problem in Early Disease Onset Predictioncited by 1
- 2024Ethical considerations of use of hold-out sets in clinical prediction model managementcited by 1
- 2022Fair Machine Learning in Healthcare: A Reviewcited by 0
- 2022Identifying and Combating Bias in Segmentation Networks by leveraging multiple resolutionscited by 0
- 2022Ex-Ante Assessment of Discrimination in Datasetcited by 0
- 2023Echoes of Biases: How Stigmatizing Language Affects AI Performancecited by 0
- 2023Learning Unbiased Image Segmentation: A Case Study with Plain Knee Radiographscited by 0
- 2023Beyond Fairness: Age-Harmless Parkinson's Detection via Voicecited by 0
- 2026Causal Transfer in Medical Image Analysiscited by 0
- 2026Causal Transfer in Medical Image Analysis25 Mar 2026
- 2024Ethical considerations of use of hold-out sets in clinical prediction model management5 Jun 2024
- 2024Out-of-distribution Reject Option Method for Dataset Shift Problem in Early Disease Onset Prediction30 May 2024
- 2023Beyond Fairness: Age-Harmless Parkinson's Detection via Voice23 Sep 2023
- 2023Learning Unbiased Image Segmentation: A Case Study with Plain Knee Radiographs8 Aug 2023
- 2023Fair Machine Unlearning: Data Removal while Mitigating Disparities27 Jul 2023
- 2023Improving Fairness in AI Models on Electronic Health Records: The Case for Federated Learning Methods19 May 2023
- 2023Echoes of Biases: How Stigmatizing Language Affects AI Performance17 May 2023
- 2023Fairness Evaluation in Text Classification: Machine Learning Practitioner Perspectives of Individual and Group Fairness1 Mar 2023
- 2023A Review of the Role of Causality in Developing Trustworthy AI Systems14 Feb 2023
- 2022A Survey on Preserving Fairness Guarantees in Changing Environments14 Nov 2022
- 2022Mitigating Health Disparities in EHR via Deconfounder28 Oct 2022
9 more
- 2022MEDFAIR: Benchmarking Fairness for Medical Imaging4 Oct 2022
- 2022Ex-Ante Assessment of Discrimination in Dataset16 Aug 2022
- 2022Imputation Strategies Under Clinical Presence: Impact on Algorithmic Fairness13 Aug 2022
- 2022Enhancing Fairness of Visual Attribute Predictors7 Jul 2022
- 2022Identifying and Combating Bias in Segmentation Networks by leveraging multiple resolutions29 Jun 2022
- 2022Fair Machine Learning in Healthcare: A Review29 Jun 2022
- 2022Three Applications of Conformal Prediction for Rating Breast Density in Mammography23 Jun 2022
- 2022A Review of Causality for Learning Algorithms in Medical Image Analysis11 Jun 2022
- 2022Guidelines and Evaluation of Clinical Explainable AI in Medical Image Analysis16 Feb 2022
- 2022MEDFAIR: Benchmarking Fairness for Medical Imagingcited by 68
- 2022Guidelines and Evaluation of Clinical Explainable AI in Medical Image Analysiscited by 35
- 2022A Review of Causality for Learning Algorithms in Medical Image Analysiscited by 18
- 2023Improving Fairness in AI Models on Electronic Health Records: The Case for Federated Learning Methodscited by 17
- 2023A Review of the Role of Causality in Developing Trustworthy AI Systemscited by 14
- 2022Mitigating Health Disparities in EHR via Deconfoundercited by 7
- 2023Fairness Evaluation in Text Classification: Machine Learning Practitioner Perspectives of Individual and Group Fairnesscited by 7
- 2022Three Applications of Conformal Prediction for Rating Breast Density in Mammographycited by 6
- 2022Imputation Strategies Under Clinical Presence: Impact on Algorithmic Fairnesscited by 6
- 2022Enhancing Fairness of Visual Attribute Predictorscited by 3
- 2022A Survey on Preserving Fairness Guarantees in Changing Environmentscited by 2
- 2024Out-of-distribution Reject Option Method for Dataset Shift Problem in Early Disease Onset Predictioncited by 1
12 most cited of 20 All 20 (JSON)
- 2026Causal Transfer in Medical Image Analysis25 Mar 2026
- 2024Ethical considerations of use of hold-out sets in clinical prediction model management5 Jun 2024
- 2024Out-of-distribution Reject Option Method for Dataset Shift Problem in Early Disease Onset Prediction30 May 2024
- 2023Beyond Fairness: Age-Harmless Parkinson's Detection via Voice23 Sep 2023
- 2023Learning Unbiased Image Segmentation: A Case Study with Plain Knee Radiographs8 Aug 2023
- 2023Improving Fairness in AI Models on Electronic Health Records: The Case for Federated Learning Methods19 May 2023
- 2023Echoes of Biases: How Stigmatizing Language Affects AI Performance17 May 2023
- 2023Fairness Evaluation in Text Classification: Machine Learning Practitioner Perspectives of Individual and Group Fairness1 Mar 2023
- 2023A Review of the Role of Causality in Developing Trustworthy AI Systems14 Feb 2023
- 2022A Survey on Preserving Fairness Guarantees in Changing Environments14 Nov 2022
- 2022Mitigating Health Disparities in EHR via Deconfounder28 Oct 2022
- 2022MEDFAIR: Benchmarking Fairness for Medical Imaging4 Oct 2022
12 newest of 20 All 20 (JSON)