# Fairness in Cardiac MR Image Analysis: An Investigation of Bias Due to Data Imbalance in Deep Learning Based Segmentation

arXiv: https://arxiv.org/abs/2106.12387 · HTML: https://mlsanity.com/paper/2106.12387/

## Key facts

- Cited by 57 papers in the map (data through 14 Oct 2026).
- Builds on 11 of its 26 references that are in the map.
- First posted on arXiv 23 Jun 2021.

## Builds on (most cited first, 11 of 11)

- [Densely Connected Convolutional Networks](https://mlsanity.com/paper/1608.06993/) (2016)
- [Equality of Opportunity in Supervised Learning](https://mlsanity.com/paper/1610.02413/) (2016)
- [Mitigating Unwanted Biases with Adversarial Learning](https://mlsanity.com/paper/1801.07593/) (2018)
- [On Fairness and Calibration](https://mlsanity.com/paper/1709.02012/) (2017)
- [Towards Fairness in Visual Recognition: Effective Strategies for Bias Mitigation](https://mlsanity.com/paper/1911.11834/) (2019)
- [Gender Bias in Neural Natural Language Processing](https://mlsanity.com/paper/1807.11714/) (2018)
- [Mitigate Bias in Face Recognition using Skewness-Aware Reinforcement Learning](https://mlsanity.com/paper/1911.10692/) (2019)
- [Investigating Bias and Fairness in Facial Expression Recognition](https://mlsanity.com/paper/2007.10075/) (2020)
- [FairFaceGAN: Fairness-aware Facial Image-to-Image Translation](https://mlsanity.com/paper/2012.00282/) (2020)
- [Bias Remediation in Driver Drowsiness Detection systems using Generative Adversarial Networks](https://mlsanity.com/paper/1912.12123/) (2019)
- [Clinical trial of an AI-augmented intervention for HIV prevention in youth experiencing homelessness](https://mlsanity.com/paper/2009.09559/) (2020)

## Built on by (most cited first, 30 of 57)

- [FairCLIP: Harnessing Fairness in Vision-Language Learning](https://mlsanity.com/paper/2403.19949/) (2024)
- [Enhancing Pseudo Label Quality for Semi-Supervised Domain-Generalized Medical Image Segmentation](https://mlsanity.com/paper/2201.08657/) (2022)
- [FairMedFM: Fairness Benchmarking for Medical Imaging Foundation Models](https://mlsanity.com/paper/2407.00983/) (2024)
- [Learning Disentangled Representations in the Imaging Domain](https://mlsanity.com/paper/2108.12043/) (2021)
- [Semi-supervised Meta-learning with Disentanglement for Domain-generalised Medical Image Segmentation](https://mlsanity.com/paper/2106.13292/) (2021)
- [Addressing Fairness Issues in Deep Learning-Based Medical Image Analysis: A Systematic Review](https://mlsanity.com/paper/2209.13177/) (2022)
- [Improving anatomical plausibility in medical image segmentation via hybrid graph neural networks: applications to chest x-ray analysis](https://mlsanity.com/paper/2203.10977/) (2022)
- [FairDisCo: Fairer AI in Dermatology via Disentanglement Contrastive Learning](https://mlsanity.com/paper/2208.10013/) (2022)
- [Algorithm Fairness in AI for Medicine and Healthcare](https://mlsanity.com/paper/2110.00603/) (2021)
- [FairAdaBN: Mitigating unfairness with adaptive batch normalization and its application to dermatological disease classification](https://mlsanity.com/paper/2303.08325/) (2023)
- [CIRCLe: Color Invariant Representation Learning for Unbiased Classification of Skin Lesions](https://mlsanity.com/paper/2208.13528/) (2022)
- [Prompt Risk Control: A Rigorous Framework for Responsible Deployment of Large Language Models](https://mlsanity.com/paper/2311.13628/) (2023)
- [A Study of Demographic Bias in CNN-based Brain MR Segmentation](https://mlsanity.com/paper/2208.06613/) (2022)
- [Evaluating the Fairness of Deep Learning Uncertainty Estimates in Medical Image Analysis](https://mlsanity.com/paper/2303.03242/) (2023)
- [FUTURE-AI: Guiding Principles and Consensus Recommendations for Trustworthy Artificial Intelligence in Medical Imaging](https://mlsanity.com/paper/2109.09658/) (2021)
- [A systematic study of race and sex bias in CNN-based cardiac MR segmentation](https://mlsanity.com/paper/2209.01627/) (2022)
- [An investigation into the impact of deep learning model choice on sex and race bias in cardiac MR segmentation](https://mlsanity.com/paper/2308.13415/) (2023)
- [MedalCare-XL: 16,900 healthy and pathological 12 lead ECGs obtained through electrophysiological simulations](https://mlsanity.com/paper/2211.15997/) (2022)
- [BMFT: Achieving Fairness via Bias-based Weight Masking Fine-tuning](https://mlsanity.com/paper/2408.06890/) (2024)
- [Unveiling Fairness Biases in Deep Learning-Based Brain MRI Reconstruction](https://mlsanity.com/paper/2309.14392/) (2023)
- [Incorporating Rather Than Eliminating: Achieving Fairness for Skin Disease Diagnosis Through Group-Specific Expert](https://mlsanity.com/paper/2506.17787/) (2025)
- [Neurosymbolic AI for Reasoning on Biomedical Knowledge Graphs](https://mlsanity.com/paper/2307.08411/) (2023)
- [Towards objective and systematic evaluation of bias in artificial intelligence for medical imaging](https://mlsanity.com/paper/2311.02115/) (2023)
- [On Biases in a UK Biobank-based Retinal Image Classification Model](https://mlsanity.com/paper/2408.02676/) (2024)
- [FairREAD: Re-fusing Demographic Attributes after Disentanglement for Fair Medical Image Classification](https://mlsanity.com/paper/2412.16373/) (2024)
- [Debiased Noise Editing on Foundation Models for Fair Medical Image Classification](https://mlsanity.com/paper/2403.06104/) (2024)
- [FedSPU: Personalized Federated Learning for Resource-constrained Devices with Stochastic Parameter Update](https://mlsanity.com/paper/2403.11464/) (2024)
- [Investigating Demographic Bias in Brain MRI Segmentation: A Comparative Study of Deep-Learning and Non-Deep-Learning Methods](https://mlsanity.com/paper/2510.17999/) (2025)
- [APPLE: Adversarial Privacy-aware Perturbations on Latent Embedding for Unfairness Mitigation](https://mlsanity.com/paper/2403.05114/) (2024)
- [Open Challenges on Fairness of Artificial Intelligence in Medical Imaging Applications](https://mlsanity.com/paper/2407.16953/) (2024)

## Abstract (arXiv)

The subject of "fairness" in artificial intelligence (AI) refers to assessing AI algorithms for potential bias based on demographic characteristics such as race and gender, and the development of algorithms to address this bias. Most applications to date have been in computer vision, although some work in healthcare has started to emerge. The use of deep learning (DL) in cardiac MR segmentation has led to impressive results in recent years, and such techniques are starting to be translated into clinical practice. However, no work has yet investigated the fairness of such models. In this work, we perform such an analysis for racial/gender groups, focusing on the problem of training data imbalance, using a nnU-Net model trained and evaluated on cine short axis cardiac MR data from the UK Biobank dataset, consisting of 5,903 subjects from 6 different racial groups. We find statistically significant differences in Dice performance between different racial groups. To reduce the racial bias, we investigated three strategies: (1) stratified batch sampling, in which batch sampling is stratified to ensure balance between racial groups; (2) fair meta-learning for segmentation, in which a DL classifier is trained to classify race and jointly optimized with the segmentation model; and (3) protected group models, in which a different segmentation model is trained for each racial group. We also compared the results to the scenario where we have a perfectly balanced database. To assess fairness we used the standard deviation (SD) and skewed error ratio (SER) of the average Dice values. Our results demonstrate that the racial bias results from the use of imbalanced training data, and that all proposed bias mitigation strategies improved fairness, with the best SD and SER resulting from the use of protected group models.
