A survey of Identification and mitigation of Machine Learning algorithmic biases in Image Analysis
Not on the map. Why?
Abstract (arXiv)
The problem of algorithmic bias in machine learning has gained a lot of attention in recent years due to its concrete and potentially hazardous implications in society. In much the same manner, biases can also alter modern industrial and safety-critical applications where machine learning are based on high dimensional inputs such as images. This issue has however been mostly left out of the spotlight in the machine learning literature. Contrarily to societal applications where a set of proxy variables can be provided by the common sense or by regulations to draw the attention on potential risks, industrial and safety-critical applications are most of the times sailing blind. The variables related to undesired biases can indeed be indirectly represented in the input data, or can be unknown, thus making them harder to tackle. This raises serious and well-founded concerns towards the commercial deployment of AI-based solutions, especially in a context where new regulations clearly address the issues opened by undesired biases in AI. Consequently, we propose here to make an overview of recent advances in this area, firstly by presenting how such biases can demonstrate themselves, then by exploring different ways to bring them to light, and by probing different possibilities to mitigate them. We finally present a practical remote sensing use-case of industrial Fairness.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 75 of its 114 references that are in the map. First posted on arXiv 10 Oct 2022.
Builds on
75 of 114 references.
References · 75
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
- 2017mixup: Beyond Empirical Risk Minimizationcited by 5,155
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,040
- 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,427
- 2014Deep Learning Face Attributes in the Wildcited by 3,679
- 2016Equality of Opportunity in Supervised Learningcited by 2,000
38 more
- 2017EuroSAT: A Novel Dataset and Deep Learning Benchmark for Land Use and Land Cover Classificationcited by 1,488
- 2018A Simple Unified Framework for Detecting Out-of-Distribution Samples and Adversarial Attackscited by 1,472
- 2019CheXpert: A Large Chest Radiograph Dataset with Uncertainty Labels and Expert Comparisoncited by 1,410
- 2017Counterfactual Fairnesscited by 802
- 2014Certifying and removing disparate impactcited by 715
- 2016Fair prediction with disparate impact: A study of bias in recidivism prediction instrumentscited by 671
- 2018Mitigating Unwanted Biases with Adversarial Learningcited by 663
- 2019MIMIC-CXR-JPG, a large publicly available database of labeled chest radiographscited by 590
- 2018The Open Images Dataset V4: Unified image classification, object detection, and visual relationship detection at scalecited by 542
- 2017A systematic study of the class imbalance problem in convolutional neural networkscited by 510
- 2018Do Deep Generative Models Know What They Don't Know?cited by 443
- 2017On Fairness and Calibrationcited by 406
- 2016Fairness Beyond Disparate Treatment & Disparate Impact: Learning Classification without Disparate Mistreatmentcited by 368
- 2018Learning Models with Uniform Performance via Distributionally Robust Optimizationcited by 334
- 2017Certifying Some Distributional Robustness with Principled Adversarial Trainingcited by 333
- 2020An Investigation of Why Overparameterization Exacerbates Spurious Correlationscited by 310
- 2018Learning Not to Learn: Training Deep Neural Networks with Biased Datacited by 255
- 2016Understanding Deep Neural Networks with Rectified Linear Unitscited by 253
- 2020Deep Structural Causal Models for Tractable Counterfactual Inferencecited by 210
- 2020No Subclass Left Behind: Fine-Grained Robustness in Coarse-Grained Classification Problemscited by 208
- 2019Flexibly Fair Representation Learning by Disentanglementcited by 196
- 2020Fairness in Machine Learningcited by 194
- 2019Domain Generalization Using a Mixture of Multiple Latent Domainscited by 170
- 2021Reading Race: AI Recognises Patient's Racial Identity In Medical Imagescited by 155
- 2017No Classification without Representation: Assessing Geodiversity Issues in Open Data Sets for the Developing Worldcited by 152
- 2019On the Fairness of Disentangled Representationscited by 144
- 2017What do we need to build explainable AI systems for the medical domain?cited by 127
- 2020Fair Attribute Classification through Latent Space De-biasingcited by 125
- 2021Learning Debiased Representation via Disentangled Feature Augmentationcited by 116
- 2021A Clarification of the Nuances in the Fairness Metrics Landscapecited by 98
- 2020Don't Judge an Object by Its Context: Learning to Overcome Contextual Biascited by 91
- 2020Saving Face: Investigating the Ethical Concerns of Facial Recognition Auditingcited by 89
- 2020Investigating Bias and Fairness in Facial Expression Recognitioncited by 87
- 2020Model Patching: Closing the Subgroup Performance Gap with Data Augmentationcited by 82
- 2019Diversity in Facescited by 77
- 2020Fairness by Learning Orthogonal Disentangled Representationscited by 76
- 2019Image Counterfactual Sensitivity Analysis for Detecting Unintended Biascited by 74
- 2021Look at the Variance! Efficient Black-box Explanations with Sobol-based Sensitivity Analysiscited by 65
50 most cited of 75 All 75 (JSON)
Built on by
Citing papers per year: 2023: 2; 2024: 1.
3 papers.