mlsanityData to 7 Oct 2026

A survey of Identification and mitigation of Machine Learning algorithmic biases in Image Analysis

arXiv 2210.04491 ↗First posted 10 Oct 2022cs.LG stat.MLcited by 3

Not on the map. Why?

Abstract (arXiv)

The problem of algorithmic bias in machine learning has gained a lot of attention in recent years due to its concrete and potentially hazardous implications in society. In much the same manner, biases can also alter modern industrial and safety-critical applications where machine learning are based on high dimensional inputs such as images. This issue has however been mostly left out of the spotlight in the machine learning literature. Contrarily to societal applications where a set of proxy variables can be provided by the common sense or by regulations to draw the attention on potential risks, industrial and safety-critical applications are most of the times sailing blind. The variables related to undesired biases can indeed be indirectly represented in the input data, or can be unknown, thus making them harder to tackle. This raises serious and well-founded concerns towards the commercial deployment of AI-based solutions, especially in a context where new regulations clearly address the issues opened by undesired biases in AI. Consequently, we propose here to make an overview of recent advances in this area, firstly by presenting how such biases can demonstrate themselves, then by exploring different ways to bring them to light, and by probing different possibilities to mitigate them. We finally present a practical remote sensing use-case of industrial Fairness.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 75 of its 114 references that are in the map. First posted on arXiv 10 Oct 2022.

Builds on

75 of 114 references.

References · 75

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  3. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  4. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  5. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
  6. 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
  7. 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
  8. 2017mixup: Beyond Empirical Risk Minimizationcited by 5,155
  9. 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,040
  10. 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,427
  11. 2014Deep Learning Face Attributes in the Wildcited by 3,679
  12. 2016Equality of Opportunity in Supervised Learningcited by 2,000
38 more
  1. 2017EuroSAT: A Novel Dataset and Deep Learning Benchmark for Land Use and Land Cover Classificationcited by 1,488
  2. 2018A Simple Unified Framework for Detecting Out-of-Distribution Samples and Adversarial Attackscited by 1,472
  3. 2019CheXpert: A Large Chest Radiograph Dataset with Uncertainty Labels and Expert Comparisoncited by 1,410
  4. 2017Counterfactual Fairnesscited by 802
  5. 2014Certifying and removing disparate impactcited by 715
  6. 2016Fair prediction with disparate impact: A study of bias in recidivism prediction instrumentscited by 671
  7. 2018Mitigating Unwanted Biases with Adversarial Learningcited by 663
  8. 2019MIMIC-CXR-JPG, a large publicly available database of labeled chest radiographscited by 590
  9. 2018The Open Images Dataset V4: Unified image classification, object detection, and visual relationship detection at scalecited by 542
  10. 2017A systematic study of the class imbalance problem in convolutional neural networkscited by 510
  11. 2018Do Deep Generative Models Know What They Don't Know?cited by 443
  12. 2017On Fairness and Calibrationcited by 406
  13. 2016Fairness Beyond Disparate Treatment & Disparate Impact: Learning Classification without Disparate Mistreatmentcited by 368
  14. 2018Learning Models with Uniform Performance via Distributionally Robust Optimizationcited by 334
  15. 2017Certifying Some Distributional Robustness with Principled Adversarial Trainingcited by 333
  16. 2020An Investigation of Why Overparameterization Exacerbates Spurious Correlationscited by 310
  17. 2018Learning Not to Learn: Training Deep Neural Networks with Biased Datacited by 255
  18. 2016Understanding Deep Neural Networks with Rectified Linear Unitscited by 253
  19. 2020Deep Structural Causal Models for Tractable Counterfactual Inferencecited by 210
  20. 2020No Subclass Left Behind: Fine-Grained Robustness in Coarse-Grained Classification Problemscited by 208
  21. 2019Flexibly Fair Representation Learning by Disentanglementcited by 196
  22. 2020Fairness in Machine Learningcited by 194
  23. 2019Domain Generalization Using a Mixture of Multiple Latent Domainscited by 170
  24. 2021Reading Race: AI Recognises Patient's Racial Identity In Medical Imagescited by 155
  25. 2017No Classification without Representation: Assessing Geodiversity Issues in Open Data Sets for the Developing Worldcited by 152
  26. 2019On the Fairness of Disentangled Representationscited by 144
  27. 2017What do we need to build explainable AI systems for the medical domain?cited by 127
  28. 2020Fair Attribute Classification through Latent Space De-biasingcited by 125
  29. 2021Learning Debiased Representation via Disentangled Feature Augmentationcited by 116
  30. 2021A Clarification of the Nuances in the Fairness Metrics Landscapecited by 98
  31. 2020Don't Judge an Object by Its Context: Learning to Overcome Contextual Biascited by 91
  32. 2020Saving Face: Investigating the Ethical Concerns of Facial Recognition Auditingcited by 89
  33. 2020Investigating Bias and Fairness in Facial Expression Recognitioncited by 87
  34. 2020Model Patching: Closing the Subgroup Performance Gap with Data Augmentationcited by 82
  35. 2019Diversity in Facescited by 77
  36. 2020Fairness by Learning Orthogonal Disentangled Representationscited by 76
  37. 2019Image Counterfactual Sensitivity Analysis for Detecting Unintended Biascited by 74
  38. 2021Look at the Variance! Efficient Black-box Explanations with Sobol-based Sensitivity Analysiscited by 65

50 most cited of 75 All 75 (JSON)

Built on by

Cited by year

Citing papers per year: 2023: 2; 2024: 1.

3 papers.