Towards Fairness in Visual Recognition: Effective Strategies for Bias Mitigation
Not on the map. Why?
Abstract (arXiv)
Computer vision models learn to perform a task by capturing relevant statistics from training data. It has been shown that models learn spurious age, gender, and race correlations when trained for seemingly unrelated tasks like activity recognition or image captioning. Various mitigation techniques have been presented to prevent models from utilizing or learning such biases. However, there has been little systematic comparison between these techniques. We design a simple but surprisingly effective visual recognition benchmark for studying bias mitigation. Using this benchmark, we provide a thorough analysis of a wide range of techniques. We highlight the shortcomings of popular adversarial training approaches for bias mitigation, propose a simple but similarly effective alternative to the inference-time Reducing Bias Amplification method of Zhao et al., and design a domain-independent training technique that outperforms all other methods. Finally, we validate our findings on the attribute classification task in the CelebA dataset, where attribute presence is known to be correlated with the gender of people in the image, and demonstrate that the proposed technique is effective at mitigating real-world gender bias.
Key facts. Cited by 252 papers in the map (data through 14 Oct 2026). First posted on arXiv 26 Nov 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 41; 2022: 55; 2023: 61; 2024: 46; 2025: 37; 2026: 12.
252 papers.
Sort:
By area:
- 2023Scaling Vision Transformers to 22 Billion Parameterscited by 694
- 2022A Survey of Machine Unlearningcited by 312
- 2023PaLI-X: On Scaling up a Multilingual Vision and Language Modelcited by 255
- 2021A Unified Survey on Anomaly, Novelty, Open-Set, and Out-of-Distribution Detection: Solutions and Future Challengescited by 154
- 2023Debiasing Vision-Language Models via Biased Promptscited by 149
- 2021Counterfactual Generative Networkscited by 111
- 2021EnD: Entangling and Disentangling deep representations for bias correctioncited by 105
- 2021Trustworthy AI: A Computational Perspectivecited by 93
- 2021OoD-Bench: Quantifying and Understanding Two Dimensions of Out-of-Distribution Generalizationcited by 86
- 2022A Whac-A-Mole Dilemma: Shortcuts Come in Multiples Where Mitigating One Amplifies Otherscited by 85
- 2022Fair Contrastive Learning for Facial Attribute Classificationcited by 71
- 2024FairCLIP: Harnessing Fairness in Vision-Language Learningcited by 69
38 more
- 2022MEDFAIR: Benchmarking Fairness for Medical Imagingcited by 68
- 2023ITI-GEN: Inclusive Text-to-Image Generationcited by 64
- 2022Handling Bias in Toxic Speech Detection: A Surveycited by 61
- 2024OpenBias: Open-set Bias Detection in Text-to-Image Generative Modelscited by 61
- 2021Fair Feature Distillation for Visual Recognitioncited by 59
- 2022FairPrune: Achieving Fairness Through Pruning for Dermatological Disease Diagnosiscited by 59
- 2021Fairness in Cardiac MR Image Analysis: An Investigation of Bias Due to Data Imbalance in Deep Learning Based Segmentationcited by 57
- 2022Leveling Down in Computer Vision: Pareto Inefficiencies in Fair Deep Classifierscited by 53
- 2023SocialCounterfactuals: Probing and Mitigating Intersectional Social Biases in Vision-Language Models with Counterfactual Examplescited by 53
- 2023TIBET: Identifying and Evaluating Biases in Text-to-Image Generative Modelscited by 52
- 2021Understanding and Mitigating Annotation Bias in Facial Expression Recognitioncited by 50
- 2022Discover and Mitigate Unknown Biases with Debiasing Alternate Networkscited by 47
- 2024A Decade's Battle on Dataset Bias: Are We There Yet?cited by 47
- 2024FairMedFM: Fairness Benchmarking for Medical Imaging Foundation Modelscited by 47
- 2021Discover the Unknown Biased Attribute of an Image Classifiercited by 46
- 2022A Causal Lens for Controllable Text Generationcited by 45
- 2022Diagnosing failures of fairness transfer across distribution shift in real-world medical settingscited by 45
- 2021NeuronFair: Interpretable White-Box Fairness Testing through Biased Neuron Identificationcited by 42
- 2022Unbiased Supervised Contrastive Learningcited by 40
- 2022Gender Artifacts in Visual Datasetscited by 38
- 2022Quantifying Societal Bias Amplification in Image Captioningcited by 37
- 2022Studying Bias in GANs through the Lens of Racecited by 31
- 2022FairGRAPE: Fairness-aware GRAdient Pruning mEthod for Face Attribute Classificationcited by 30
- 2022Bias Mimicking: A Simple Sampling Approach for Bias Mitigationcited by 30
- 2022Rethinking Bias Mitigation: Fairer Architectures Make for Fairer Face Recognitioncited by 26
- 2023Survey of Social Bias in Vision-Language Modelscited by 26
- 2024Depth Prompting for Sensor-Agnostic Depth Estimationcited by 26
- 2022Bayes-Optimal Classifiers under Group Fairnesscited by 24
- 2021UDIS: Unsupervised Discovery of Bias in Deep Visual Recognition Modelscited by 23
- 2023FairTune: Optimizing Parameter Efficient Fine Tuning for Fairness in Medical Image Analysiscited by 23
- 2021Responsible AI: Gender bias assessment in emotion recognitioncited by 22
- 2021Rethinking Common Assumptions to Mitigate Racial Bias in Face Recognition Datasetscited by 22
- 2022FairDisCo: Fairer AI in Dermatology via Disentanglement Contrastive Learningcited by 22
- 2023Consensus and Subjectivity of Skin Tone Annotation for ML Fairnesscited by 22
- 2022Men Also Do Laundry: Multi-Attribute Bias Amplificationcited by 21
- 2021Technical Challenges for Training Fair Neural Networkscited by 20
- 2024Fairness and Bias in Multimodal AI: A Surveycited by 20
- 2021Domain-Incremental Continual Learning for Mitigating Bias in Facial Expression and Action Unit Recognitioncited by 19
50 most cited of 252 All 252 (JSON)
- 2026Random Label Prediction Heads for Studying Memorization in Deep Neural Networks13 Jul 2026
- 2026Bridging Geographic Bias in Urban Streetscape Inference via Lifelong Learning with Visual-Semantic Pivoting13 Jun 2026
- 2026Fair Dataset Distillation via Cross-Group Barycenter Alignment30 Apr 2026
- 2026Evaluating the Impact of Medical Image Reconstruction on Downstream AI Fairness and Performance13 Apr 2026
- 2026Investigating Bias and Fairness in Appearance-based Gaze Estimation12 Apr 2026
- 2026Bias In, Bias Out? Finding Unbiased Subnetworks in Vanilla Models5 Mar 2026
- 2026Beyond performance-wise Contribution Evaluation in Federated Learning25 Feb 2026
- 2026Rank-Constrained Adaptation for Reliable Real-World Performance6 Feb 2026
- 2026SHaSaM: Submodular Hard Sample Mining for Fair Facial Attribute Recognition5 Feb 2026
- 2026Benchmarking Bias Mitigation Toward Fairness Without Harm from Vision to LVLMs3 Feb 2026
- 2026Happy Young Women, Grumpy Old Men? Emotion-Driven Demographic Biases in Synthetic Face Generation18 Jan 2026
- 2026Aesthetics as Structural Harm: Algorithmic Lookism Across Text-to-Image Generation and Classification15 Jan 2026
38 more
- 2025A Comprehensive Study of Deep Learning Model Fixing Approaches26 Dec 2025
- 2025Beyond Memorization: A Multi-Modal Ordinal Regression Benchmark to Expose Popularity Bias in Vision-Language Models24 Dec 2025
- 2025OxEnsemble: Fair Ensembles for Low-Data Classification10 Dec 2025
- 2025Context-Enriched Contrastive Loss: Enhancing Presentation of Inherent Sample Connections in Contrastive Learning Framework1 Dec 2025
- 2025Preventing Shortcut Learning in Medical Image Analysis through Intermediate Layer Knowledge Distillation from Specialist Teachers21 Nov 2025
- 2025Harnessing Diffusion-Generated Synthetic Images for Fair Image Classification11 Nov 2025
- 2025Understanding Fairness and Prediction Error through Subspace Decomposition and Influence Analysis27 Oct 2025
- 2025Explainable Human-in-the-Loop Segmentation via Critic Feedback Signals11 Oct 2025
- 2025Real, Fake, or Manipulated? Detecting Machine-Influenced Text18 Sep 2025
- 2025Discovering Divergent Representations between Text-to-Image Models10 Sep 2025
- 2025Bias-Aware Machine Unlearning: Towards Fairer Vision Models via Controllable Forgetting9 Sep 2025
- 2025GANDiff FR: Hybrid GAN Diffusion Synthesis for Causal Bias Attribution in Face Recognition15 Aug 2025
- 2025Processing and acquisition traces in visual encoders: What does CLIP know about your camera?14 Aug 2025
- 2025VB-Mitigator: An Open-source Framework for Evaluating and Advancing Visual Bias Mitigation24 Jul 2025
- 2025Forget Me Not: Fighting Local Overfitting with Knowledge Fusion and Distillation11 Jul 2025
- 2025Incorporating Rather Than Eliminating: Achieving Fairness for Skin Disease Diagnosis Through Group-Specific Expert21 Jun 2025
- 2025BiMa: Towards Biases Mitigation for Text-Video Retrieval via Scene Element Guidance4 Jun 2025
- 2025Balancing Beyond Discrete Categories: Continuous Demographic Labels for Fair Face Recognition2 Jun 2025
- 2025Subgroups Matter for Robust Bias Mitigation27 May 2025
- 2025Mitigate One, Skew Another? Tackling Intersectional Biases in Text-to-Image Models22 May 2025
- 2025MedCFVQA: A Causal Approach to Mitigate Modality Preference Bias in Medical Visual Question Answering22 May 2025
- 2025When Algorithms Play Favorites: Lookism in the Generation and Perception of Faces20 May 2025
- 2025Improving Fairness in LLMs Through Testing-Time Adversaries17 May 2025
- 2025Identities are not Interchangeable: The Problem of Overgeneralization in Fair Machine Learning7 May 2025
- 2025Component-Based Fairness in Face Attribute Classification with Bayesian Network-informed Meta Learning3 May 2025
- 2025Active Data Sampling and Generation for Bias Remediation26 Mar 2025
- 2025Attention IoU: Examining Biases in CelebA using Attention Maps25 Mar 2025
- 2025On the Origins of Sampling Bias: Implications on Fairness Measurement and Mitigation23 Mar 2025
- 2025A Deep Learning Framework for Visual Attention Prediction and Analysis of News Interfaces21 Mar 2025
- 2025A Multi-Objective Evaluation Framework for Analyzing Utility-Fairness Trade-Offs in Machine Learning Systems14 Mar 2025
- 2025EquiPy: Sequential Fairness using Optimal Transport in Python12 Mar 2025
- 2025BiasConnect: Investigating Bias Interactions in Text-to-Image Models12 Mar 2025
- 2025Project-Probe-Aggregate: Efficient Fine-Tuning for Group Robustness12 Mar 2025
- 2025AIM-Fair: Advancing Algorithmic Fairness via Selectively Fine-Tuning Biased Models with Contextual Synthetic Data7 Mar 2025
- 2025Beyond Visual Perception: Insights from Smartphone Interaction of Visually Impaired Users with Large Multimodal Models22 Feb 2025
- 2025Detecting Systematic Weaknesses in Vision Models along Predefined Human-Understandable Dimensions17 Feb 2025
- 2025A Critical Review of Predominant Bias in Neural Networks16 Feb 2025
- 2024On Demographic Group Fairness Guarantees in Deep Learning29 Dec 2024
50 newest of 252 All 252 (JSON)
- 2023Debiasing Vision-Language Models via Biased Promptscited by 149
- 2023SocialCounterfactuals: Probing and Mitigating Intersectional Social Biases in Vision-Language Models with Counterfactual Examplescited by 53
- 2023Survey of Social Bias in Vision-Language Modelscited by 26
- 2024Fairness and Bias in Multimodal AI: A Surveycited by 20
- 2025Beyond Visual Perception: Insights from Smartphone Interaction of Visually Impaired Users with Large Multimodal Modelscited by 13
- 2025BiMa: Towards Biases Mitigation for Text-Video Retrieval via Scene Element Guidancecited by 2
- 2025Beyond Memorization: A Multi-Modal Ordinal Regression Benchmark to Expose Popularity Bias in Vision-Language Modelscited by 1
- 2025Beyond Memorization: A Multi-Modal Ordinal Regression Benchmark to Expose Popularity Bias in Vision-Language Models24 Dec 2025
- 2025BiMa: Towards Biases Mitigation for Text-Video Retrieval via Scene Element Guidance4 Jun 2025
- 2025Beyond Visual Perception: Insights from Smartphone Interaction of Visually Impaired Users with Large Multimodal Models22 Feb 2025
- 2024Fairness and Bias in Multimodal AI: A Survey27 Jun 2024
- 2023SocialCounterfactuals: Probing and Mitigating Intersectional Social Biases in Vision-Language Models with Counterfactual Examples30 Nov 2023
- 2023Survey of Social Bias in Vision-Language Models24 Sep 2023
- 2023Debiasing Vision-Language Models via Biased Prompts31 Jan 2023
- 2021Fair Feature Distillation for Visual Recognitioncited by 59
- 2021Simon Says: Evaluating and Mitigating Bias in Pruned Neural Networks with Knowledge Distillationcited by 15
- 2024What is Left After Distillation? How Knowledge Transfer Impacts Fairness and Biascited by 4
- 2025Preventing Shortcut Learning in Medical Image Analysis through Intermediate Layer Knowledge Distillation from Specialist Teacherscited by 4
- 2021Fair Visual Recognition in Limited Data Regime using Self-Supervision and Self-Distillationcited by 2
- 2025Preventing Shortcut Learning in Medical Image Analysis through Intermediate Layer Knowledge Distillation from Specialist Teachers21 Nov 2025
- 2024What is Left After Distillation? How Knowledge Transfer Impacts Fairness and Bias10 Oct 2024
- 2021Fair Visual Recognition in Limited Data Regime using Self-Supervision and Self-Distillation30 Jun 2021
- 2021Simon Says: Evaluating and Mitigating Bias in Pruned Neural Networks with Knowledge Distillation15 Jun 2021
- 2021Fair Feature Distillation for Visual Recognition27 May 2021
- 2022A Survey of Machine Unlearningcited by 312
- 2022Efficient Attribute Unlearning: Towards Selective Removal of Input Attributes from Feature Representationscited by 17
- 2023When Fairness Meets Privacy: Exploring Privacy Threats in Fair Binary Classifiers via Membership Inference Attackscited by 5
- 2025Bias-Aware Machine Unlearning: Towards Fairer Vision Models via Controllable Forgettingcited by 0
- 2025Bias-Aware Machine Unlearning: Towards Fairer Vision Models via Controllable Forgetting9 Sep 2025
- 2023When Fairness Meets Privacy: Exploring Privacy Threats in Fair Binary Classifiers via Membership Inference Attacks7 Nov 2023
- 2022A Survey of Machine Unlearning6 Sep 2022
- 2022Efficient Attribute Unlearning: Towards Selective Removal of Input Attributes from Feature Representations27 Feb 2022
- 2024Fairness-Aware Data Augmentation for Cardiac MRI using Text-Conditioned Diffusion Modelscited by 7
- 2025AIM-Fair: Advancing Algorithmic Fairness via Selectively Fine-Tuning Biased Models with Contextual Synthetic Datacited by 5
- 2025Harnessing Diffusion-Generated Synthetic Images for Fair Image Classificationcited by 1
- 2025Harnessing Diffusion-Generated Synthetic Images for Fair Image Classification11 Nov 2025
- 2025AIM-Fair: Advancing Algorithmic Fairness via Selectively Fine-Tuning Biased Models with Contextual Synthetic Data7 Mar 2025
- 2024Fairness-Aware Data Augmentation for Cardiac MRI using Text-Conditioned Diffusion Models28 Mar 2024
- 2023Scaling Vision Transformers to 22 Billion Parameterscited by 694
- 2023PaLI-X: On Scaling up a Multilingual Vision and Language Modelcited by 255
- 2021A Unified Survey on Anomaly, Novelty, Open-Set, and Out-of-Distribution Detection: Solutions and Future Challengescited by 154
- 2021Counterfactual Generative Networkscited by 111
- 2021EnD: Entangling and Disentangling deep representations for bias correctioncited by 105
- 2021Trustworthy AI: A Computational Perspectivecited by 93
- 2021OoD-Bench: Quantifying and Understanding Two Dimensions of Out-of-Distribution Generalizationcited by 86
- 2022A Whac-A-Mole Dilemma: Shortcuts Come in Multiples Where Mitigating One Amplifies Otherscited by 85
- 2022Fair Contrastive Learning for Facial Attribute Classificationcited by 71
- 2024FairCLIP: Harnessing Fairness in Vision-Language Learningcited by 69
- 2022MEDFAIR: Benchmarking Fairness for Medical Imagingcited by 68
- 2023ITI-GEN: Inclusive Text-to-Image Generationcited by 64
12 most cited of 232 All 232 (JSON)
- 2026Random Label Prediction Heads for Studying Memorization in Deep Neural Networks13 Jul 2026
- 2026Bridging Geographic Bias in Urban Streetscape Inference via Lifelong Learning with Visual-Semantic Pivoting13 Jun 2026
- 2026Fair Dataset Distillation via Cross-Group Barycenter Alignment30 Apr 2026
- 2026Evaluating the Impact of Medical Image Reconstruction on Downstream AI Fairness and Performance13 Apr 2026
- 2026Investigating Bias and Fairness in Appearance-based Gaze Estimation12 Apr 2026
- 2026Bias In, Bias Out? Finding Unbiased Subnetworks in Vanilla Models5 Mar 2026
- 2026Beyond performance-wise Contribution Evaluation in Federated Learning25 Feb 2026
- 2026Rank-Constrained Adaptation for Reliable Real-World Performance6 Feb 2026
- 2026SHaSaM: Submodular Hard Sample Mining for Fair Facial Attribute Recognition5 Feb 2026
- 2026Benchmarking Bias Mitigation Toward Fairness Without Harm from Vision to LVLMs3 Feb 2026
- 2026Happy Young Women, Grumpy Old Men? Emotion-Driven Demographic Biases in Synthetic Face Generation18 Jan 2026
- 2026Aesthetics as Structural Harm: Algorithmic Lookism Across Text-to-Image Generation and Classification15 Jan 2026
12 newest of 232 All 232 (JSON)