Debiasing Methods for Fairer Neural Models in Vision and Language Research: A Survey
Not on the map. Why?
Abstract (arXiv)
Despite being responsible for state-of-the-art results in several computer vision and natural language processing tasks, neural networks have faced harsh criticism due to some of their current shortcomings. One of them is that neural networks are correlation machines prone to model biases within the data instead of focusing on actual useful causal relationships. This problem is particularly serious in application domains affected by aspects such as race, gender, and age. To prevent models from incurring on unfair decision-making, the AI community has concentrated efforts in correcting algorithmic biases, giving rise to the research area now widely known as fairness in AI. In this survey paper, we provide an in-depth overview of the main debiasing methods for fairness-aware neural networks in the context of vision and language research. We propose a novel taxonomy to better organize the literature on debiasing methods for fairness, and we discuss the current challenges, trends, and important future work directions for the interested researcher and practitioner.
Key facts. Cited by 22 papers in the map (data through 7 Oct 2026). Builds on 154 of its 233 references that are in the map. First posted on arXiv 10 Nov 2022.
Builds on
154 of 233 references.
References · 154
- 2017Attention Is All You Needcited by 59,932
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2015Distilling the Knowledge in a Neural Networkcited by 10,076
- 2014ImageNet Large Scale Visual Recognition Challengecited by 8,441
- 2014Explaining and Harnessing Adversarial Examplescited by 7,287
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
- 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,346
- 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,243
- 2021On the Opportunities and Risks of Foundation Modelscited by 3,961
38 more
- 2014Deep Learning Face Attributes in the Wildcited by 3,679
- 2022OPT: Open Pre-trained Transformer Language Modelscited by 3,464
- 2019A Survey on Bias and Fairness in Machine Learningcited by 1,911
- 2018Datasheets for Datasetscited by 1,371
- 2016Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddingscited by 1,304
- 2020RealToxicityPrompts: Evaluating Neural Toxic Degeneration in Language Modelscited by 1,235
- 2018Model Cards for Model Reportingcited by 1,068
- 2018A Survey Of Methods For Explaining Black Box Modelscited by 970
- 2020Language (Technology) is Power: A Critical Survey of "Bias" in NLPcited by 951
- 2018Challenging Common Assumptions in the Unsupervised Learning of Disentangled Representationscited by 929
- 2020StereoSet: Measuring stereotypical bias in pretrained language modelscited by 911
- 2016Semantics derived automatically from language corpora contain human-like biasescited by 894
- 2017Counterfactual Fairnesscited by 802
- 2022GPT-NeoX-20B: An Open-Source Autoregressive Language Modelcited by 711
- 2019Universal Adversarial Triggers for Attacking and Analyzing NLPcited by 709
- 2020CrowS-Pairs: A Challenge Dataset for Measuring Social Biases in Masked Language Modelscited by 703
- 2016Fair prediction with disparate impact: A study of bias in recidivism prediction instrumentscited by 671
- 2018Mitigating Unwanted Biases with Adversarial Learningcited by 663
- 2021Prompt Programming for Large Language Models: Beyond the Few-Shot Paradigmcited by 599
- 2017Men Also Like Shopping: Reducing Gender Bias Amplification using Corpus-level Constraintscited by 420
- 2019On Measuring Social Biases in Sentence Encoderscited by 397
- 2020Multi-Task Learning with Deep Neural Networks: A Surveycited by 374
- 2020Fairness in Machine Learning: A Surveycited by 369
- 2019Bias in Bios: A Case Study of Semantic Representation Bias in a High-Stakes Settingcited by 346
- 2021Self-Diagnosis and Self-Debiasing: A Proposal for Reducing Corpus-Based Bias in NLPcited by 336
- 2018Towards a Definition of Disentangled Representationscited by 294
- 2021Towards Understanding and Mitigating Social Biases in Language Modelscited by 294
- 2019Measuring Bias in Contextualized Word Representationscited by 275
- 2020Counterfactual VQA: A Cause-Effect Look at Language Biascited by 266
- 2018Improving fairness in machine learning systems: What do industry practitioners need?cited by 262
- 2018Learning Not to Learn: Training Deep Neural Networks with Biased Datacited by 255
- 2018Women also Snowboard: Overcoming Bias in Captioning Modelscited by 236
- 2022DALL-Eval: Probing the Reasoning Skills and Social Biases of Text-to-Image Generation Modelscited by 230
- 2019Pareto Multi-Task Learningcited by 224
- 2020Measuring and Reducing Gendered Correlations in Pre-trained Modelscited by 222
- 2019Identifying and Reducing Gender Bias in Word-Level Language Modelscited by 214
- 2018Gender Bias in Neural Natural Language Processingcited by 210
- 2019The What-If Tool: Interactive Probing of Machine Learning Modelscited by 207
50 most cited of 154 All 154 (JSON)
Built on by
Citing papers per year: 2024: 10; 2025: 6; 2026: 6.
22 papers.
Sort:
By area:
- 2024Evaluating Fairness in Large Vision-Language Models Across Diverse Demographic Attributes and Promptscited by 15
- 2024Verifiable evaluations of machine learning models using zkSNARKscited by 14
- 2024The Pursuit of Fairness in Artificial Intelligence Models: A Surveycited by 13
- 2024Fairness and Bias Mitigation in Computer Vision: A Surveycited by 12
- 2024Unveiling and Mitigating Generalized Biases of DNNs through the Intrinsic Dimensions of Perceptual Manifoldscited by 6
- 2024SDFD: Building a Versatile Synthetic Face Image Dataset with Diverse Attributescited by 6
- 2025Fair-MoE: Fairness-Oriented Mixture of Experts in Vision-Language Modelscited by 6
- 2025A Survey on fMRI-based Brain Decoding for Reconstructing Multimodal Stimulicited by 6
- 2024Mitigating Bias Using Model-Agnostic Data Attributioncited by 3
- 2025Attention IoU: Examining Biases in CelebA using Attention Mapscited by 3
- 2025MoENAS: Mixture-of-Expert based Neural Architecture Search for jointly Accurate, Fair, and Robust Edge Deep Neural Networkscited by 2
- 2026Inference-Time Machine Unlearning via Gated Activation Redirectioncited by 2
10 more
- 2024Social Science Is Necessary for Operationalizing Socially Responsible Foundation Modelscited by 1
- 2025Inference Time Debiasing Concepts in Diffusion Modelscited by 1
- 2026Happy Young Women, Grumpy Old Men? Emotion-Driven Demographic Biases in Synthetic Face Generationcited by 1
- 2026HoloFair: Unified T2I Fairness Evaluation and Fair-GRPO Debiasingcited by 1
- 2024Balancing the Scales: Enhancing Fairness in Facial Expression Recognition with Latent Alignmentcited by 0
- 2024TransFair: Transferring Fairness from Ocular Disease Classification to Progression Predictioncited by 0
- 2025A Framework for Benchmarking Fairness-Utility Trade-offs in Text-to-Image Models via Pareto Frontierscited by 0
- 2026Responsible AI for General-Purpose Systems: Overview, Challenges, and A Path Forwardcited by 0
- 2026FairLLaVA: Fairness-Aware Parameter-Efficient Fine-Tuning for Large Vision-Language Assistantscited by 0
- 2026Benchmarking Fairness in Spiking Neural Networks: Data Bias, Spurious Features, and Hardware Effectscited by 0
- 2026HoloFair: Unified T2I Fairness Evaluation and Fair-GRPO Debiasing23 May 2026
- 2026Inference-Time Machine Unlearning via Gated Activation Redirection12 May 2026
- 2026Benchmarking Fairness in Spiking Neural Networks: Data Bias, Spurious Features, and Hardware Effects8 May 2026
- 2026FairLLaVA: Fairness-Aware Parameter-Efficient Fine-Tuning for Large Vision-Language Assistants27 Mar 2026
- 2026Responsible AI for General-Purpose Systems: Overview, Challenges, and A Path Forward19 Jan 2026
- 2026Happy Young Women, Grumpy Old Men? Emotion-Driven Demographic Biases in Synthetic Face Generation18 Jan 2026
- 2025A Framework for Benchmarking Fairness-Utility Trade-offs in Text-to-Image Models via Pareto Frontiers22 Aug 2025
- 2025Inference Time Debiasing Concepts in Diffusion Models19 Aug 2025
- 2025Attention IoU: Examining Biases in CelebA using Attention Maps25 Mar 2025
- 2025A Survey on fMRI-based Brain Decoding for Reconstructing Multimodal Stimuli20 Mar 2025
- 2025MoENAS: Mixture-of-Expert based Neural Architecture Search for jointly Accurate, Fair, and Robust Edge Deep Neural Networks11 Feb 2025
- 2025Fair-MoE: Fairness-Oriented Mixture of Experts in Vision-Language Models10 Feb 2025
10 more
- 2024Social Science Is Necessary for Operationalizing Socially Responsible Foundation Models20 Dec 2024
- 2024TransFair: Transferring Fairness from Ocular Disease Classification to Progression Prediction24 Nov 2024
- 2024Balancing the Scales: Enhancing Fairness in Facial Expression Recognition with Latent Alignment25 Oct 2024
- 2024Fairness and Bias Mitigation in Computer Vision: A Survey5 Aug 2024
- 2024Evaluating Fairness in Large Vision-Language Models Across Diverse Demographic Attributes and Prompts25 Jun 2024
- 2024Mitigating Bias Using Model-Agnostic Data Attribution8 May 2024
- 2024SDFD: Building a Versatile Synthetic Face Image Dataset with Diverse Attributes26 Apr 2024
- 2024Unveiling and Mitigating Generalized Biases of DNNs through the Intrinsic Dimensions of Perceptual Manifolds22 Apr 2024
- 2024The Pursuit of Fairness in Artificial Intelligence Models: A Survey26 Mar 2024
- 2024Verifiable evaluations of machine learning models using zkSNARKs5 Feb 2024
- 2024Evaluating Fairness in Large Vision-Language Models Across Diverse Demographic Attributes and Promptscited by 15
- 2025Fair-MoE: Fairness-Oriented Mixture of Experts in Vision-Language Modelscited by 6
- 2026FairLLaVA: Fairness-Aware Parameter-Efficient Fine-Tuning for Large Vision-Language Assistantscited by 0
- 2026FairLLaVA: Fairness-Aware Parameter-Efficient Fine-Tuning for Large Vision-Language Assistants27 Mar 2026
- 2025Fair-MoE: Fairness-Oriented Mixture of Experts in Vision-Language Models10 Feb 2025
- 2024Evaluating Fairness in Large Vision-Language Models Across Diverse Demographic Attributes and Prompts25 Jun 2024
- 2025Inference Time Debiasing Concepts in Diffusion Modelscited by 1
- 2025Inference Time Debiasing Concepts in Diffusion Models19 Aug 2025
- 2024Verifiable evaluations of machine learning models using zkSNARKscited by 14
- 2024The Pursuit of Fairness in Artificial Intelligence Models: A Surveycited by 13
- 2024Fairness and Bias Mitigation in Computer Vision: A Surveycited by 12
- 2024Unveiling and Mitigating Generalized Biases of DNNs through the Intrinsic Dimensions of Perceptual Manifoldscited by 6
- 2024SDFD: Building a Versatile Synthetic Face Image Dataset with Diverse Attributescited by 6
- 2025A Survey on fMRI-based Brain Decoding for Reconstructing Multimodal Stimulicited by 6
- 2024Mitigating Bias Using Model-Agnostic Data Attributioncited by 3
- 2025Attention IoU: Examining Biases in CelebA using Attention Mapscited by 3
- 2024Social Science Is Necessary for Operationalizing Socially Responsible Foundation Modelscited by 1
- 2026Happy Young Women, Grumpy Old Men? Emotion-Driven Demographic Biases in Synthetic Face Generationcited by 1
- 2024Balancing the Scales: Enhancing Fairness in Facial Expression Recognition with Latent Alignmentcited by 0
- 2024TransFair: Transferring Fairness from Ocular Disease Classification to Progression Predictioncited by 0
12 most cited of 15 All 15 (JSON)
- 2026Benchmarking Fairness in Spiking Neural Networks: Data Bias, Spurious Features, and Hardware Effects8 May 2026
- 2026Responsible AI for General-Purpose Systems: Overview, Challenges, and A Path Forward19 Jan 2026
- 2026Happy Young Women, Grumpy Old Men? Emotion-Driven Demographic Biases in Synthetic Face Generation18 Jan 2026
- 2025A Framework for Benchmarking Fairness-Utility Trade-offs in Text-to-Image Models via Pareto Frontiers22 Aug 2025
- 2025Attention IoU: Examining Biases in CelebA using Attention Maps25 Mar 2025
- 2025A Survey on fMRI-based Brain Decoding for Reconstructing Multimodal Stimuli20 Mar 2025
- 2024Social Science Is Necessary for Operationalizing Socially Responsible Foundation Models20 Dec 2024
- 2024TransFair: Transferring Fairness from Ocular Disease Classification to Progression Prediction24 Nov 2024
- 2024Balancing the Scales: Enhancing Fairness in Facial Expression Recognition with Latent Alignment25 Oct 2024
- 2024Fairness and Bias Mitigation in Computer Vision: A Survey5 Aug 2024
- 2024Mitigating Bias Using Model-Agnostic Data Attribution8 May 2024
- 2024SDFD: Building a Versatile Synthetic Face Image Dataset with Diverse Attributes26 Apr 2024
12 newest of 15 All 15 (JSON)