Fair Attribute Classification through Latent Space De-biasing
Not on the map. Why?
Abstract (arXiv)
Fairness in visual recognition is becoming a prominent and critical topic of discussion as recognition systems are deployed at scale in the real world. Models trained from data in which target labels are correlated with protected attributes (e.g., gender, race) are known to learn and exploit those correlations. In this work, we introduce a method for training accurate target classifiers while mitigating biases that stem from these correlations. We use GANs to generate realistic-looking images, and perturb these images in the underlying latent space to generate training data that is balanced for each protected attribute. We augment the original dataset with this perturbed generated data, and empirically demonstrate that target classifiers trained on the augmented dataset exhibit a number of both quantitative and qualitative benefits. We conduct a thorough evaluation across multiple target labels and protected attributes in the CelebA dataset, and provide an in-depth analysis and comparison to existing literature in the space.
Key facts. Cited by 125 papers in the map (data through 14 Oct 2026). First posted on arXiv 2 Dec 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 8; 2022: 35; 2023: 33; 2024: 28; 2025: 14; 2026: 7.
125 papers.
Sort:
By area:
- 2022A Survey of Machine Unlearningcited by 312
- 2023Debiasing Vision-Language Models via Biased Promptscited by 149
- 2021Understanding and Evaluating Racial Biases in Image Captioningcited by 108
- 2021Generative Models as a Data Source for Multiview Representation Learningcited by 104
- 2022Fair Contrastive Learning for Facial Attribute Classificationcited by 71
- 2024FairCLIP: Harnessing Fairness in Vision-Language Learningcited by 69
- 2023ITI-GEN: Inclusive Text-to-Image Generationcited by 64
- 2022Towards Intersectionality in Machine Learning: Including More Identities, Handling Underrepresentation, and Performing Evaluationcited by 59
- 2023Diagnosing and Rectifying Vision Models using Languagecited by 58
- 2022Leveling Down in Computer Vision: Pareto Inefficiencies in Fair Deep Classifierscited by 53
- 2024Balancing Act: Distribution-Guided Debiasing in Diffusion Modelscited by 52
- 2022Fairness-aware Adversarial Perturbation Towards Bias Mitigation for Deployed Deep Modelscited by 47
38 more
- 2022Overlooked factors in concept-based explanations: Dataset choice, concept learnability, and human capabilitycited by 46
- 2023Inspecting the Geographical Representativeness of Images from Text-to-Image Modelscited by 44
- 2021NeuronFair: Interpretable White-Box Fairness Testing through Biased Neuron Identificationcited by 42
- 2022On-Demand Sampling: Learning Optimally from Multiple Distributionscited by 39
- 2022Gender Artifacts in Visual Datasetscited by 38
- 2023Human-Centric Multimodal Machine Learning: Recent Advances and Testbed on AI-based Recruitmentcited by 33
- 2023Overwriting Pretrained Bias with Finetuning Datacited by 32
- 2023Harvard Glaucoma Fairness: A Retinal Nerve Disease Dataset for Fairness Learning and Fair Identity Normalizationcited by 31
- 2022Evidence for Hypodescent in Visual Semantic AIcited by 30
- 2022FairGRAPE: Fairness-aware GRAdient Pruning mEthod for Face Attribute Classificationcited by 30
- 2022Bias Mimicking: A Simple Sampling Approach for Bias Mitigationcited by 30
- 2024Causal Concept Graph Models: Beyond Causal Opacity in Deep Learningcited by 29
- 2022Generative Visual Prompt: Unifying Distributional Control of Pre-Trained Generative Modelscited by 27
- 2023Balancing the Picture: Debiasing Vision-Language Datasets with Synthetic Contrast Setscited by 27
- 2023Survey of Social Bias in Vision-Language Modelscited by 26
- 2023Benchmarking Algorithmic Bias in Face Recognition: An Experimental Approach Using Synthetic Faces and Human Evaluationcited by 25
- 2023Zero-shot Model Diagnosiscited by 23
- 2022Mitigating Dataset Bias by Using Per-sample Gradientcited by 22
- 2022Debiasing Methods for Fairer Neural Models in Vision and Language Research: A Surveycited by 22
- 2022Open Long-Tailed Recognition in a Dynamic Worldcited by 21
- 2022Men Also Do Laundry: Multi-Attribute Bias Amplificationcited by 21
- 2022FairStyle: Debiasing StyleGAN2 with Style Channel Manipulationscited by 20
- 2024FairDomain: Achieving Fairness in Cross-Domain Medical Image Segmentation and Classificationcited by 19
- 2024SANER: Annotation-free Societal Attribute Neutralizer for Debiasing CLIPcited by 19
- 2021Latent Space Smoothing for Individually Fair Representationscited by 18
- 2021Anatomizing Bias in Facial Analysiscited by 18
- 2024Decompose-and-Compose: A Compositional Approach to Mitigating Spurious Correlationcited by 18
- 2021LARGE: Latent-Based Regression through GAN Semanticscited by 17
- 2022Efficient Attribute Unlearning: Towards Selective Removal of Input Attributes from Feature Representationscited by 17
- 2023Beyond Skin Tone: A Multidimensional Measure of Apparent Skin Colorcited by 17
- 2021Fair Representation: Guaranteeing Approximate Multiple Group Fairness for Unknown Taskscited by 16
- 2022Fair Bayes-Optimal Classifiers Under Predictive Paritycited by 16
- 2023Image retrieval outperforms diffusion models on data augmentationcited by 14
- 2023Post-hoc Bias Scoring Is Optimal For Fair Classificationcited by 14
- 2023FairVision: Equitable Deep Learning for Eye Disease Screening via Fair Identity Scalingcited by 13
- 2024Fairness and Bias Mitigation in Computer Vision: A Surveycited by 13
- 2025Beyond Visual Perception: Insights from Smartphone Interaction of Visually Impaired Users with Large Multimodal Modelscited by 13
- 2023From Fake to Real: Pretraining on Balanced Synthetic Images to Prevent Spurious Correlations in Image Recognitioncited by 12
50 most cited of 125 All 125 (JSON)
- 2026Do Counterfactually Fair Image Classifiers Satisfy Group Fairness? -- A Theoretical and Empirical Study7 Jul 2026
- 2026Bridging Geographic Bias in Urban Streetscape Inference via Lifelong Learning with Visual-Semantic Pivoting13 Jun 2026
- 2026BiasEdit: A Training-Free Bias-Detect-and-Edit Framework for Learning Fair Visual Classifiers27 May 2026
- 2026Personalized Generative Models for Contextual Debiasing25 May 2026
- 2026Unbiased Model Prediction Without Using Protected Attribute Information31 Mar 2026
- 2026Mitigating Bias in Concept Bottleneck Models for Fair and Interpretable Image Classification6 Mar 2026
- 2026SHaSaM: Submodular Hard Sample Mining for Fair Facial Attribute Recognition5 Feb 2026
- 2025Leveraging Text Guidance for Enhancing Demographic Fairness in Gender Classification11 Dec 2025
- 2025Biased Minds Meet Biased AI: How Class Imbalance Shapes Appropriate Reliance and Interacts with Human Base Rate Neglect18 Nov 2025
- 2025T2IBias: Uncovering Societal Bias Encoded in the Latent Space of Text-to-Image Generative Models13 Nov 2025
- 2025Harnessing Diffusion-Generated Synthetic Images for Fair Image Classification11 Nov 2025
- 2025High-dimensional Analysis of Synthetic Data Selection9 Oct 2025
38 more
- 2025A Feature-level Bias Evaluation Framework for Facial Expression Recognition Models26 May 2025
- 2025Behind the Screens: Uncovering Bias in AI-Driven Video Interview Assessments Using Counterfactuals17 May 2025
- 2025Attention IoU: Examining Biases in CelebA using Attention Maps25 Mar 2025
- 2025pFedFair: Towards Optimal Group Fairness-Accuracy Trade-off in Heterogeneous Federated Learning19 Mar 2025
- 2025Do Fairness Interventions Come at the Cost of Privacy: Evaluations for Binary Classifiers8 Mar 2025
- 2025AIM-Fair: Advancing Algorithmic Fairness via Selectively Fine-Tuning Biased Models with Contextual Synthetic Data7 Mar 2025
- 2025Beyond Visual Perception: Insights from Smartphone Interaction of Visually Impaired Users with Large Multimodal Models22 Feb 2025
- 2025A Critical Review of Predominant Bias in Neural Networks16 Feb 2025
- 2025Unsupervised Search for Ethnic Minorities' Medical Segmentation Training Set5 Jan 2025
- 2024Constructing Fair Latent Space for Intersection of Fairness and Explainability23 Dec 2024
- 2024Fairness via Independence: A (Conditional) Distance Covariance Framework1 Dec 2024
- 2024Fair Bilevel Neural Network (FairBiNN): On Balancing fairness and accuracy via Stackelberg Equilibrium21 Oct 2024
- 2024Multi-Output Distributional Fairness via Post-Processing31 Aug 2024
- 2024FineFACE: Fair Facial Attribute Classification Leveraging Fine-grained Features29 Aug 2024
- 2024SANER: Annotation-free Societal Attribute Neutralizer for Debiasing CLIP19 Aug 2024
- 2024Social Debiasing for Fair Multi-modal LLMs13 Aug 2024
- 2024Approximating Discrimination Within Models When Faced With Several Non-Binary Sensitive Attributes12 Aug 2024
- 2024Fairness and Bias Mitigation in Computer Vision: A Survey5 Aug 2024
- 2024FairDomain: Achieving Fairness in Cross-Domain Medical Image Segmentation and Classification11 Jul 2024
- 2024Resampled Datasets Are Not Enough: Mitigating Societal Bias Beyond Single Attributes4 Jul 2024
- 2024OxonFair: A Flexible Toolkit for Algorithmic Fairness30 Jun 2024
- 2024A Taxonomy of Challenges to Curating Fair Datasets10 Jun 2024
- 2024Contrastive Learning from Synthetic Audio Doppelg"angers9 Jun 2024
- 2024Language-guided Detection and Mitigation of Unknown Dataset Bias5 Jun 2024
- 2024Causal Concept Graph Models: Beyond Causal Opacity in Deep Learning26 May 2024
- 2024Sampling Strategies for Mitigating Bias in Face Synthesis Methods18 May 2024
- 2024Mitigating Bias Using Model-Agnostic Data Attribution8 May 2024
- 2024Utilizing Adversarial Examples for Bias Mitigation and Accuracy Enhancement18 Apr 2024
- 2024Inference-Time Rule Eraser: Fair Recognition via Distilling and Removing Biased Rules7 Apr 2024
- 2024FairCLIP: Harnessing Fairness in Vision-Language Learning29 Mar 2024
- 2024FairRR: Pre-Processing for Group Fairness through Randomized Response12 Mar 2024
- 2024Distributionally Generative Augmentation for Fair Facial Attribute Classification11 Mar 2024
- 2024Decompose-and-Compose: A Compositional Approach to Mitigating Spurious Correlation29 Feb 2024
- 2024Balancing Act: Distribution-Guided Debiasing in Diffusion Models28 Feb 2024
- 2024Common-Sense Bias Modeling for Classification Tasks24 Jan 2024
- 2024A Large-Scale Empirical Study on Improving the Fairness of Image Classification Models8 Jan 2024
- 2024Marginal Debiased Network for Fair Visual Recognition4 Jan 2024
- 2023GELDA: A generative language annotation framework to reveal visual biases in datasets29 Nov 2023
50 newest of 125 All 125 (JSON)
- 2024Balancing Act: Distribution-Guided Debiasing in Diffusion Modelscited by 52
- 2023Inspecting the Geographical Representativeness of Images from Text-to-Image Modelscited by 44
- 2022Generative Visual Prompt: Unifying Distributional Control of Pre-Trained Generative Modelscited by 27
- 2023Image retrieval outperforms diffusion models on data augmentationcited by 14
- 2025AIM-Fair: Advancing Algorithmic Fairness via Selectively Fine-Tuning Biased Models with Contextual Synthetic Datacited by 5
- 2025Harnessing Diffusion-Generated Synthetic Images for Fair Image Classificationcited by 1
- 2025Harnessing Diffusion-Generated Synthetic Images for Fair Image Classification11 Nov 2025
- 2025AIM-Fair: Advancing Algorithmic Fairness via Selectively Fine-Tuning Biased Models with Contextual Synthetic Data7 Mar 2025
- 2024Balancing Act: Distribution-Guided Debiasing in Diffusion Models28 Feb 2024
- 2023Inspecting the Geographical Representativeness of Images from Text-to-Image Models18 May 2023
- 2023Image retrieval outperforms diffusion models on data augmentation20 Apr 2023
- 2022Generative Visual Prompt: Unifying Distributional Control of Pre-Trained Generative Models14 Sep 2022
- 2023Debiasing Vision-Language Models via Biased Promptscited by 149
- 2023Balancing the Picture: Debiasing Vision-Language Datasets with Synthetic Contrast Setscited by 27
- 2023Survey of Social Bias in Vision-Language Modelscited by 26
- 2024SANER: Annotation-free Societal Attribute Neutralizer for Debiasing CLIPcited by 19
- 2025Beyond Visual Perception: Insights from Smartphone Interaction of Visually Impaired Users with Large Multimodal Modelscited by 13
- 2024Social Debiasing for Fair Multi-modal LLMscited by 8
- 2025Beyond Visual Perception: Insights from Smartphone Interaction of Visually Impaired Users with Large Multimodal Models22 Feb 2025
- 2024SANER: Annotation-free Societal Attribute Neutralizer for Debiasing CLIP19 Aug 2024
- 2024Social Debiasing for Fair Multi-modal LLMs13 Aug 2024
- 2023Survey of Social Bias in Vision-Language Models24 Sep 2023
- 2023Balancing the Picture: Debiasing Vision-Language Datasets with Synthetic Contrast Sets24 May 2023
- 2023Debiasing Vision-Language Models via Biased Prompts31 Jan 2023
- 2021Understanding and Evaluating Racial Biases in Image Captioningcited by 108
- 2021Generative Models as a Data Source for Multiview Representation Learningcited by 104
- 2022Fair Contrastive Learning for Facial Attribute Classificationcited by 71
- 2024FairCLIP: Harnessing Fairness in Vision-Language Learningcited by 69
- 2023ITI-GEN: Inclusive Text-to-Image Generationcited by 64
- 2022Towards Intersectionality in Machine Learning: Including More Identities, Handling Underrepresentation, and Performing Evaluationcited by 59
- 2023Diagnosing and Rectifying Vision Models using Languagecited by 58
- 2022Leveling Down in Computer Vision: Pareto Inefficiencies in Fair Deep Classifierscited by 53
- 2022Fairness-aware Adversarial Perturbation Towards Bias Mitigation for Deployed Deep Modelscited by 47
- 2022Overlooked factors in concept-based explanations: Dataset choice, concept learnability, and human capabilitycited by 46
- 2021NeuronFair: Interpretable White-Box Fairness Testing through Biased Neuron Identificationcited by 42
- 2022On-Demand Sampling: Learning Optimally from Multiple Distributionscited by 39
12 most cited of 111 All 111 (JSON)
- 2026Do Counterfactually Fair Image Classifiers Satisfy Group Fairness? -- A Theoretical and Empirical Study7 Jul 2026
- 2026Bridging Geographic Bias in Urban Streetscape Inference via Lifelong Learning with Visual-Semantic Pivoting13 Jun 2026
- 2026BiasEdit: A Training-Free Bias-Detect-and-Edit Framework for Learning Fair Visual Classifiers27 May 2026
- 2026Personalized Generative Models for Contextual Debiasing25 May 2026
- 2026Unbiased Model Prediction Without Using Protected Attribute Information31 Mar 2026
- 2026Mitigating Bias in Concept Bottleneck Models for Fair and Interpretable Image Classification6 Mar 2026
- 2026SHaSaM: Submodular Hard Sample Mining for Fair Facial Attribute Recognition5 Feb 2026
- 2025Leveraging Text Guidance for Enhancing Demographic Fairness in Gender Classification11 Dec 2025
- 2025Biased Minds Meet Biased AI: How Class Imbalance Shapes Appropriate Reliance and Interacts with Human Base Rate Neglect18 Nov 2025
- 2025T2IBias: Uncovering Societal Bias Encoded in the Latent Space of Text-to-Image Generative Models13 Nov 2025
- 2025High-dimensional Analysis of Synthetic Data Selection9 Oct 2025
- 2025A Feature-level Bias Evaluation Framework for Facial Expression Recognition Models26 May 2025
12 newest of 111 All 111 (JSON)