InsideBias: Measuring Bias in Deep Networks and Application to Face Gender Biometrics
Not on the map. Why?
Abstract (arXiv)
This work explores the biases in learning processes based on deep neural network architectures. We analyze how bias affects deep learning processes through a toy example using the MNIST database and a case study in gender detection from face images. We employ two gender detection models based on popular deep neural networks. We present a comprehensive analysis of bias effects when using an unbalanced training dataset on the features learned by the models. We show how bias impacts in the activations of gender detection models based on face images. We finally propose InsideBias, a novel method to detect biased models. InsideBias is based on how the models represent the information instead of how they perform, which is the normal practice in other existing methods for bias detection. Our strategy with InsideBias allows to detect biased models with very few samples (only 15 images in our case study). Our experiments include 72K face images from 24K identities and 3 ethnic groups.
Key facts. Cited by 31 papers in the map (data through 7 Oct 2026). First posted on arXiv 14 Apr 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 7; 2022: 5; 2023: 6; 2024: 7; 2025: 3; 2026: 3.
31 papers.
Sort:
By area:
- 2021A Comprehensive Study on Face Recognition Biases Beyond Demographicscited by 86
- 2023Multimodal Composite Association Score: Measuring Gender Bias in Generative Multimodal Modelscited by 21
- 2021Anatomizing Bias in Facial Analysiscited by 18
- 2021Balancing Biases and Preserving Privacy on Balanced Faces in the Wildcited by 17
- 2024Is My Data in Your AI? Membership Inference Test (MINT) applied to Face Biometricscited by 12
- 2025Addressing Bias in LLMs: Strategies and Application to Fair AI-based Recruitmentcited by 12
- 2021IFBiD: Inference-Free Bias Detectioncited by 11
- 2023Measuring Bias in AI Models: An Statistical Approach Introducing N-Sigmacited by 11
- 2024Synthetic Data for the Mitigation of Demographic Biases in Face Recognitioncited by 10
- 2023Unlearning with Fisher Maskingcited by 8
- 2022Towards Explaining Demographic Bias through the Eyes of Face Recognition Modelscited by 7
- 2022Learning Visual Explanations for DCNN-Based Image Classifiers Using an Attention Mechanismcited by 7
19 more
- 2022Explaining Bias in Deep Face Recognition via Image Characteristicscited by 6
- 2024SDFD: Building a Versatile Synthetic Face Image Dataset with Diverse Attributescited by 6
- 2026Is My Vision-Language Data in Your AI? Membership Inference Test (MINT) Demo 2cited by 6
- 2021Improving Fairness in Speaker Recognitioncited by 5
- 2024Can the accuracy bias by facial hairstyle be reduced through balancing the training data?cited by 5
- 2023Biased Attention: Do Vision Transformers Amplify Gender Bias More than Convolutional Neural Networks?cited by 4
- 2022A survey of Identification and mitigation of Machine Learning algorithmic biases in Image Analysiscited by 3
- 2024The Impact of Balancing Real and Synthetic Data on Accuracy and Fairness in Face Recognitioncited by 3
- 2024Generated Bias: Auditing Internal Bias Dynamics of Text-To-Image Generative Modelscited by 3
- 2021There is an elephant in the room: Towards a critique on the use of fairness in biometricscited by 2
- 2023Variation of Gender Biases in Visual Recognition Models Before and After Finetuningcited by 2
- 2024Comprehensive Equity Index (CEI): Definition and Application to Bias Evaluation in Biometricscited by 2
- 2025Balancing Tails when Comparing Distributions: Comprehensive Equity Index (CEI) with Application to Bias Evaluation in Operational Face Biometricscited by 2
- 2026Unraveling Machine Behavior by Multi-Level Bias Analysis and Detection: Methodology and Application to Computer Visioncited by 2
- 2022Race Bias Analysis of Bona Fide Errors in face anti-spoofingcited by 1
- 2023(Un)fair Exposure in Deep Face Rankings at a Distancecited by 1
- 2021SELM: Siamese Extreme Learning Machine with Application to Face Biometricscited by 0
- 2025Designing and Generating Diverse, Equitable Face Image Datasets for Face Verification Taskscited by 0
- 2026Unbiased Model Prediction Without Using Protected Attribute Informationcited by 0
- 2026Unraveling Machine Behavior by Multi-Level Bias Analysis and Detection: Methodology and Application to Computer Vision8 Jul 2026
- 2026Is My Vision-Language Data in Your AI? Membership Inference Test (MINT) Demo 25 Jun 2026
- 2026Unbiased Model Prediction Without Using Protected Attribute Information31 Mar 2026
- 2025Designing and Generating Diverse, Equitable Face Image Datasets for Face Verification Tasks21 Nov 2025
- 2025Addressing Bias in LLMs: Strategies and Application to Fair AI-based Recruitment13 Jun 2025
- 2025Balancing Tails when Comparing Distributions: Comprehensive Equity Index (CEI) with Application to Bias Evaluation in Operational Face Biometrics12 Jun 2025
- 2024Generated Bias: Auditing Internal Bias Dynamics of Text-To-Image Generative Models10 Oct 2024
- 2024The Impact of Balancing Real and Synthetic Data on Accuracy and Fairness in Face Recognition4 Sep 2024
- 2024Comprehensive Equity Index (CEI): Definition and Application to Bias Evaluation in Biometrics3 Sep 2024
- 2024Can the accuracy bias by facial hairstyle be reduced through balancing the training data?30 May 2024
- 2024SDFD: Building a Versatile Synthetic Face Image Dataset with Diverse Attributes26 Apr 2024
- 2024Is My Data in Your AI? Membership Inference Test (MINT) applied to Face Biometrics14 Feb 2024
19 more
- 2024Synthetic Data for the Mitigation of Demographic Biases in Face Recognition2 Feb 2024
- 2023Unlearning with Fisher Masking9 Oct 2023
- 2023Biased Attention: Do Vision Transformers Amplify Gender Bias More than Convolutional Neural Networks?15 Sep 2023
- 2023(Un)fair Exposure in Deep Face Rankings at a Distance22 Aug 2023
- 2023Multimodal Composite Association Score: Measuring Gender Bias in Generative Multimodal Models26 Apr 2023
- 2023Measuring Bias in AI Models: An Statistical Approach Introducing N-Sigma26 Apr 2023
- 2023Variation of Gender Biases in Visual Recognition Models Before and After Finetuning14 Mar 2023
- 2022Race Bias Analysis of Bona Fide Errors in face anti-spoofing11 Oct 2022
- 2022A survey of Identification and mitigation of Machine Learning algorithmic biases in Image Analysis10 Oct 2022
- 2022Learning Visual Explanations for DCNN-Based Image Classifiers Using an Attention Mechanism22 Sep 2022
- 2022Towards Explaining Demographic Bias through the Eyes of Face Recognition Models29 Aug 2022
- 2022Explaining Bias in Deep Face Recognition via Image Characteristics23 Aug 2022
- 2021There is an elephant in the room: Towards a critique on the use of fairness in biometrics16 Dec 2021
- 2021Anatomizing Bias in Facial Analysis13 Dec 2021
- 2021IFBiD: Inference-Free Bias Detection9 Sep 2021
- 2021SELM: Siamese Extreme Learning Machine with Application to Face Biometrics6 Aug 2021
- 2021Improving Fairness in Speaker Recognition29 Apr 2021
- 2021Balancing Biases and Preserving Privacy on Balanced Faces in the Wild16 Mar 2021
- 2021A Comprehensive Study on Face Recognition Biases Beyond Demographics2 Mar 2021
- 2021A Comprehensive Study on Face Recognition Biases Beyond Demographicscited by 86
- 2021Anatomizing Bias in Facial Analysiscited by 18
- 2021Balancing Biases and Preserving Privacy on Balanced Faces in the Wildcited by 17
- 2025Addressing Bias in LLMs: Strategies and Application to Fair AI-based Recruitmentcited by 12
- 2021IFBiD: Inference-Free Bias Detectioncited by 11
- 2023Measuring Bias in AI Models: An Statistical Approach Introducing N-Sigmacited by 11
- 2024Synthetic Data for the Mitigation of Demographic Biases in Face Recognitioncited by 10
- 2022Towards Explaining Demographic Bias through the Eyes of Face Recognition Modelscited by 7
- 2022Learning Visual Explanations for DCNN-Based Image Classifiers Using an Attention Mechanismcited by 7
- 2022Explaining Bias in Deep Face Recognition via Image Characteristicscited by 6
- 2024SDFD: Building a Versatile Synthetic Face Image Dataset with Diverse Attributescited by 6
- 2021Improving Fairness in Speaker Recognitioncited by 5
12 most cited of 26 All 26 (JSON)
- 2026Unraveling Machine Behavior by Multi-Level Bias Analysis and Detection: Methodology and Application to Computer Vision8 Jul 2026
- 2026Unbiased Model Prediction Without Using Protected Attribute Information31 Mar 2026
- 2025Designing and Generating Diverse, Equitable Face Image Datasets for Face Verification Tasks21 Nov 2025
- 2025Addressing Bias in LLMs: Strategies and Application to Fair AI-based Recruitment13 Jun 2025
- 2025Balancing Tails when Comparing Distributions: Comprehensive Equity Index (CEI) with Application to Bias Evaluation in Operational Face Biometrics12 Jun 2025
- 2024The Impact of Balancing Real and Synthetic Data on Accuracy and Fairness in Face Recognition4 Sep 2024
- 2024Comprehensive Equity Index (CEI): Definition and Application to Bias Evaluation in Biometrics3 Sep 2024
- 2024Can the accuracy bias by facial hairstyle be reduced through balancing the training data?30 May 2024
- 2024SDFD: Building a Versatile Synthetic Face Image Dataset with Diverse Attributes26 Apr 2024
- 2024Synthetic Data for the Mitigation of Demographic Biases in Face Recognition2 Feb 2024
- 2023Biased Attention: Do Vision Transformers Amplify Gender Bias More than Convolutional Neural Networks?15 Sep 2023
- 2023(Un)fair Exposure in Deep Face Rankings at a Distance22 Aug 2023
12 newest of 26 All 26 (JSON)