Face Recognition: Too Bias, or Not Too Bias?
Not on the map. Why?
Abstract (arXiv)
We reveal critical insights into problems of bias in state-of-the-art facial recognition (FR) systems using a novel Balanced Faces In the Wild (BFW) dataset: data balanced for gender and ethnic groups. We show variations in the optimal scoring threshold for face-pairs across different subgroups. Thus, the conventional approach of learning a global threshold for all pairs resulting in performance gaps among subgroups. By learning subgroup-specific thresholds, we not only mitigate problems in performance gaps but also show a notable boost in the overall performance. Furthermore, we do a human evaluation to measure the bias in humans, which supports the hypothesis that such a bias exists in human perception. For the BFW database, source code, and more, visit github.com/visionjo/facerec-bias-bfw.
Key facts. Cited by 82 papers in the map (data through 14 Oct 2026). First posted on arXiv 16 Feb 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 22; 2022: 13; 2023: 15; 2024: 15; 2025: 12; 2026: 5.
82 papers.
Sort:
By area:
- 2021A Comprehensive Study on Face Recognition Biases Beyond Demographicscited by 86
- 2021A Survey on Bias in Visual Datasetscited by 84
- 2021Understanding and Mitigating Annotation Bias in Facial Expression Recognitioncited by 50
- 2021Consistent Instance False Positive Improves Fairness in Face Recognitioncited by 40
- 2021PASS: Protected Attribute Suppression System for Mitigating Bias in Face Recognitioncited by 38
- 2021One Label, One Billion Faces: Usage and Consistency of Racial Categories in Computer Visioncited by 33
- 2023Human-Centric Multimodal Machine Learning: Recent Advances and Testbed on AI-based Recruitmentcited by 33
- 2021Learning Bias-Invariant Representation by Cross-Sample Mutual Information Minimizationcited by 32
- 2022Towards Racially Unbiased Skin Tone Estimation via Scene Disambiguationcited by 32
- 2021Pre-training strategies and datasets for facial representation learningcited by 26
- 2021Deepfake Videos in the Wild: Analysis and Detectioncited by 23
- 2021Domain-Incremental Continual Learning for Mitigating Bias in Facial Expression and Action Unit Recognitioncited by 19
38 more
- 2021Anatomizing Bias in Facial Analysiscited by 18
- 2021Balancing Biases and Preserving Privacy on Balanced Faces in the Wildcited by 17
- 2021FairCal: Fairness Calibration for Face Verificationcited by 17
- 2021Multiset-Equivariant Set Prediction with Approximate Implicit Differentiationcited by 17
- 2023Ethical Considerations for Responsible Data Curationcited by 17
- 2021Measuring Hidden Bias within Face Recognition via Racial Phenotypescited by 16
- 202550 Years of Automated Face Recognitioncited by 15
- 2023Towards Fair Face Verification: An In-depth Analysis of Demographic Biasescited by 14
- 2022A Review of Speech-centric Trustworthy Machine Learning: Privacy, Safety, and Fairnesscited by 13
- 2023What Should Be Balanced in a "Balanced" Face Recognition Dataset?cited by 13
- 2022Mitigating Gender Bias in Face Recognition Using the von Mises-Fisher Mixture Modelcited by 12
- 2025Face-Human-Bench: A Comprehensive Benchmark of Face and Human Understanding for Multi-modal Assistantscited by 12
- 2022A Deep Dive into Dataset Imbalance and Bias in Face Identificationcited by 11
- 2023Bias and Diversity in Synthetic-based Face Recognitioncited by 11
- 2022How to Boost Face Recognition with StyleGAN?cited by 10
- 2023Fairness in Visual Clustering: A Novel Transformer Clustering Approachcited by 10
- 2024Synthetic Data for the Mitigation of Demographic Biases in Face Recognitioncited by 10
- 2023Racial Bias within Face Recognition: A Surveycited by 9
- 2024Thinking Racial Bias in Fair Forgery Detection: Models, Datasets and Evaluationscited by 8
- 2021Hierarchical Attention-based Age Estimation and Bias Estimationcited by 7
- 2022Towards Explaining Demographic Bias through the Eyes of Face Recognition Modelscited by 7
- 2022The Impact of Racial Distribution in Training Data on Face Recognition Bias: A Closer Lookcited by 7
- 2023Gradient Attention Balance Network: Mitigating Face Recognition Racial Bias via Gradient Attentioncited by 7
- 2025Review of Demographic Fairness in Face Recognitioncited by 7
- 2021Distill and De-bias: Mitigating Bias in Face Verification using Knowledge Distillationcited by 6
- 2022CAT: Controllable Attribute Translation for Fair Facial Attribute Classificationcited by 6
- 2023A View From Somewhere: Human-Centric Face Representationscited by 6
- 2023Invariant Feature Regularization for Fair Face Recognitioncited by 6
- 2021Face Verification with Challenging Imposters and Diversified Demographicscited by 5
- 2021Algorithmic Fairness in Face Morphing Attack Detectioncited by 5
- 2022Assessing Bias in Face Image Quality Assessmentcited by 5
- 2023Optimization-Based Improvement of Face Image Quality Assessment Techniquescited by 5
- 2024Model Compression Techniques in Biometrics Applications: A Surveycited by 5
- 2024Can the accuracy bias by facial hairstyle be reduced through balancing the training data?cited by 5
- 2021Learning Fair Face Representation With Progressive Cross Transformercited by 4
- 2021The 5th Recognizing Families in the Wild Data Challenge: Predicting Kinship from Facescited by 4
- 2023Class Distribution Shifts in Zero-Shot Learning: Learning Robust Representationscited by 4
- 2024Lookism: The overlooked bias in computer visioncited by 4
50 most cited of 82 All 82 (JSON)
- 2026UFPR-PEs: A Brazilian Face Recognition Benchmark with Self-Declared Race/Color Labels31 Aug 2026
- 2026Bias Mitigation in Face Recognition via Demographic-based Supervised Contrastive Learning13 Aug 2026
- 2026Adaptive Calibration for Fair and Performant Facial Recognition3 Jun 2026
- 2026Beyond Performance Disparities: A Three-Level Audit of Representational Harm in CelebA14 May 2026
- 2026Demographic and Linguistic Bias Evaluation in Omnimodal Language Models11 Apr 2026
- 2025Mitigating Bias with Words: Inducing Demographic Ambiguity in Face Recognition Templates by Text Encoding5 Dec 2025
- 2025Reliable and Reproducible Demographic Inference for Fairness in Face Analysis23 Oct 2025
- 2025Discovering Intersectional Bias via Directional Alignment in Face Recognition Embeddings17 Oct 2025
- 2025Vec2Face+ for Face Dataset Generation23 Jul 2025
- 2025Balancing Beyond Discrete Categories: Continuous Demographic Labels for Fair Face Recognition2 Jun 2025
- 202550 Years of Automated Face Recognition30 May 2025
- 2025Component-Based Fairness in Face Attribute Classification with Bayesian Network-informed Meta Learning3 May 2025
38 more
- 2025Mitigating Bias in Facial Recognition Systems: Centroid Fairness Loss Optimization27 Apr 2025
- 2025A Critical Review of Predominant Bias in Neural Networks16 Feb 2025
- 2025Towards Fair and Robust Face Parsing for Generative AI: A Multi-Objective Approach6 Feb 2025
- 2025Review of Demographic Fairness in Face Recognition4 Feb 2025
- 2025Face-Human-Bench: A Comprehensive Benchmark of Face and Human Understanding for Multi-modal Assistants2 Jan 2025
- 2024Fairer Analysis and Demographically Balanced Face Generation for Fairer Face Verification4 Dec 2024
- 2024A large-scale study of performance and equity of commercial remote identity verification technologies across demographics18 Sep 2024
- 2024MST-KD: Multiple Specialized Teachers Knowledge Distillation for Fair Face Recognition29 Aug 2024
- 2024Lookism: The overlooked bias in computer vision21 Aug 2024
- 2024Fairness Under Cover: Evaluating the Impact of Occlusions on Demographic Bias in Facial Recognition19 Aug 2024
- 2024Thinking Racial Bias in Fair Forgery Detection: Models, Datasets and Evaluations19 Jul 2024
- 2024Beyond Spatial Explanations: Explainable Face Recognition in the Frequency Domain16 Jul 2024
- 2024Toward Fairer Face Recognition Datasets24 Jun 2024
- 2024Can the accuracy bias by facial hairstyle be reduced through balancing the training data?30 May 2024
- 2024Identity Overlap Between Face Recognition Train/Test Data: Causing Optimistic Bias in Accuracy Measurement15 May 2024
- 2024Sum of Group Error Differences: A Critical Examination of Bias Evaluation in Biometric Verification and a Dual-Metric Measure23 Apr 2024
- 2024AI Competitions and Benchmarks: Dataset Development15 Apr 2024
- 2024Mask-up: Investigating Biases in Face Re-identification for Masked Faces21 Feb 2024
- 2024Synthetic Data for the Mitigation of Demographic Biases in Face Recognition2 Feb 2024
- 2024Model Compression Techniques in Biometrics Applications: A Survey18 Jan 2024
- 2023Class Distribution Shifts in Zero-Shot Learning: Learning Robust Representations30 Nov 2023
- 2023Bias and Diversity in Synthetic-based Face Recognition7 Nov 2023
- 2023On Responsible Machine Learning Datasets with Fairness, Privacy, and Regulatory Norms24 Oct 2023
- 2023Invariant Feature Regularization for Fair Face Recognition23 Oct 2023
- 2023Towards Fair Face Verification: An In-depth Analysis of Demographic Biases19 Jul 2023
- 2023Optimization-Based Improvement of Face Image Quality Assessment Techniques24 May 2023
- 2023Racial Bias within Face Recognition: A Survey1 May 2023
- 2023Embedding Aggregation for Forensic Facial Comparison29 Apr 2023
- 2023What Should Be Balanced in a "Balanced" Face Recognition Dataset?17 Apr 2023
- 2023Fairness in Visual Clustering: A Novel Transformer Clustering Approach14 Apr 2023
- 2023Gradient Attention Balance Network: Mitigating Face Recognition Racial Bias via Gradient Attention5 Apr 2023
- 2023A View From Somewhere: Human-Centric Face Representations30 Mar 2023
- 2023Human-Centric Multimodal Machine Learning: Recent Advances and Testbed on AI-based Recruitment13 Feb 2023
- 2023Ethical Considerations for Responsible Data Curation7 Feb 2023
- 2023Young Labeled Faces in the Wild (YLFW): A Dataset for Children Faces Recognition13 Jan 2023
- 2022A Review of Speech-centric Trustworthy Machine Learning: Privacy, Safety, and Fairness18 Dec 2022
- 2022Assessing Bias in Face Image Quality Assessment28 Nov 2022
- 2022The Impact of Racial Distribution in Training Data on Face Recognition Bias: A Closer Look26 Nov 2022
50 newest of 82 All 82 (JSON)
- 2021A Comprehensive Study on Face Recognition Biases Beyond Demographicscited by 86
- 2021A Survey on Bias in Visual Datasetscited by 84
- 2021Understanding and Mitigating Annotation Bias in Facial Expression Recognitioncited by 50
- 2021Consistent Instance False Positive Improves Fairness in Face Recognitioncited by 40
- 2021PASS: Protected Attribute Suppression System for Mitigating Bias in Face Recognitioncited by 38
- 2021One Label, One Billion Faces: Usage and Consistency of Racial Categories in Computer Visioncited by 33
- 2023Human-Centric Multimodal Machine Learning: Recent Advances and Testbed on AI-based Recruitmentcited by 33
- 2021Learning Bias-Invariant Representation by Cross-Sample Mutual Information Minimizationcited by 32
- 2022Towards Racially Unbiased Skin Tone Estimation via Scene Disambiguationcited by 32
- 2021Pre-training strategies and datasets for facial representation learningcited by 26
- 2021Deepfake Videos in the Wild: Analysis and Detectioncited by 23
- 2021Domain-Incremental Continual Learning for Mitigating Bias in Facial Expression and Action Unit Recognitioncited by 19
12 most cited of 80 All 80 (JSON)
- 2026UFPR-PEs: A Brazilian Face Recognition Benchmark with Self-Declared Race/Color Labels31 Aug 2026
- 2026Bias Mitigation in Face Recognition via Demographic-based Supervised Contrastive Learning13 Aug 2026
- 2026Adaptive Calibration for Fair and Performant Facial Recognition3 Jun 2026
- 2026Beyond Performance Disparities: A Three-Level Audit of Representational Harm in CelebA14 May 2026
- 2026Demographic and Linguistic Bias Evaluation in Omnimodal Language Models11 Apr 2026
- 2025Mitigating Bias with Words: Inducing Demographic Ambiguity in Face Recognition Templates by Text Encoding5 Dec 2025
- 2025Reliable and Reproducible Demographic Inference for Fairness in Face Analysis23 Oct 2025
- 2025Discovering Intersectional Bias via Directional Alignment in Face Recognition Embeddings17 Oct 2025
- 2025Vec2Face+ for Face Dataset Generation23 Jul 2025
- 2025Balancing Beyond Discrete Categories: Continuous Demographic Labels for Fair Face Recognition2 Jun 2025
- 202550 Years of Automated Face Recognition30 May 2025
- 2025Component-Based Fairness in Face Attribute Classification with Bayesian Network-informed Meta Learning3 May 2025
12 newest of 80 All 80 (JSON)