There is an elephant in the room: Towards a critique on the use of fairness in biometrics
Not on the map. Why?
Abstract (arXiv)
In 2019, the UK's Immigration and Asylum Chamber of the Upper Tribunal dismissed an asylum appeal basing the decision on the output of a biometric system, alongside other discrepancies. The fingerprints of the asylum seeker were found in a biometric database which contradicted the appellant's account. The Tribunal found this evidence unequivocal and denied the asylum claim. Nowadays, the proliferation of biometric systems is shaping public debates around its political, social and ethical implications. Yet whilst concerns towards the racialised use of this technology for migration control have been on the rise, investment in the biometrics industry and innovation is increasing considerably. Moreover, fairness has also been recently adopted by biometrics to mitigate bias and discrimination on biometrics. However, algorithmic fairness cannot distribute justice in scenarios which are broken or intended purpose is to discriminate, such as biometrics deployed at the border. In this paper, we offer a critical reading of recent debates about biometric fairness and show its limitations drawing on research in fairness in machine learning and critical border studies. Building on previous fairness demonstrations, we prove that biometric fairness criteria are mathematically mutually exclusive. Then, the paper moves on illustrating empirically that a fair biometric system is not possible by reproducing experiments from previous works. Finally, we discuss the politics of fairness in biometrics by situating the debate at the border. We claim that bias and error rates have different impact on citizens and asylum seekers. Fairness has overshadowed the elephant in the room of biometrics, focusing on the demographic biases and ethical discourses of algorithms rather than examine how these systems reproduce historical and political injustices.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 19 of its 96 references that are in the map. First posted on arXiv 16 Dec 2021.
Builds on
19 of 96 references.
References · 19
- 2016Equality of Opportunity in Supervised Learningcited by 2,007
- 2016Fair prediction with disparate impact: A study of bias in recidivism prediction instrumentscited by 672
- 2020Data and its (dis)contents: A survey of dataset development and use in machine learning researchcited by 260
- 2018A comparative study of fairness-enhancing interventions in machine learningcited by 208
- 2019Inherent Tradeoffs in Learning Fair Representationscited by 144
- 2019Towards a Critical Race Methodology in Algorithmic Fairnesscited by 125
- 201850 Years of Test (Un)fairness: Lessons for Machine Learningcited by 101
- 2020Demographic Bias in Biometrics: A Survey on an Emerging Challengecited by 93
- 2020Saving Face: Investigating the Ethical Concerns of Facial Recognition Auditingcited by 89
- 2021A Comprehensive Study on Face Recognition Biases Beyond Demographicscited by 86
- 2021Demystifying the Draft EU Artificial Intelligence Actcited by 84
- 2020Fairness Metrics: A Comparative Analysiscited by 45
7 more
- 2020Fairness in Biometrics: a figure of merit to assess biometric verification systemscited by 41
- 2020InsideBias: Measuring Bias in Deep Networks and Application to Face Gender Biometricscited by 31
- 2019Algorithmic Discrimination: Formulation and Exploration in Deep Learning-based Face Biometricscited by 19
- 2019Some Research Problems in Biometrics: The Future Beckonscited by 13
- 2020Demographic Bias in Presentation Attack Detection of Iris Recognition Systemscited by 13
- 2021Toward a Theory of Justice for Artificial Intelligencecited by 7
- 2020Demographic Bias: A Challenge for Fingervein Recognition Systems?cited by 2
Built on by
Citing papers per year: 2022: 1; 2023: 0; 2024: 0; 2025: 1.
2 papers.