Towards a Critical Race Methodology in Algorithmic Fairness
Not on the map. Why?
Abstract (arXiv)
We examine the way race and racial categories are adopted in algorithmic fairness frameworks. Current methodologies fail to adequately account for the socially constructed nature of race, instead adopting a conceptualization of race as a fixed attribute. Treating race as an attribute, rather than a structural, institutional, and relational phenomenon, can serve to minimize the structural aspects of algorithmic unfairness. In this work, we focus on the history of racial categories and turn to critical race theory and sociological work on race and ethnicity to ground conceptualizations of race for fairness research, drawing on lessons from public health, biomedical research, and social survey research. We argue that algorithmic fairness researchers need to take into account the multidimensionality of race, take seriously the processes of conceptualizing and operationalizing race, focus on social processes which produce racial inequality, and consider perspectives of those most affected by sociotechnical systems.
Key facts. Cited by 124 papers in the map (data through 7 Oct 2026). First posted on arXiv 8 Dec 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 25; 2022: 27; 2023: 29; 2024: 27; 2025: 10; 2026: 6.
124 papers.
Sort:
By area:
- 2023PaLM 2 Technical Reportcited by 1,154
- 2023DataComp: In search of the next generation of multimodal datasetscited by 635
- 2023Bias and Fairness in Large Language Models: A Surveycited by 626
- 2021Causal Inference in Natural Language Processing: Estimation, Prediction, Interpretation and Beyondcited by 177
- 2021Understanding and Evaluating Racial Biases in Image Captioningcited by 108
- 2021Re-imagining Algorithmic Fairness in India and Beyondcited by 102
- 2023CoMPosT: Characterizing and Evaluating Caricature in LLM Simulationscited by 94
- 2023NLPositionality: Characterizing Design Biases of Datasets and Modelscited by 91
- 2021Do Datasets Have Politics? Disciplinary Values in Computer Vision Dataset Developmentcited by 85
- 2021A Survey on Bias in Visual Datasetscited by 84
- 2021Towards Measuring Fairness in AI: the Casual Conversations Datasetcited by 80
- 2021A Survey of Race, Racism, and Anti-Racism in NLPcited by 74
38 more
- 2024FairCLIP: Harnessing Fairness in Vision-Language Learningcited by 69
- 2022Interactive Model Cards: A Human-Centered Approach to Model Documentationcited by 61
- 2022Towards Intersectionality in Machine Learning: Including More Identities, Handling Underrepresentation, and Performing Evaluationcited by 59
- 2023AI's Regimes of Representation: A Community-centered Study of Text-to-Image Models in South Asiacited by 54
- 2023Uncurated Image-Text Datasets: Shedding Light on Demographic Biascited by 51
- 2021Mitigating Dataset Harms Requires Stewardship: Lessons from 1000 Paperscited by 49
- 2022Characteristics of Harmful Text: Towards Rigorous Benchmarking of Language Modelscited by 49
- 2021Designing Disaggregated Evaluations of AI Systems: Choices, Considerations, and Tradeoffscited by 48
- 2022Accountability in an Algorithmic Society: Relationality, Responsibility, and Robustness in Machine Learningcited by 47
- 2022Discover and Mitigate Unknown Biases with Debiasing Alternate Networkscited by 47
- 2021Fairness for Unobserved Characteristics: Insights from Technological Impacts on Queer Communitiescited by 40
- 2022Gender and Racial Bias in Visual Question Answering Datasetscited by 39
- 2021One Label, One Billion Faces: Usage and Consistency of Racial Categories in Computer Visioncited by 33
- 2023Queer In AI: A Case Study in Community-Led Participatory AIcited by 33
- 2021Fairness for Image Generation with Uncertain Sensitive Attributescited by 31
- 2022Studying Bias in GANs through the Lens of Racecited by 31
- 2023Sociodemographic Bias in Language Models: A Survey and Forward Pathcited by 27
- 2024ViSAGe: A Global-Scale Analysis of Visual Stereotypes in Text-to-Image Generationcited by 27
- 2022From plane crashes to algorithmic harm: applicability of safety engineering frameworks for responsible MLcited by 26
- 2023Survey of Social Bias in Vision-Language Modelscited by 26
- 2023Disentangling Perceptions of Offensiveness: Cultural and Moral Correlatescited by 26
- 2024Position: Measure Dataset Diversity, Don't Just Claim Itcited by 26
- 2021"Garbage In, Garbage Out" Revisited: What Do Machine Learning Application Papers Report About Human-Labeled Training Data?cited by 24
- 2021A Sociotechnical View of Algorithmic Fairnesscited by 24
- 2022Fairness Indicators for Systematic Assessments of Visual Feature Extractorscited by 24
- 2022Rethinking Fairness: An Interdisciplinary Survey of Critiques of Hegemonic ML Fairness Approachescited by 23
- 2022How Hate Speech Varies by Target Identity: A Computational Analysiscited by 23
- 2021When Fair Ranking Meets Uncertain Inferencecited by 22
- 2021Image Cropping on Twitter: Fairness Metrics, their Limitations, and the Importance of Representation, Design, and Agencycited by 22
- 2024Stop! In the Name of Flaws: Disentangling Personal Names and Sociodemographic Attributes in NLPcited by 22
- 2021Problematic Machine Behavior: A Systematic Literature Review of Algorithm Auditscited by 20
- 2022Subgroup Robustness Grows On Trees: An Empirical Baseline Investigationcited by 17
- 2023Ethical Considerations for Responsible Data Curationcited by 17
- 2023Beyond Skin Tone: A Multidimensional Measure of Apparent Skin Colorcited by 17
- 2023Can Fairness be Automated? Guidelines and Opportunities for Fairness-aware AutoMLcited by 16
- 2024The "Colonial Impulse" of Natural Language Processing: An Audit of Bengali Sentiment Analysis Tools and Their Identity-based Biasescited by 16
- 2024Large Language Model Bias Mitigation from the Perspective of Knowledge Editingcited by 16
- 2024Epistemic Injustice in Generative AIcited by 16
50 most cited of 124 All 124 (JSON)
- 2026Fairness Theatre: Evaluating Post-Hoc Fairness Interventions in Vendor-Controlled Early Warning Systems29 Sep 2026
- 2026Abstracted Away: Resisting Alienation and Ungrounded Abstraction in AI Research Communities9 Aug 2026
- 2026Beyond Performance Disparities: A Three-Level Audit of Representational Harm in CelebA14 May 2026
- 2026NLP needs Diversity outside of 'Diversity'16 Apr 2026
- 2026Position: LLMs Must Use Functor-Based and RAG-Driven Bias Mitigation for Fairness7 Mar 2026
- 2026Happy Young Women, Grumpy Old Men? Emotion-Driven Demographic Biases in Synthetic Face Generation18 Jan 2026
- 2025Identifying Bias in Machine-generated Text Detection10 Dec 2025
- 2025Person-Centric Annotations of LAION-400M: Auditing Bias and Its Transfer to Models4 Oct 2025
- 2025Toward Substantive Intersectional Algorithmic Fairness: Desiderata for a Feminist Approach25 Aug 2025
- 2025Bias Amplification in Stable Diffusion's Representation of Stigma Through Skin Tones and Their Homogeneity24 Aug 2025
- 2025Auditing Facial Emotion Recognition Datasets for Posed Expressions and Racial Bias14 Jul 2025
- 2025Tell, Don't Show: Leveraging Language Models' Abstractive Retellings to Model Literary Themes29 May 2025
38 more
- 2025Identities are not Interchangeable: The Problem of Overgeneralization in Fair Machine Learning7 May 2025
- 2025The Case for "Thick Evaluations" of Cultural Representation in AI24 Mar 2025
- 2025Counterfactual Situation Testing: From Single to Multidimensional Discrimination3 Feb 2025
- 2025It's complicated. The relationship of algorithmic fairness and non-discrimination provisions for high-risk systems in the EU AI Act22 Jan 2025
- 2024Beyond Model Interpretability: Socio-Structural Explanations in Machine Learning5 Sep 2024
- 2024Epistemic Injustice in Generative AI21 Aug 2024
- 2024Covert Bias: The Severity of Social Views' Unalignment in Language Models Towards Implicit and Explicit Opinion15 Aug 2024
- 2024Identifying and Mitigating Social Bias Knowledge in Language Models7 Aug 2024
- 2024Position: Measure Dataset Diversity, Don't Just Claim It11 Jul 2024
- 2024They're All Doctors: Synthesizing Diverse Counterfactuals to Mitigate Associative Bias17 Jun 2024
- 2024What is Fair? Defining Fairness in Machine Learning for Health13 Jun 2024
- 2024A Taxonomy of Challenges to Curating Fair Datasets10 Jun 2024
- 2024The Life Cycle of Large Language Models: A Review of Biases in Education3 Jun 2024
- 2024Stop! In the Name of Flaws: Disentangling Personal Names and Sociodemographic Attributes in NLP27 May 2024
- 2024Addressing Discretization-Induced Bias in Demographic Prediction27 May 2024
- 2024Mutatis Mutandis: Revisiting the Comparator in Discrimination Testing22 May 2024
- 2024Large Language Model Bias Mitigation from the Perspective of Knowledge Editing15 May 2024
- 2024Exploring the Human-LLM Synergy in Advancing Theory-driven Qualitative Analysis9 May 2024
- 2024The Psychosocial Impacts of Generative AI Harms2 May 2024
- 2024Mapping the Potential of Explainable AI for Fairness Along the AI Lifecycle29 Apr 2024
- 2024Unlawful Proxy Discrimination: A Framework for Challenging Inherently Discriminatory Algorithms22 Apr 2024
- 2024The Neutrality Fallacy: When Algorithmic Fairness Interventions are (Not) Positive Action18 Apr 2024
- 2024Laissez-Faire Harms: Algorithmic Biases in Generative Language Models11 Apr 2024
- 2024Racial/Ethnic Categories in AI and Algorithmic Fairness: Why They Matter and What They Represent10 Apr 2024
- 2024FairCLIP: Harnessing Fairness in Vision-Language Learning29 Mar 2024
- 2024The Pursuit of Fairness in Artificial Intelligence Models: A Survey26 Mar 2024
- 2024ARTiST: Automated Text Simplification for Task Guidance in Augmented Reality29 Feb 2024
- 2024Discipline and Label: A WEIRD Genealogy and Social Theory of Data Annotation9 Feb 2024
- 2024A New Paradigm for Counterfactual Reasoning in Fairness and Recourse25 Jan 2024
- 2024The "Colonial Impulse" of Natural Language Processing: An Audit of Bengali Sentiment Analysis Tools and Their Identity-based Biases19 Jan 2024
- 2024ViSAGe: A Global-Scale Analysis of Visual Stereotypes in Text-to-Image Generation12 Jan 2024
- 2023Disentangling Perceptions of Offensiveness: Cultural and Moral Correlates11 Dec 2023
- 2023SoUnD Framework: Analyzing (So)cial Representation in (Un)structured (D)ata28 Nov 2023
- 2023Fairness Hacking: The Malicious Practice of Shrouding Unfairness in Algorithms12 Nov 2023
- 2023"One-Size-Fits-All"? Examining Expectations around What Constitute "Fair" or "Good" NLG System Behaviors23 Oct 2023
- 2023CoMPosT: Characterizing and Evaluating Caricature in LLM Simulations17 Oct 2023
- 2023Survey of Social Bias in Vision-Language Models24 Sep 2023
- 2023Beyond Skin Tone: A Multidimensional Measure of Apparent Skin Color10 Sep 2023
50 newest of 124 All 124 (JSON)
- 2023PaLM 2 Technical Reportcited by 1,154
- 2023PaLM 2 Technical Report17 May 2023
- 2023Bias and Fairness in Large Language Models: A Surveycited by 626
- 2021Causal Inference in Natural Language Processing: Estimation, Prediction, Interpretation and Beyondcited by 177
- 2021Understanding and Evaluating Racial Biases in Image Captioningcited by 108
- 2021Re-imagining Algorithmic Fairness in India and Beyondcited by 102
- 2023CoMPosT: Characterizing and Evaluating Caricature in LLM Simulationscited by 94
- 2023NLPositionality: Characterizing Design Biases of Datasets and Modelscited by 91
- 2021Do Datasets Have Politics? Disciplinary Values in Computer Vision Dataset Developmentcited by 85
- 2021A Survey on Bias in Visual Datasetscited by 84
- 2021Towards Measuring Fairness in AI: the Casual Conversations Datasetcited by 80
- 2021A Survey of Race, Racism, and Anti-Racism in NLPcited by 74
- 2024FairCLIP: Harnessing Fairness in Vision-Language Learningcited by 69
- 2022Interactive Model Cards: A Human-Centered Approach to Model Documentationcited by 61
12 most cited of 117 All 117 (JSON)
- 2026Fairness Theatre: Evaluating Post-Hoc Fairness Interventions in Vendor-Controlled Early Warning Systems29 Sep 2026
- 2026Abstracted Away: Resisting Alienation and Ungrounded Abstraction in AI Research Communities9 Aug 2026
- 2026Beyond Performance Disparities: A Three-Level Audit of Representational Harm in CelebA14 May 2026
- 2026NLP needs Diversity outside of 'Diversity'16 Apr 2026
- 2026Position: LLMs Must Use Functor-Based and RAG-Driven Bias Mitigation for Fairness7 Mar 2026
- 2026Happy Young Women, Grumpy Old Men? Emotion-Driven Demographic Biases in Synthetic Face Generation18 Jan 2026
- 2025Identifying Bias in Machine-generated Text Detection10 Dec 2025
- 2025Toward Substantive Intersectional Algorithmic Fairness: Desiderata for a Feminist Approach25 Aug 2025
- 2025Auditing Facial Emotion Recognition Datasets for Posed Expressions and Racial Bias14 Jul 2025
- 2025Tell, Don't Show: Leveraging Language Models' Abstractive Retellings to Model Literary Themes29 May 2025
- 2025Identities are not Interchangeable: The Problem of Overgeneralization in Fair Machine Learning7 May 2025
- 2025The Case for "Thick Evaluations" of Cultural Representation in AI24 Mar 2025
12 newest of 117 All 117 (JSON)