Beyond "Fairness:" Structural (In)justice Lenses on AI for Education
Not on the map. Why?
Abstract (arXiv)
Educational technologies, and the systems of schooling in which they are deployed, enact particular ideologies about what is important to know and how learners should learn. As artificial intelligence technologies -- in education and beyond -- may contribute to inequitable outcomes for marginalized communities, various approaches have been developed to evaluate and mitigate the harmful impacts of AI. However, we argue in this paper that the dominant paradigm of evaluating fairness on the basis of performance disparities in AI models is inadequate for confronting the systemic inequities that educational AI systems (re)produce. We draw on a lens of structural injustice informed by critical theory and Black feminist scholarship to critically interrogate several widely-studied and widely-adopted categories of educational AI and explore how they are bound up in and reproduce historical legacies of structural injustice and inequity, regardless of the parity of their models' performance. We close with alternative visions for a more equitable future for educational AI.
Key facts. Cited by 12 papers in the map (data through 7 Oct 2026). Builds on 22 of its 214 references that are in the map. First posted on arXiv 18 May 2021.
Builds on
22 of 214 references.
References · 22
- 2016Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddingscited by 1,304
- 2020Language (Technology) is Power: A Critical Survey of "Bias" in NLPcited by 951
- 2016Fair prediction with disparate impact: A study of bias in recidivism prediction instrumentscited by 671
- 2018A Reductions Approach to Fair Classificationcited by 585
- 2016Inherent Trade-Offs in the Fair Determination of Risk Scorescited by 582
- 2015Deep Knowledge Tracingcited by 328
- 2018Improving fairness in machine learning systems: What do industry practitioners need?cited by 262
- 2019Racial Bias in Hate Speech and Abusive Language Detection Datasetscited by 208
- 2019Mitigating Bias in Algorithmic Hiring: Evaluating Claims and Practicescited by 170
- 2019Towards a Critical Race Methodology in Algorithmic Fairnesscited by 124
- 2020Participation is not a Design Fix for Machine Learningcited by 110
- 2021Re-imagining Algorithmic Fairness in India and Beyondcited by 102
10 more
- 201850 Years of Test (Un)fairness: Lessons for Machine Learningcited by 101
- 2020Decolonial AI: Decolonial Theory as Sociotechnical Foresight in Artificial Intelligencecited by 100
- 2019Problem Formulation and Fairnesscited by 85
- 2018Online Learning with an Unknown Fairness Metriccited by 61
- 2018Fairness Through Computationally-Bounded Awarenesscited by 55
- 2020Algorithmic Fairness in Educationcited by 44
- 2018Data Science as Political Action: Grounding Data Science in a Politics of Justicecited by 14
- 2020What If I Don't Like Any Of The Choices? The Limits of Preference Elicitation for Participatory Algorithm Designcited by 14
- 2020Evaluation of Fairness Trade-offs in Predicting Student Successcited by 10
- 2019Human-Computer Insurrection: Notes on an Anarchist HCIcited by 7
Built on by
Citing papers per year: 2021: 1; 2022: 2; 2023: 0; 2024: 4; 2025: 1; 2026: 4.
12 papers.
- 2022The NCTE Transcripts: A Dataset of Elementary Math Classroom Transcriptscited by 43
- 2025DrawEduMath: Evaluating Vision Language Models with Expert-Annotated Students' Hand-Drawn Math Imagescited by 17
- 2024The Ethics of AI in Educationcited by 7
- 2021Risks of AI Foundation Models in Educationcited by 6
- 2024Navigating the Landscape of Hint Generation Research: From the Past to the Futurecited by 6
- 2024Multi-stakeholder Perspective on Responsible Artificial Intelligence and Acceptability in Educationcited by 2
- 2024A Manifesto for a Pro-Actively Responsible AI in Educationcited by 2
- 2026Knowledge without Wisdom: Measuring Misalignment between LLMs and Intended Impactcited by 2
- 2022Lost in Translation: Reimagining the Machine Learning Life Cycle in Educationcited by 1
- 2026Equity Bias: An Ethical Framework for AI Designcited by 0
- 2026Cripping AI: Reimagining AI Through Lived Disability Experiencescited by 0
- 2026Quality-Conditioned Agreement in Automated Short Answer Scoring: Mid-Range Degradation and the Impact of Task-Specific Adaptationcited by 0
- 2026Quality-Conditioned Agreement in Automated Short Answer Scoring: Mid-Range Degradation and the Impact of Task-Specific Adaptation8 May 2026
- 2026Cripping AI: Reimagining AI Through Lived Disability Experiences3 May 2026
- 2026Knowledge without Wisdom: Measuring Misalignment between LLMs and Intended Impact1 Mar 2026
- 2026Equity Bias: An Ethical Framework for AI Design28 Jan 2026
- 2025DrawEduMath: Evaluating Vision Language Models with Expert-Annotated Students' Hand-Drawn Math Images24 Jan 2025
- 2024A Manifesto for a Pro-Actively Responsible AI in Education3 May 2024
- 2024Navigating the Landscape of Hint Generation Research: From the Past to the Future6 Apr 2024
- 2024The Ethics of AI in Education22 Mar 2024
- 2024Multi-stakeholder Perspective on Responsible Artificial Intelligence and Acceptability in Education22 Feb 2024
- 2022The NCTE Transcripts: A Dataset of Elementary Math Classroom Transcripts21 Nov 2022
- 2022Lost in Translation: Reimagining the Machine Learning Life Cycle in Education8 Sep 2022
- 2021Risks of AI Foundation Models in Education19 Oct 2021