Fairness in representation: quantifying stereotyping as a representational harm
Not on the map. Why?
Abstract (arXiv)
While harms of allocation have been increasingly studied as part of the subfield of algorithmic fairness, harms of representation have received considerably less attention. In this paper, we formalize two notions of stereotyping and show how they manifest in later allocative harms within the machine learning pipeline. We also propose mitigation strategies and demonstrate their effectiveness on synthetic datasets.
Key facts. Cited by 26 papers in the map (data through 7 Oct 2026). First posted on arXiv 28 Jan 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 6; 2022: 6; 2023: 7; 2024: 3; 2025: 3; 2026: 1.
26 papers.
Sort:
- 2021The Values Encoded in Machine Learning Researchcited by 172
- 2021Fairness for Unobserved Characteristics: Insights from Technological Impacts on Queer Communitiescited by 40
- 2021Your fairness may vary: Pretrained language model fairness in toxic text classificationcited by 38
- 2022Measuring Representational Harms in Image Captioningcited by 36
- 2023On The Impact of Machine Learning Randomness on Group Fairnesscited by 26
- 2023Bias and Fairness in Chatbots: An Overviewcited by 20
- 2025Position is Power: System Prompts as a Mechanism of Bias in Large Language Models (LLMs)cited by 19
- 2022The worst of both worlds: A comparative analysis of errors in learning from data in psychology and machine learningcited by 17
- 2022Gender Stereotyping Impact in Facial Expression Recognitioncited by 8
- 2023Fairness and representation in satellite-based poverty maps: Evidence of urban-rural disparities and their impacts on downstream policycited by 7
- 2023An Empirical Investigation into Benchmarking Model Multiplicity for Trustworthy Machine Learning: A Case Study on Image Classificationcited by 7
- 2021Precarity: Modeling the Long Term Effects of Compounded Decisions on Individual Instabilitycited by 5
14 more
- 2021Obstructing Classification via Projectioncited by 5
- 2021Feature-based Individual Fairness in k-Clusteringcited by 4
- 2023Muslim-Violence Bias Persists in Debiased GPT Modelscited by 4
- 2024Measuring Machine Learning Harms from Stereotypes Requires Understanding Who Is Harmed by Which Errors in What Wayscited by 4
- 2022It's Not Fairness, and It's Not Fair: The Failure of Distributional Equality and the Promise of Relational Equality in Complete-Information Hiring Gamescited by 3
- 2023An Investigation of Representation and Allocation Harms in Contrastive Learningcited by 2
- 2023Break Out of a Pigeonhole: A Unified Framework for Examining Miscalibration, Bias, and Stereotype in Recommender Systemscited by 2
- 2024Multi-Group Proportional Representation in Retrievalcited by 2
- 2025Unequal Voices: How LLMs Construct Constrained Queer Narrativescited by 2
- 2022Explainability for identification of vulnerable groups in machine learning modelscited by 1
- 2022Measuring and mitigating voting access disparities: a study of race and polling locations in Florida and North Carolinacited by 1
- 2024Legally Binding but Unfair? Towards Assessing Fairness of Privacy Policiescited by 1
- 2025Mitigation of Gender and Ethnicity Bias in AI-Generated Stories through Model Explanationscited by 1
- 2026Unmasking LAION-5B: Age, Gender, Race, and Emotion Biases in Large-Scale Image Datasetscited by 0
- 2026Unmasking LAION-5B: Age, Gender, Race, and Emotion Biases in Large-Scale Image Datasets22 Jun 2026
- 2025Mitigation of Gender and Ethnicity Bias in AI-Generated Stories through Model Explanations3 Sep 2025
- 2025Unequal Voices: How LLMs Construct Constrained Queer Narratives21 Jul 2025
- 2025Position is Power: System Prompts as a Mechanism of Bias in Large Language Models (LLMs)27 May 2025
- 2024Multi-Group Proportional Representation in Retrieval11 Jul 2024
- 2024Legally Binding but Unfair? Towards Assessing Fairness of Privacy Policies12 Mar 2024
- 2024Measuring Machine Learning Harms from Stereotypes Requires Understanding Who Is Harmed by Which Errors in What Ways6 Feb 2024
- 2023Break Out of a Pigeonhole: A Unified Framework for Examining Miscalibration, Bias, and Stereotype in Recommender Systems29 Dec 2023
- 2023An Empirical Investigation into Benchmarking Model Multiplicity for Trustworthy Machine Learning: A Case Study on Image Classification24 Nov 2023
- 2023Muslim-Violence Bias Persists in Debiased GPT Models25 Oct 2023
- 2023An Investigation of Representation and Allocation Harms in Contrastive Learning2 Oct 2023
- 2023Bias and Fairness in Chatbots: An Overview16 Sep 2023
14 more
- 2023On The Impact of Machine Learning Randomness on Group Fairness9 Jul 2023
- 2023Fairness and representation in satellite-based poverty maps: Evidence of urban-rural disparities and their impacts on downstream policy2 May 2023
- 2022Gender Stereotyping Impact in Facial Expression Recognition11 Oct 2022
- 2022It's Not Fairness, and It's Not Fair: The Failure of Distributional Equality and the Promise of Relational Equality in Complete-Information Hiring Games12 Sep 2022
- 2022Measuring Representational Harms in Image Captioning14 Jun 2022
- 2022Measuring and mitigating voting access disparities: a study of race and polling locations in Florida and North Carolina30 May 2022
- 2022The worst of both worlds: A comparative analysis of errors in learning from data in psychology and machine learning12 Mar 2022
- 2022Explainability for identification of vulnerable groups in machine learning models1 Mar 2022
- 2021Feature-based Individual Fairness in k-Clustering9 Sep 2021
- 2021Your fairness may vary: Pretrained language model fairness in toxic text classification3 Aug 2021
- 2021The Values Encoded in Machine Learning Research29 Jun 2021
- 2021Obstructing Classification via Projection19 May 2021
- 2021Precarity: Modeling the Long Term Effects of Compounded Decisions on Individual Instability24 Apr 2021
- 2021Fairness for Unobserved Characteristics: Insights from Technological Impacts on Queer Communities3 Feb 2021
- 2021The Values Encoded in Machine Learning Researchcited by 172
- 2021Fairness for Unobserved Characteristics: Insights from Technological Impacts on Queer Communitiescited by 40
- 2021Your fairness may vary: Pretrained language model fairness in toxic text classificationcited by 38
- 2022Measuring Representational Harms in Image Captioningcited by 36
- 2023On The Impact of Machine Learning Randomness on Group Fairnesscited by 26
- 2023Bias and Fairness in Chatbots: An Overviewcited by 20
- 2025Position is Power: System Prompts as a Mechanism of Bias in Large Language Models (LLMs)cited by 19
- 2022The worst of both worlds: A comparative analysis of errors in learning from data in psychology and machine learningcited by 17
- 2022Gender Stereotyping Impact in Facial Expression Recognitioncited by 8
- 2023Fairness and representation in satellite-based poverty maps: Evidence of urban-rural disparities and their impacts on downstream policycited by 7
- 2023An Empirical Investigation into Benchmarking Model Multiplicity for Trustworthy Machine Learning: A Case Study on Image Classificationcited by 7
- 2021Precarity: Modeling the Long Term Effects of Compounded Decisions on Individual Instabilitycited by 5
12 most cited of 26 All 26 (JSON)
- 2026Unmasking LAION-5B: Age, Gender, Race, and Emotion Biases in Large-Scale Image Datasets22 Jun 2026
- 2025Mitigation of Gender and Ethnicity Bias in AI-Generated Stories through Model Explanations3 Sep 2025
- 2025Unequal Voices: How LLMs Construct Constrained Queer Narratives21 Jul 2025
- 2025Position is Power: System Prompts as a Mechanism of Bias in Large Language Models (LLMs)27 May 2025
- 2024Multi-Group Proportional Representation in Retrieval11 Jul 2024
- 2024Legally Binding but Unfair? Towards Assessing Fairness of Privacy Policies12 Mar 2024
- 2024Measuring Machine Learning Harms from Stereotypes Requires Understanding Who Is Harmed by Which Errors in What Ways6 Feb 2024
- 2023Break Out of a Pigeonhole: A Unified Framework for Examining Miscalibration, Bias, and Stereotype in Recommender Systems29 Dec 2023
- 2023An Empirical Investigation into Benchmarking Model Multiplicity for Trustworthy Machine Learning: A Case Study on Image Classification24 Nov 2023
- 2023Muslim-Violence Bias Persists in Debiased GPT Models25 Oct 2023
- 2023An Investigation of Representation and Allocation Harms in Contrastive Learning2 Oct 2023
- 2023Bias and Fairness in Chatbots: An Overview16 Sep 2023
12 newest of 26 All 26 (JSON)