Stereotyping and Bias in the Flickr30K Dataset
Not on the map. Why?
Abstract (arXiv)
An untested assumption behind the crowdsourced descriptions of the images in the Flickr30K dataset (Young et al., 2014) is that they "focus only on the information that can be obtained from the image alone" (Hodosh et al., 2013, p. 859). This paper presents some evidence against this assumption, and provides a list of biases and unwarranted inferences that can be found in the Flickr30K dataset. Finally, it considers methods to find examples of these, and discusses how we should deal with stereotype-driven descriptions in future applications.
Key facts. Cited by 25 papers in the map (data through 7 Oct 2026). First posted on arXiv 19 May 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 5; 2022: 4; 2023: 7; 2024: 6; 2025: 2; 2026: 1.
25 papers.
Sort:
By area:
- 2021Understanding and Evaluating Racial Biases in Image Captioningcited by 108
- 2021PASS: An ImageNet replacement for self-supervised pretraining without humanscited by 51
- 2023Uncurated Image-Text Datasets: Shedding Light on Demographic Biascited by 51
- 2024A Decade's Battle on Dataset Bias: Are We There Yet?cited by 46
- 2022Gender Artifacts in Visual Datasetscited by 38
- 2022Measuring Representational Harms in Image Captioningcited by 36
- 2021The World of an Octopus: How Reporting Bias Influences a Language Model's Perception of Colorcited by 32
- 2022Underspecification in Scene Description-to-Depiction Taskscited by 30
- 2021Dimensions of Commonsense Knowledgecited by 29
- 2023Balancing the Picture: Debiasing Vision-Language Datasets with Synthetic Contrast Setscited by 27
- 2023Survey of Social Bias in Vision-Language Modelscited by 26
- 2023A Friendly Face: Do Text-to-Image Systems Rely on Stereotypes when the Input is Under-Specified?cited by 25
13 more
- 2024Understanding Bias in Large-Scale Visual Datasetscited by 15
- 2021Computer Vision and Conflicting Values: Describing People with Automated Alt Textcited by 14
- 2024Fairness and Bias Mitigation in Computer Vision: A Surveycited by 12
- 2022Simplicity Bias Leads to Amplified Performance Disparitiescited by 11
- 2023Evaluating Bias and Fairness in Gender-Neutral Pretrained Vision-and-Language Modelscited by 6
- 2023Fairness in AI Systems: Mitigating gender bias from language-vision modelscited by 5
- 2024Quantifying the Gaps Between Translation and Native Perception in Training for Multimodal, Multilingual Retrievalcited by 5
- 2024Measuring Machine Learning Harms from Stereotypes Requires Understanding Who Is Harmed by Which Errors in What Wayscited by 4
- 2023Impressions: Understanding Visual Semiotics and Aesthetic Impactcited by 3
- 2025Attention IoU: Examining Biases in CelebA using Attention Mapscited by 3
- 2025Understanding Gender Bias in AI-Generated Product Descriptionscited by 2
- 2024Common-Sense Bias Modeling for Classification Taskscited by 1
- 2026Personalized Generative Models for Contextual Debiasingcited by 0
- 2026Personalized Generative Models for Contextual Debiasing25 May 2026
- 2025Understanding Gender Bias in AI-Generated Product Descriptions3 Jun 2025
- 2025Attention IoU: Examining Biases in CelebA using Attention Maps25 Mar 2025
- 2024Understanding Bias in Large-Scale Visual Datasets2 Dec 2024
- 2024Quantifying the Gaps Between Translation and Native Perception in Training for Multimodal, Multilingual Retrieval2 Oct 2024
- 2024Fairness and Bias Mitigation in Computer Vision: A Survey5 Aug 2024
- 2024A Decade's Battle on Dataset Bias: Are We There Yet?13 Mar 2024
- 2024Measuring Machine Learning Harms from Stereotypes Requires Understanding Who Is Harmed by Which Errors in What Ways6 Feb 2024
- 2024Common-Sense Bias Modeling for Classification Tasks24 Jan 2024
- 2023Impressions: Understanding Visual Semiotics and Aesthetic Impact27 Oct 2023
- 2023Evaluating Bias and Fairness in Gender-Neutral Pretrained Vision-and-Language Models26 Oct 2023
- 2023Survey of Social Bias in Vision-Language Models24 Sep 2023
13 more
- 2023Balancing the Picture: Debiasing Vision-Language Datasets with Synthetic Contrast Sets24 May 2023
- 2023Fairness in AI Systems: Mitigating gender bias from language-vision models3 May 2023
- 2023Uncurated Image-Text Datasets: Shedding Light on Demographic Bias6 Apr 2023
- 2023A Friendly Face: Do Text-to-Image Systems Rely on Stereotypes when the Input is Under-Specified?14 Feb 2023
- 2022Simplicity Bias Leads to Amplified Performance Disparities13 Dec 2022
- 2022Underspecification in Scene Description-to-Depiction Tasks11 Oct 2022
- 2022Gender Artifacts in Visual Datasets18 Jun 2022
- 2022Measuring Representational Harms in Image Captioning14 Jun 2022
- 2021The World of an Octopus: How Reporting Bias Influences a Language Model's Perception of Color15 Oct 2021
- 2021PASS: An ImageNet replacement for self-supervised pretraining without humans27 Sep 2021
- 2021Understanding and Evaluating Racial Biases in Image Captioning16 Jun 2021
- 2021Computer Vision and Conflicting Values: Describing People with Automated Alt Text26 May 2021
- 2021Dimensions of Commonsense Knowledge12 Jan 2021
- 2021Understanding and Evaluating Racial Biases in Image Captioningcited by 108
- 2021PASS: An ImageNet replacement for self-supervised pretraining without humanscited by 51
- 2023Uncurated Image-Text Datasets: Shedding Light on Demographic Biascited by 51
- 2024A Decade's Battle on Dataset Bias: Are We There Yet?cited by 46
- 2022Gender Artifacts in Visual Datasetscited by 38
- 2022Measuring Representational Harms in Image Captioningcited by 36
- 2021The World of an Octopus: How Reporting Bias Influences a Language Model's Perception of Colorcited by 32
- 2022Underspecification in Scene Description-to-Depiction Taskscited by 30
- 2021Dimensions of Commonsense Knowledgecited by 29
- 2023A Friendly Face: Do Text-to-Image Systems Rely on Stereotypes when the Input is Under-Specified?cited by 25
- 2024Understanding Bias in Large-Scale Visual Datasetscited by 15
- 2021Computer Vision and Conflicting Values: Describing People with Automated Alt Textcited by 14
12 most cited of 22 All 22 (JSON)
- 2026Personalized Generative Models for Contextual Debiasing25 May 2026
- 2025Understanding Gender Bias in AI-Generated Product Descriptions3 Jun 2025
- 2025Attention IoU: Examining Biases in CelebA using Attention Maps25 Mar 2025
- 2024Understanding Bias in Large-Scale Visual Datasets2 Dec 2024
- 2024Fairness and Bias Mitigation in Computer Vision: A Survey5 Aug 2024
- 2024A Decade's Battle on Dataset Bias: Are We There Yet?13 Mar 2024
- 2024Measuring Machine Learning Harms from Stereotypes Requires Understanding Who Is Harmed by Which Errors in What Ways6 Feb 2024
- 2024Common-Sense Bias Modeling for Classification Tasks24 Jan 2024
- 2023Impressions: Understanding Visual Semiotics and Aesthetic Impact27 Oct 2023
- 2023Evaluating Bias and Fairness in Gender-Neutral Pretrained Vision-and-Language Models26 Oct 2023
- 2023Fairness in AI Systems: Mitigating gender bias from language-vision models3 May 2023
- 2023Uncurated Image-Text Datasets: Shedding Light on Demographic Bias6 Apr 2023
12 newest of 22 All 22 (JSON)