Hidden Bias in the Machine: Stereotypes in Text-to-Image Models
Not on the map. Why?
Abstract (arXiv)
Text-to-Image (T2I) models have transformed visual content creation, producing highly realistic images from natural language prompts. However, concerns persist around their potential to replicate and magnify existing societal biases. To investigate these issues, we curated a diverse set of prompts spanning thematic categories such as occupations, traits, actions, ideologies, emotions, family roles, place descriptions, spirituality, and life events. For each of the 160 unique topics, we crafted multiple prompt variations to reflect a wide range of meanings and perspectives. Using Stable Diffusion 1.5 (UNet-based) and Flux-1 (DiT-based) models with original checkpoints, we generated over 16,000 images under consistent settings. Additionally, we collected 8,000 comparison images from Google Image Search. All outputs were filtered to exclude abstract, distorted, or nonsensical results. Our analysis reveals significant disparities in the representation of gender, race, age, somatotype, and other human-centric factors across generated images. These disparities often mirror and reinforce harmful stereotypes embedded in societal narratives. We discuss the implications of these findings and emphasize the need for more inclusive datasets and development practices to foster fairness in generative visual systems.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 16 of its 26 references that are in the map. First posted on arXiv 9 Jun 2025.
Builds on
16 of 26 references.
References · 16
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
- 2021LAION-400M: Open Dataset of CLIP-Filtered 400 Million Image-Text Pairscited by 1,555
- 2023PixArt-α: Fast Training of Diffusion Transformer for Photorealistic Text-to-Image Synthesiscited by 864
- 2024Fast High-Resolution Image Synthesis with Latent Adversarial Diffusion Distillationcited by 279
- 2022Imagen Editor and EditBench: Advancing and Evaluating Text-Guided Image Inpaintingcited by 233
- 2022DALL-Eval: Probing the Reasoning Skills and Social Biases of Text-to-Image Generation Modelscited by 230
- 2023Stable Bias: Analyzing Societal Representations in Diffusion Modelscited by 226
- 2022SINE: SINgle Image Editing with Text-to-Image Diffusion Modelscited by 159
- 2023Social Biases through the Text-to-Image Generation Lenscited by 127
- 2024Survey of Bias In Text-to-Image Generation: Definition, Evaluation, and Mitigationcited by 66
- 2017Look, Imagine and Match: Improving Textual-Visual Cross-Modal Retrieval with Generative Modelscited by 53
- 2023TIBET: Identifying and Evaluating Biases in Text-to-Image Generative Modelscited by 52
4 more
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2022Easily Accessible Text-to-Image Generation Amplifies Demographic Stereotypes at Large Scale
- 2023Word-Level Explanations for Analyzing Bias in Text-to-Image Models
- 2025Do Existing Testing Tools Really Uncover Gender Bias in Text-to-Image Models?
- 2025Prompting Away Stereotypes? Evaluating Bias in Text-to-Image Models for Occupations
- 2026Newer Is Not Fairer: Gender Stereotyping in Text-to-Image AI Across Model Generations
- 2024Identifying Implicit Social Biases in Vision-Language Models
- 2026BAFIS: Dataset + Framework to assess occupational Bias and Human Preference in modern Text-to-image Models
- 2025Exposing Hidden Biases in Text-to-Image Models via Automated Prompt Search