When Cars Have Stereotypes: Auditing Demographic Bias in Objects from Text-to-Image Models
Not on the map. Why?
Abstract (arXiv)
While prior research on text-to-image generation has predominantly focused on biases in human depictions, demographic bias in generated objects remains relatively underexplored. We introduce SODA (Stereotyped Object Diagnostic Audit), a novel framework for systematically measuring these biases through automated attribute discovery and three standardized metrics: Base vs. Demographic Divergence (BDS), Cross-Demographic Disparity (CDS), and Visual Attribute Concentration (VAC). Applying SODA to 8,000 images across five state-of-the-art models and eight object categories (e.g., cars), we find that "neutral" prompts produce outputs most visually similar to middle-aged and White people, suggesting these groups are implicitly over-represented in model defaults. Furthermore, demographic cues trigger highly skewed stereotypical outputs: 26.6% of object-model-demographic combinations produce results where all 20 generated images share the exact same attribute value (e.g., rose gold laptops for women). Finally, prompt-level debiasing reduces inter-group disparity but paradoxically collapses within-group diversity, replacing one stereotype with another. SODA offers a practical pipeline for making these implicit associations measurable, serving as a step toward more responsible AI development.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 34 of its 50 references that are in the map. First posted on arXiv 5 Aug 2025.
Builds on
34 of 50 references.
References · 34
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
- 2021Zero-Shot Text-to-Image Generationcited by 4,276
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2018UMAP: Uniform Manifold Approximation and Projection for Dimension Reductioncited by 2,841
- 2025Qwen-Image Technical Reportcited by 973
- 2018Improving fairness in machine learning systems: What do industry practitioners need?cited by 262
- 2022Easily Accessible Text-to-Image Generation Amplifies Demographic Stereotypes at Large Scalecited by 262
- 2022DALL-Eval: Probing the Reasoning Skills and Social Biases of Text-to-Image Generation Modelscited by 230
- 2023Social Biases through the Text-to-Image Generation Lenscited by 126
22 more
- 2020Image Representations Learned With Unsupervised Pre-Training Contain Human-like Biasescited by 107
- 2022The Creativity of Text-to-Image Generationcited by 73
- 2023The Bias Amplification Paradox in Text-to-Image Generationcited by 69
- 2024Survey of Bias In Text-to-Image Generation: Definition, Evaluation, and Mitigationcited by 66
- 2024OpenBias: Open-set Bias Detection in Text-to-Image Generative Modelscited by 61
- 2021Directional Bias Amplificationcited by 54
- 2023VisoGender: A dataset for benchmarking gender bias in image-text pronoun resolutioncited by 52
- 2023TIBET: Identifying and Evaluating Biases in Text-to-Image Generative Modelscited by 51
- 2023Inspecting the Geographical Representativeness of Images from Text-to-Image Modelscited by 44
- 2023T2IAT: Measuring Valence and Stereotypical Biases in Text-to-Image Generationcited by 39
- 2023'Person' == Light-skinned, Western Man, and Sexualization of Women of Color: Stereotypes in Stable Diffusioncited by 33
- 2024GenderBias-VL: Benchmarking Gender Bias in Vision Language Models via Counterfactual Probingcited by 31
- 2023Stable Diffusion Exposed: Gender Bias from Prompt to Imagecited by 25
- 2023Attribute-Centric Compositional Text-to-Image Generationcited by 19
- 2025Whose View of Safety? A Deep DIVE Dataset for Pluralistic Alignment of Text-to-Image Modelscited by 11
- 2023DIG In: Evaluating Disparities in Image Generations with Indicators for Geographic Diversitycited by 9
- 2025Exploring Bias in over 100 Text-to-Image Generative Modelscited by 9
- 2023Analysing Gender Bias in Text-to-Image Models using Object Detectioncited by 7
- 2025Can we Debias Social Stereotypes in AI-Generated Images? Examining Text-to-Image Outputs and User Perceptionscited by 6
- 2024Type-R: Automatically Retouching Typos for Text-to-Image Generationcited by 5
- 2025Implicit Bias Injection Attacks against Text-to-Image Diffusion Modelscited by 4
- 2025FairSense-AI: Responsible AI Meets Sustainabilitycited by 1
Built on by
Not cited yet.