mlsanityData to 14 Oct 2026

Can we Debias Social Stereotypes in AI-Generated Images? Examining Text-to-Image Outputs and User Perceptions

arXiv 2505.20692 ↗First posted 27 May 2025cs.HC cs.AI cs.CLcited by 6

Not on the map. Why?

Abstract (arXiv)

Recent advances in generative AI have enabled visual content creation through text-to-image (T2I) generation. However, despite their creative potential, T2I models often replicate and amplify societal stereotypes -- particularly those related to gender, race, and culture -- raising important ethical concerns. This paper proposes a theory-driven bias detection rubric and a Social Stereotype Index (SSI) to systematically evaluate social biases in T2I outputs. We audited three major T2I model outputs -- DALL-E-3, Midjourney-6.1, and Stability AI Core -- using 100 queries across three categories -- geocultural, occupational, and adjectival. Our analysis reveals that initial outputs are prone to include stereotypical visual cues, including gendered professions, cultural markers, and western beauty norms. To address this, we adopted our rubric to conduct targeted prompt refinement using LLMs, which significantly reduced bias -- SSI dropped by 61% for geocultural, 69% for occupational, and 51% for adjectival queries. We complemented our quantitative analysis through a user study examining perceptions, awareness, and preferences around AI-generated biased imagery. Our findings reveal a key tension -- although prompt refinement can mitigate stereotypes, it can limit contextual alignment. Interestingly, users often perceived stereotypical images to be more aligned with their expectations. We discuss the need to balance ethical debiasing with contextual relevance and call for T2I systems that support global diversity and inclusivity while not compromising the reflection of real-world social complexity.

Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 33 of its 73 references that are in the map. First posted on arXiv 27 May 2025.

Builds on

33 of 73 references.

References · 33

  1. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
  2. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
  3. 2019A Survey on Bias and Fairness in Machine Learningcited by 1,917
  4. 2018Datasheets for Datasetscited by 1,386
  5. 2018Model Cards for Model Reportingcited by 1,080
  6. 2020Closing the AI Accountability Gap: Defining an End-to-End Framework for Internal Algorithmic Auditingcited by 384
  7. 2022Easily Accessible Text-to-Image Generation Amplifies Demographic Stereotypes at Large Scalecited by 262
  8. 2020Questioning the AI: Informing Design Practices for Explainable AI User Experiencescited by 253
  9. 2023Stable Bias: Analyzing Societal Representations in Diffusion Modelscited by 226
  10. 2023Social Biases through the Text-to-Image Generation Lenscited by 127
  11. 2024BetterBench: Assessing AI Benchmarks, Uncovering Issues, and Establishing Best Practicescited by 114
  12. 2019Explainability Fact Sheets: A Framework for Systematic Assessment of Explainable Approachescited by 101
21 more
  1. 2023Finetuning Text-to-Image Diffusion Models for Fairnesscited by 92
  2. 2018Fairness and Accountability Design Needs for Algorithmic Support in High-Stakes Public Sector Decision-Makingcited by 67
  3. 2024Survey of Bias In Text-to-Image Generation: Definition, Evaluation, and Mitigationcited by 66
  4. 2021Assessing the Fairness of AI Systems: AI Practitioners' Processes, Challenges, and Needs for Supportcited by 63
  5. 2022How Different Groups Prioritize Ethical Values for Responsible AIcited by 49
  6. 2023Charting the Sociotechnical Gap in Explainable AI: A Framework to Address the Gap in XAIcited by 33
  7. 2022A Validity Perspective on Evaluating the Justified Use of Data-driven Decision-making Algorithmscited by 30
  8. 2023It Takes Two to Tango: Navigating Conceptualizations of NLP Tasks and Measurements of Performancecited by 26
  9. 2020Overcoming Failures of Imagination in AI Infused System Development and Deploymentcited by 22
  10. 2023Multimodal Composite Association Score: Measuring Gender Bias in Generative Multimodal Modelscited by 21
  11. 2024SCoFT: Self-Contrastive Fine-Tuning for Equitable Image Generationcited by 19
  12. 2019Implicit Diversity in Image Summarizationcited by 18
  13. 2019Female Librarians and Male Computer Programmers? Gender Bias in Occupational Images on Digital Media Platformscited by 13
  14. 2023Sensing Wellbeing in the Workplace, Why and For Whom? Envisioning Impacts with Organizational Stakeholderscited by 13
  15. 2024Interpretations, Representations, and Stereotypes of Caste within Text-to-Image Generatorscited by 10
  16. 2023Analysing Gender Bias in Text-to-Image Models using Object Detectioncited by 7
  17. 2024The Male CEO and the Female Assistant: Evaluation and Mitigation of Gender Biases in Text-To-Image Generation of Dual Subjectscited by 6
  18. 2024Breaking the Global North Stereotype: A Global South-centric Benchmark Dataset for Auditing and Mitigating Biases in Facial Recognition Systemscited by 3
  19. 2016Identifying Stereotypes in the Online Perception of Physical Attractivenesscited by 1
  20. 2016Stereotypes in Search Engine Results: Understanding The Role of Local and Global Factorscited by 1
  21. 2024DiffInject: Revisiting Debias via Synthetic Data Generation using Diffusion-based Style Injectioncited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 2; 2026: 4.

6 papers.