Bias in Generative AI
Not on the map. Why?
Abstract (arXiv)
This study analyzed images generated by three popular generative artificial intelligence (AI) tools - Midjourney, Stable Diffusion, and DALLE 2 - representing various occupations to investigate potential bias in AI generators. Our analysis revealed two overarching areas of concern in these AI generators, including (1) systematic gender and racial biases, and (2) subtle biases in facial expressions and appearances. Firstly, we found that all three AI generators exhibited bias against women and African Americans. Moreover, we found that the evident gender and racial biases uncovered in our analysis were even more pronounced than the status quo when compared to labor force statistics or Google images, intensifying the harmful biases we are actively striving to rectify in our society. Secondly, our study uncovered more nuanced prejudices in the portrayal of emotions and appearances. For example, women were depicted as younger with more smiles and happiness, while men were depicted as older with more neutral expressions and anger, posing a risk that generative AI models may unintentionally depict women as more submissive and less competent than men. Such nuanced biases, by their less overt nature, might be more problematic as they can permeate perceptions unconsciously and may be more difficult to rectify. Although the extent of bias varied depending on the model, the direction of bias remained consistent in both commercial and open-source AI generators. As these tools become commonplace, our study highlights the urgency to identify and mitigate various biases in generative AI, reinforcing the commitment to ensuring that AI technologies benefit all of humanity for a more inclusive future.
Key facts. Cited by 19 papers in the map (data through 7 Oct 2026). Builds on 1 of its 23 references that are in the map. First posted on arXiv 5 Mar 2024.
Builds on
1 of 23 references.
References · 1
Built on by
Citing papers per year: 2024: 5; 2025: 11; 2026: 3.
19 papers.
Sort:
By area:
- 2024Is Sora a World Simulator? A Comprehensive Survey on General World Models and Beyondcited by 111
- 2024Transforming Teachers' Roles and Agencies in the Era of Generative AI: Perceptions, Acceptance, Knowledge, and Practicescited by 8
- 2025Variance reduction in output from generative AIcited by 6
- 2025LACONIC: A 3D Layout Adapter for Controllable Image Creationcited by 6
- 2024Towards Effective Discrimination Testing for Generative AIcited by 5
- 2025Interpersonal Theory of Suicide as a Lens to Examine Suicidal Ideation in Online Spacescited by 5
- 2024FairSkin: Fair Diffusion for Skin Disease Image Generationcited by 4
- 2025Do LLMs have a Gender (Entropy) Bias?cited by 2
- 2025Assessing instructor-AI cooperation for grading essay-type questions in an introductory sociology coursecited by 1
- 2025CraftGraffiti: Exploring Human Identity with Custom Graffiti Art via Facial-Preserving Diffusion Modelscited by 1
- 2025From Symptoms to Systems: An Expert-Guided Approach to Understanding Risks of Generative AI for Eating Disorderscited by 1
- 2026HoloFair: Unified T2I Fairness Evaluation and Fair-GRPO Debiasingcited by 1
7 more
- 2024Attention Shift: Steering AI Away from Unsafe Contentcited by 0
- 2025Trust, Experience, and Innovation: Key Factors Shaping American Attitudes About AIcited by 0
- 2025Using complex prompts to identify fine-grained biases in image generation through ChatGPT-4ocited by 0
- 2025The Rise of the Knowledge Sculptor: A New Archetype for Knowledge Work in the Age of Generative AIcited by 0
- 2025Designing and Generating Diverse, Equitable Face Image Datasets for Face Verification Taskscited by 0
- 2026Can Generative Artificial Intelligence Survive Data Contamination? Theoretical Guarantees under Contaminated Recursive Trainingcited by 0
- 2026Practical Judgment, Virtue, and Intuition in the Use of Opaque AI-Enabled Systemscited by 0
- 2026Practical Judgment, Virtue, and Intuition in the Use of Opaque AI-Enabled Systems14 Jul 2026
- 2026HoloFair: Unified T2I Fairness Evaluation and Fair-GRPO Debiasing23 May 2026
- 2026Can Generative Artificial Intelligence Survive Data Contamination? Theoretical Guarantees under Contaminated Recursive Training17 Feb 2026
- 2025From Symptoms to Systems: An Expert-Guided Approach to Understanding Risks of Generative AI for Eating Disorders4 Dec 2025
- 2025Designing and Generating Diverse, Equitable Face Image Datasets for Face Verification Tasks21 Nov 2025
- 2025The Rise of the Knowledge Sculptor: A New Archetype for Knowledge Work in the Age of Generative AI9 Oct 2025
- 2025CraftGraffiti: Exploring Human Identity with Custom Graffiti Art via Facial-Preserving Diffusion Models28 Aug 2025
- 2025LACONIC: A 3D Layout Adapter for Controllable Image Creation4 Jul 2025
- 2025Do LLMs have a Gender (Entropy) Bias?24 May 2025
- 2025Interpersonal Theory of Suicide as a Lens to Examine Suicidal Ideation in Online Spaces17 Apr 2025
- 2025Using complex prompts to identify fine-grained biases in image generation through ChatGPT-4o1 Apr 2025
- 2025Trust, Experience, and Innovation: Key Factors Shaping American Attitudes About AI4 Mar 2025
7 more
- 2025Variance reduction in output from generative AI2 Mar 2025
- 2025Assessing instructor-AI cooperation for grading essay-type questions in an introductory sociology course11 Jan 2025
- 2024Towards Effective Discrimination Testing for Generative AI30 Dec 2024
- 2024FairSkin: Fair Diffusion for Skin Disease Image Generation29 Oct 2024
- 2024Attention Shift: Steering AI Away from Unsafe Content6 Oct 2024
- 2024Transforming Teachers' Roles and Agencies in the Era of Generative AI: Perceptions, Acceptance, Knowledge, and Practices3 Oct 2024
- 2024Is Sora a World Simulator? A Comprehensive Survey on General World Models and Beyond6 May 2024
- 2024Attention Shift: Steering AI Away from Unsafe Contentcited by 0
- 2024Attention Shift: Steering AI Away from Unsafe Content6 Oct 2024
- 2024Transforming Teachers' Roles and Agencies in the Era of Generative AI: Perceptions, Acceptance, Knowledge, and Practicescited by 8
- 2025Variance reduction in output from generative AIcited by 6
- 2025LACONIC: A 3D Layout Adapter for Controllable Image Creationcited by 6
- 2024Towards Effective Discrimination Testing for Generative AIcited by 5
- 2025Interpersonal Theory of Suicide as a Lens to Examine Suicidal Ideation in Online Spacescited by 5
- 2024FairSkin: Fair Diffusion for Skin Disease Image Generationcited by 4
- 2025Do LLMs have a Gender (Entropy) Bias?cited by 2
- 2025Assessing instructor-AI cooperation for grading essay-type questions in an introductory sociology coursecited by 1
- 2025From Symptoms to Systems: An Expert-Guided Approach to Understanding Risks of Generative AI for Eating Disorderscited by 1
- 2025Trust, Experience, and Innovation: Key Factors Shaping American Attitudes About AIcited by 0
- 2025Using complex prompts to identify fine-grained biases in image generation through ChatGPT-4ocited by 0
- 2025The Rise of the Knowledge Sculptor: A New Archetype for Knowledge Work in the Age of Generative AIcited by 0
12 most cited of 15 All 15 (JSON)
- 2026Practical Judgment, Virtue, and Intuition in the Use of Opaque AI-Enabled Systems14 Jul 2026
- 2026Can Generative Artificial Intelligence Survive Data Contamination? Theoretical Guarantees under Contaminated Recursive Training17 Feb 2026
- 2025From Symptoms to Systems: An Expert-Guided Approach to Understanding Risks of Generative AI for Eating Disorders4 Dec 2025
- 2025Designing and Generating Diverse, Equitable Face Image Datasets for Face Verification Tasks21 Nov 2025
- 2025The Rise of the Knowledge Sculptor: A New Archetype for Knowledge Work in the Age of Generative AI9 Oct 2025
- 2025LACONIC: A 3D Layout Adapter for Controllable Image Creation4 Jul 2025
- 2025Do LLMs have a Gender (Entropy) Bias?24 May 2025
- 2025Interpersonal Theory of Suicide as a Lens to Examine Suicidal Ideation in Online Spaces17 Apr 2025
- 2025Using complex prompts to identify fine-grained biases in image generation through ChatGPT-4o1 Apr 2025
- 2025Trust, Experience, and Innovation: Key Factors Shaping American Attitudes About AI4 Mar 2025
- 2025Variance reduction in output from generative AI2 Mar 2025
- 2025Assessing instructor-AI cooperation for grading essay-type questions in an introductory sociology course11 Jan 2025
12 newest of 15 All 15 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2024AI-generated faces influence gender stereotypes and racial homogenization
- 2024Generating Fearful Images: Investigating Potential Emotional Biases in Image-Generation Models
- 2024Can Prompt Modifiers Control Bias? A Comparative Analysis of Text-to-Image Generative Models
- 2023Stable Diffusion Exposed: Gender Bias from Prompt to Image
- 2026Newer Is Not Fairer: Gender Stereotyping in Text-to-Image AI Across Model Generations
- 2024New Job, New Gender? Measuring the Social Bias in Image Generation Models
- 2024Would Deep Generative Models Amplify Bias in Future Models?
- 2023Social Biases through the Text-to-Image Generation Lens