Generating Fearful Images: Investigating Potential Emotional Biases in Image-Generation Models
Not on the map. Why?
Abstract (arXiv)
This paper examines potential biases and inconsistencies in the emotions evoked by images produced by generative artificial intelligence (AI) models and their potential bias toward negative emotions. We assess this bias by comparing the emotions evoked by an AI-produced image to the emotions evoked by prompts used to create those images. After developing and validating automated methods for emotion recognition across modalities, we examine correlations in the prevalence of emotions across text and images and measure the degree to which generative AI models tend to over-represent specific emotions in the resulting images. Findings indicate that AI-generated images from Stable Diffusion models are biased towards producing images that evoke fear, regardless of the original prompt, as metrics show a significant over-representation of that emotion compared to five other emotions. We extend this analysis to a more recent enterprise-level models, such as ChatGPT and Gemini, and find similar results, suggesting a systemic bias rather than one present only in a single model. While certain limitations in the alignment of emotions across modalities limit this work, the emotional skew we find in generative models is consistent with an over-representation of fearful content in training data, and this bias could amplify negative affective content in digital spaces further, perpetuating its prevalence and impact.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 14 of its 48 references that are in the map. First posted on arXiv 8 Nov 2024.
Builds on
14 of 48 references.
References · 14
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,310
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
- 2016Equality of Opportunity in Supervised Learningcited by 2,000
- 2014Deep Neural Networks are Easily Fooled: High Confidence Predictions for Unrecognizable Imagescited by 774
- 2023ConvNeXt V2: Co-designing and Scaling ConvNets with Masked Autoencoderscited by 703
- 2020Closing the AI Accountability Gap: Defining an End-to-End Framework for Internal Algorithmic Auditingcited by 380
- 2022DiffusionDB: A Large-scale Prompt Gallery Dataset for Text-to-Image Generative Modelscited by 376
- 2023Fairness And Bias in Artificial Intelligence: A Brief Survey of Sources, Impacts, And Mitigation Strategiescited by 83
- 2023EmoSet: A Large-scale Visual Emotion Dataset with Rich Attributescited by 81
- 2020Fairness Metrics: A Comparative Analysiscited by 45
Built on by
Citing papers per year: 2025: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2024Bias in Generative AI
- 2024Improved Emotional Alignment of AI and Humans: Human Ratings of Emotions Expressed by Stable Diffusion v1, DALL-E 2, and DALL-E 3
- 2023The Good, The Bad, and Why: Unveiling Emotions in Generative AI
- 2024Make Me Happier: Evoking Emotions Through Image Diffusion Models
- 2025Artificial Intelligence Can Emulate Human Normative Judgments on Emotional Visual Scenes ↗
- 2024A Review of Human Emotion Synthesis Based on Generative Technology
- 2026Do Emotion Concepts Generalize Across Sources, Modalities, and Architectures in Vision-Language Models?
- 2025MUSE: Manipulating Unified Framework for Synthesizing Emotions in Images via Test-Time Optimization