Vision-Language Models Generate More Homogeneous Stories for Phenotypically Black Individuals
On the map: Multimodal LLMs / vision-language models → Social bias and fairness in VLMs
Abstract (arXiv)
Vision-Language Models (VLMs) extend Large Language Models' capabilities by integrating image processing, but concerns persist about their potential to reproduce and amplify human biases. While research has documented how these models perpetuate stereotypes across demographic groups, most work has focused on between-group biases rather than within-group differences. This study investigates homogeneity bias-the tendency to portray groups as more uniform than they are-within Black Americans, examining how perceived racial phenotypicality influences VLMs' outputs. Using computer-generated images that systematically vary in phenotypicality, we prompted VLMs to generate stories about these individuals and measured text similarity to assess content homogeneity. Our findings reveal three key patterns: First, VLMs generate significantly more homogeneous stories about Black individuals with higher phenotypicality compared to those with lower phenotypicality. Second, stories about Black women consistently display greater homogeneity than those about Black men across all models tested. Third, in two of three VLMs, this homogeneity bias is primarily driven by a pronounced interaction where phenotypicality strongly influences content variation for Black women but has minimal impact for Black men. These results demonstrate how intersectionality shapes AI-generated representations and highlight the persistence of stereotyping that mirror documented biases in human perception, where increased racial phenotypicality leads to greater stereotyping and less individualized representation.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Placed in Social bias and fairness in VLMs, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 13 of its 40 references that are in the map. First posted on arXiv 12 Dec 2024.
Builds on
13 of 40 references.
References · 13
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
- 2021Persistent Anti-Muslim Bias in Large Language Modelscited by 376
- 2022Easily Accessible Text-to-Image Generation Amplifies Demographic Stereotypes at Large Scalecited by 262
- 2021Harms of Gender Exclusivity and Challenges in Non-Binary Representation in Language Technologiescited by 128
- 2023Social Biases through the Text-to-Image Generation Lenscited by 126
- 2024xGen-MM (BLIP-3): A Family of Open Large Multimodal Modelscited by 116
- 2021Understanding and Evaluating Racial Biases in Image Captioningcited by 108
- 2023CoMPosT: Characterizing and Evaluating Caricature in LLM Simulationscited by 94
- 2021On Measures of Biases and Harms in NLPcited by 81
- 2024Large Language Models Portray Socially Subordinate Groups as More Homogeneous, Consistent with a Bias Observed in Humanscited by 31
- 2019Estimating Skin Tone and Effects on Classification Performance in Dermatology Datasetscited by 29
Built on by
Citing papers per year: 2025: 4; 2026: 2.
6 papers.
- 2025Bias Amplification in Stable Diffusion's Representation of Stigma Through Skin Tones and Their Homogeneitycited by 5
- 2025VIGNETTE: Socially Grounded Bias Evaluation for Vision-Language Modelscited by 2
- 2025How Robust Is Homogeneity Bias in LLMs? Evidence Across Models, Decoding Settings, and Identity Signalscited by 0
- 2025Token-Level Entropy Reveals Demographic Disparities in Large Language Modelscited by 0
- 2026Breaking the Assistant Mold: Modeling Behavioral Variation in LLM Based Procedural Character Generationcited by 0
- 2026PERSONAWEAVER: Controllable Diversity Beyond Conventional Archetypes in Procedural Character Generationcited by 0
- 2026PERSONAWEAVER: Controllable Diversity Beyond Conventional Archetypes in Procedural Character Generation22 Sep 2026
- 2026Breaking the Assistant Mold: Modeling Behavioral Variation in LLM Based Procedural Character Generation6 Jan 2026
- 2025Bias Amplification in Stable Diffusion's Representation of Stigma Through Skin Tones and Their Homogeneity24 Aug 2025
- 2025VIGNETTE: Socially Grounded Bias Evaluation for Vision-Language Models28 May 2025
- 2025Token-Level Entropy Reveals Demographic Disparities in Large Language Models31 Jan 2025
- 2025How Robust Is Homogeneity Bias in LLMs? Evidence Across Models, Decoding Settings, and Identity Signals4 Jan 2025
Similar, not cited
Close in wording, no citation either way
- 2025Visual Cues of Gender and Race are Associated with Stereotyping in Vision-Language Models
- 2024More Distinctively Black and Feminine Faces Lead to Increased Stereotyping in Vision-Language Models
- 2025A Stereotype Content Analysis on Color-related Social Bias in Large Vision Language Models
- 2024A Unified Framework and Dataset for Assessing Societal Bias in Vision-Language Models
- 2025Hidden Bias in the Machine: Stereotypes in Text-to-Image Models
- 2024Uncovering Bias in Large Vision-Language Models at Scale with Counterfactuals
- 2025Cultural Awareness in Vision-Language Models: A Cross-Country Exploration
- 2024AI-generated faces influence gender stereotypes and racial homogenization