Contrastive Language-Vision AI Models Pretrained on Web-Scraped Multimodal Data Exhibit Sexual Objectification Bias
Not on the map. Why?
Abstract (arXiv)
Nine language-vision AI models trained on web scrapes with the Contrastive Language-Image Pretraining (CLIP) objective are evaluated for evidence of a bias studied by psychologists: the sexual objectification of girls and women, which occurs when a person's human characteristics, such as emotions, are disregarded and the person is treated as a body. We replicate three experiments in psychology quantifying sexual objectification and show that the phenomena persist in AI. A first experiment uses standardized images of women from the Sexual OBjectification and EMotion Database, and finds that human characteristics are disassociated from images of objectified women: the model's recognition of emotional state is mediated by whether the subject is fully or partially clothed. Embedding association tests (EATs) return significant effect sizes for both anger (d >0.80) and sadness (d >0.50), associating images of fully clothed subjects with emotions. GRAD-CAM saliency maps highlight that CLIP gets distracted from emotional expressions in objectified images. A second experiment measures the effect in a representative application: an automatic image captioner (Antarctic Captions) includes words denoting emotion less than 50% as often for images of partially clothed women than for images of fully clothed women. A third experiment finds that images of female professionals (scientists, doctors, executives) are likely to be associated with sexual descriptions relative to images of male professionals. A fourth experiment shows that a prompt of "a [age] year old girl" generates sexualized images (as determined by an NSFW classifier) up to 73% of the time for VQGAN-CLIP and Stable Diffusion; the corresponding rate for boys never surpasses 9%. The evidence indicates that language-vision AI models trained on web scrapes learn biases of sexual objectification, which propagate to downstream applications.
Key facts. Cited by 43 papers in the map (data through 7 Oct 2026). Builds on 44 of its 86 references that are in the map. First posted on arXiv 21 Dec 2022.
Builds on
44 of 86 references.
References · 44
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
- 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
- 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,310
- 2021Zero-Shot Text-to-Image Generationcited by 4,276
- 2021Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervisioncited by 3,848
- 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,595
32 more
- 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,229
- 2021LAION-400M: Open Dataset of CLIP-Filtered 400 Million Image-Text Pairscited by 1,544
- 2018Datasheets for Datasetscited by 1,371
- 2020StereoSet: Measuring stereotypical bias in pretrained language modelscited by 911
- 2021Open-vocabulary Object Detection via Vision and Language Knowledge Distillationcited by 903
- 2016Semantics derived automatically from language corpora contain human-like biasescited by 894
- 2019Contrastive Representation Distillationcited by 734
- 2018Mitigating Unwanted Biases with Adversarial Learningcited by 663
- 2020Contrastive Learning of Medical Visual Representations from Paired Images and Textcited by 636
- 2021ClipCap: CLIP Prefix for Image Captioningcited by 557
- 2019The Woman Worked as a Babysitter: On Biases in Language Generationcited by 540
- 2021SLIP: Self-supervision meets Language-Image Pre-trainingcited by 434
- 2019On Measuring Social Biases in Sentence Encoderscited by 397
- 2021Multimodal datasets: misogyny, pornography, and malignant stereotypescited by 326
- 2022VQGAN-CLIP: Open Domain Image Generation and Editing with Natural Language Guidancecited by 285
- 2022Easily Accessible Text-to-Image Generation Amplifies Demographic Stereotypes at Large Scalecited by 262
- 2020Data and its (dis)contents: A survey of dataset development and use in machine learning researchcited by 259
- 2013Zero-Shot Learning Through Cross-Modal Transfercited by 237
- 2015Large-scale Classification of Fine-Art Paintings: Learning The Right Metric on The Right Featurecited by 181
- 2020Detecting Emergent Intersectional Biases: Contextualized Word Embeddings Contain a Distribution of Human-like Biasescited by 167
- 2016Grad-CAM: Why did you say that?cited by 159
- 2022CM3: A Causal Masked Multimodal Model of the Internetcited by 142
- 2021Evaluating CLIP: Towards Characterization of Broader Capabilities and Downstream Implicationscited by 128
- 2020Image Representations Learned With Unsupervised Pre-Training Contain Human-like Biasescited by 107
- 2016Learning Visual N-Grams from Web Datacited by 95
- 2021Are Gender-Neutral Queries Really Gender-Neutral? Mitigating Gender Bias in Image Searchcited by 90
- 2019Incorporating Priors with Feature Attribution on Text Classificationcited by 68
- 2022American == White in Multimodal Language-and-Image AIcited by 39
- 2022Gender Bias in Word Embeddings: A Comprehensive Analysis of Frequency, Syntax, and Semanticscited by 24
- 2021Understanding the Representation and Representativeness of Age in AI Data Setscited by 15
- 2019HireNet: a Hierarchical Attention Model for the Automatic Analysis of Asynchronous Video Job Interviewscited by 6
- 2020Grading video interviews with fairness considerationscited by 4
Built on by
Citing papers per year: 2023: 12; 2024: 12; 2025: 15; 2026: 4.
43 papers.
Sort:
By area:
- 2023Finetuning Text-to-Image Diffusion Models for Fairnesscited by 90
- 2024SafetyPrompts: a Systematic Review of Open Datasets for Evaluating and Improving Large Language Model Safetycited by 75
- 2024Examining Gender and Racial Bias in Large Vision-Language Models Using a Novel Dataset of Parallel Imagescited by 55
- 2023AI's Regimes of Representation: A Community-centered Study of Text-to-Image Models in South Asiacited by 54
- 2023'Person' == Light-skinned, Western Man, and Sexualization of Women of Color: Stereotypes in Stable Diffusioncited by 33
- 2024GenderBias-VL: Benchmarking Gender Bias in Vision Language Models via Counterfactual Probingcited by 31
- 2023Stable Diffusion Exposed: Gender Bias from Prompt to Imagecited by 25
- 2024LLM-Driven Robots Risk Enacting Discrimination, Violence, and Unlawful Actionscited by 21
- 2024Grounding and Evaluation for Large Language Models: Practical Challenges and Lessons Learned (Survey)cited by 20
- 2024Fairness and Bias in Multimodal AI: A Surveycited by 19
- 2024SANER: Annotation-free Societal Attribute Neutralizer for Debiasing CLIPcited by 19
- 2023From Google Gemini to OpenAI Q* (Q-Star): A Survey of Reshaping the Generative Artificial Intelligence (AI) Research Landscapecited by 18
31 more
- 2025Hyperbolic Safety-Aware Vision-Language Modelscited by 17
- 2023Fairness in Language Models Beyond English: Gaps and Challengescited by 16
- 2024Multilingual Text-to-Image Generation Magnifies Gender Stereotypes and Prompt Engineering May Not Help Youcited by 15
- 2024Who's in and who's out? A case study of multimodal CLIP-filtering in DataCompcited by 15
- 2024Harm Amplification in Text-to-Image Modelscited by 14
- 2025AI Sees Your Location, But With A Bias Toward The Wealthy Worldcited by 14
- 2023Pre-trained Speech Processing Models Contain Human-Like Biases that Propagate to Speech Emotion Recognitioncited by 9
- 2025Intrinsic Bias is Predicted by Pretraining Data and Correlates with Downstream Performance in Vision-Language Encoderscited by 6
- 2025Biases Propagate in Encoder-based Vision-Language Models: A Systematic Analysis From Intrinsic Measures to Zero-shot Retrieval Outcomescited by 6
- 2023Regulation and NLP (RegNLP): Taming Large Language Modelscited by 5
- 2025Bias Amplification in Stable Diffusion's Representation of Stigma Through Skin Tones and Their Homogeneitycited by 5
- 2025Bias in Gender Bias Benchmarks: How Spurious Features Distort Evaluationcited by 5
- 2023Biased Attention: Do Vision Transformers Amplify Gender Bias More than Convolutional Neural Networks?cited by 4
- 2025Person-Centric Annotations of LAION-400M: Auditing Bias and Its Transfer to Modelscited by 4
- 2024ML-EAT: A Multilevel Embedding Association Test for Interpretable and Transparent Social Sciencecited by 3
- 2025Attention IoU: Examining Biases in CelebA using Attention Mapscited by 3
- 2023Is the U.S. Legal System Ready for AI's Challenges to Human Values?cited by 2
- 2025Understanding Gender Bias in AI-Generated Product Descriptionscited by 2
- 2025Freeze and Reveal: Exposing Modality Bias in Vision-Language Modelscited by 2
- 2025From Global to Local: Social Bias Transfer in CLIPcited by 2
- 2026Aesthetics as Structural Harm: Algorithmic Lookism Across Text-to-Image Generation and Classificationcited by 2
- 2023Trustworthy Representation Learning Across Domainscited by 1
- 2023From Bytes to Biases: Investigating the Cultural Self-Perception of Large Language Modelscited by 1
- 2024Reflecting the Male Gaze: Quantifying Female Objectification in 19th and 20th Century Novelscited by 0
- 2025A Critical Review of Predominant Bias in Neural Networkscited by 0
- 2025Fragments to Facts: Partial-Information Fragment Inference from LLMscited by 0
- 2025TEDI: Trustworthy and Ethical Dataset Indicators to Analyze and Compare Dataset Documentationcited by 0
- 2025A Feature-level Bias Evaluation Framework for Facial Expression Recognition Modelscited by 0
- 2026Is Seeing Believing? Evaluating Human Sensitivity to Synthetic Videocited by 0
- 2026Selective Test-Time Debiasing for CLIP via Reward Gatingcited by 0
- 2026Unequal Verdicts: Investigating Gender Bias in LLM-Based Fake News Detectioncited by 0
- 2026Unequal Verdicts: Investigating Gender Bias in LLM-Based Fake News Detection4 Aug 2026
- 2026Selective Test-Time Debiasing for CLIP via Reward Gating1 Jul 2026
- 2026Is Seeing Believing? Evaluating Human Sensitivity to Synthetic Video14 Mar 2026
- 2026Aesthetics as Structural Harm: Algorithmic Lookism Across Text-to-Image Generation and Classification15 Jan 2026
- 2025Person-Centric Annotations of LAION-400M: Auditing Bias and Its Transfer to Models4 Oct 2025
- 2025Bias in Gender Bias Benchmarks: How Spurious Features Distort Evaluation9 Sep 2025
- 2025From Global to Local: Social Bias Transfer in CLIP25 Aug 2025
- 2025Bias Amplification in Stable Diffusion's Representation of Stigma Through Skin Tones and Their Homogeneity24 Aug 2025
- 2025Freeze and Reveal: Exposing Modality Bias in Vision-Language Models10 Aug 2025
- 2025Biases Propagate in Encoder-based Vision-Language Models: A Systematic Analysis From Intrinsic Measures to Zero-shot Retrieval Outcomes6 Jun 2025
- 2025Understanding Gender Bias in AI-Generated Product Descriptions3 Jun 2025
- 2025A Feature-level Bias Evaluation Framework for Facial Expression Recognition Models26 May 2025
31 more
- 2025TEDI: Trustworthy and Ethical Dataset Indicators to Analyze and Compare Dataset Documentation23 May 2025
- 2025Fragments to Facts: Partial-Information Fragment Inference from LLMs20 May 2025
- 2025Attention IoU: Examining Biases in CelebA using Attention Maps25 Mar 2025
- 2025Hyperbolic Safety-Aware Vision-Language Models15 Mar 2025
- 2025AI Sees Your Location, But With A Bias Toward The Wealthy World16 Feb 2025
- 2025A Critical Review of Predominant Bias in Neural Networks16 Feb 2025
- 2025Intrinsic Bias is Predicted by Pretraining Data and Correlates with Downstream Performance in Vision-Language Encoders11 Feb 2025
- 2024SANER: Annotation-free Societal Attribute Neutralizer for Debiasing CLIP19 Aug 2024
- 2024ML-EAT: A Multilevel Embedding Association Test for Interpretable and Transparent Social Science4 Aug 2024
- 2024Grounding and Evaluation for Large Language Models: Practical Challenges and Lessons Learned (Survey)10 Jul 2024
- 2024GenderBias-VL: Benchmarking Gender Bias in Vision Language Models via Counterfactual Probing30 Jun 2024
- 2024Fairness and Bias in Multimodal AI: A Survey27 Jun 2024
- 2024LLM-Driven Robots Risk Enacting Discrimination, Violence, and Unlawful Actions13 Jun 2024
- 2024Who's in and who's out? A case study of multimodal CLIP-filtering in DataComp13 May 2024
- 2024SafetyPrompts: a Systematic Review of Open Datasets for Evaluating and Improving Large Language Model Safety8 Apr 2024
- 2024Reflecting the Male Gaze: Quantifying Female Objectification in 19th and 20th Century Novels25 Mar 2024
- 2024Examining Gender and Racial Bias in Large Vision-Language Models Using a Novel Dataset of Parallel Images8 Feb 2024
- 2024Harm Amplification in Text-to-Image Models1 Feb 2024
- 2024Multilingual Text-to-Image Generation Magnifies Gender Stereotypes and Prompt Engineering May Not Help You29 Jan 2024
- 2023From Bytes to Biases: Investigating the Cultural Self-Perception of Large Language Models21 Dec 2023
- 2023From Google Gemini to OpenAI Q* (Q-Star): A Survey of Reshaping the Generative Artificial Intelligence (AI) Research Landscape18 Dec 2023
- 2023Stable Diffusion Exposed: Gender Bias from Prompt to Image5 Dec 2023
- 2023Finetuning Text-to-Image Diffusion Models for Fairness11 Nov 2023
- 2023'Person' == Light-skinned, Western Man, and Sexualization of Women of Color: Stereotypes in Stable Diffusion30 Oct 2023
- 2023Pre-trained Speech Processing Models Contain Human-Like Biases that Propagate to Speech Emotion Recognition29 Oct 2023
- 2023Regulation and NLP (RegNLP): Taming Large Language Models9 Oct 2023
- 2023Biased Attention: Do Vision Transformers Amplify Gender Bias More than Convolutional Neural Networks?15 Sep 2023
- 2023Is the U.S. Legal System Ready for AI's Challenges to Human Values?30 Aug 2023
- 2023Trustworthy Representation Learning Across Domains23 Aug 2023
- 2023AI's Regimes of Representation: A Community-centered Study of Text-to-Image Models in South Asia19 May 2023
- 2023Fairness in Language Models Beyond English: Gaps and Challenges24 Feb 2023
- 2024Examining Gender and Racial Bias in Large Vision-Language Models Using a Novel Dataset of Parallel Imagescited by 55
- 2024GenderBias-VL: Benchmarking Gender Bias in Vision Language Models via Counterfactual Probingcited by 31
- 2024Fairness and Bias in Multimodal AI: A Surveycited by 19
- 2024SANER: Annotation-free Societal Attribute Neutralizer for Debiasing CLIPcited by 19
- 2025Hyperbolic Safety-Aware Vision-Language Modelscited by 17
- 2025AI Sees Your Location, But With A Bias Toward The Wealthy Worldcited by 14
- 2025Intrinsic Bias is Predicted by Pretraining Data and Correlates with Downstream Performance in Vision-Language Encoderscited by 6
- 2025Biases Propagate in Encoder-based Vision-Language Models: A Systematic Analysis From Intrinsic Measures to Zero-shot Retrieval Outcomescited by 6
- 2025Bias in Gender Bias Benchmarks: How Spurious Features Distort Evaluationcited by 5
- 2025Person-Centric Annotations of LAION-400M: Auditing Bias and Its Transfer to Modelscited by 4
- 2025Freeze and Reveal: Exposing Modality Bias in Vision-Language Modelscited by 2
- 2026Selective Test-Time Debiasing for CLIP via Reward Gatingcited by 0
- 2026Selective Test-Time Debiasing for CLIP via Reward Gating1 Jul 2026
- 2025Person-Centric Annotations of LAION-400M: Auditing Bias and Its Transfer to Models4 Oct 2025
- 2025Bias in Gender Bias Benchmarks: How Spurious Features Distort Evaluation9 Sep 2025
- 2025Freeze and Reveal: Exposing Modality Bias in Vision-Language Models10 Aug 2025
- 2025Biases Propagate in Encoder-based Vision-Language Models: A Systematic Analysis From Intrinsic Measures to Zero-shot Retrieval Outcomes6 Jun 2025
- 2025Hyperbolic Safety-Aware Vision-Language Models15 Mar 2025
- 2025AI Sees Your Location, But With A Bias Toward The Wealthy World16 Feb 2025
- 2025Intrinsic Bias is Predicted by Pretraining Data and Correlates with Downstream Performance in Vision-Language Encoders11 Feb 2025
- 2024SANER: Annotation-free Societal Attribute Neutralizer for Debiasing CLIP19 Aug 2024
- 2024GenderBias-VL: Benchmarking Gender Bias in Vision Language Models via Counterfactual Probing30 Jun 2024
- 2024Fairness and Bias in Multimodal AI: A Survey27 Jun 2024
- 2024Examining Gender and Racial Bias in Large Vision-Language Models Using a Novel Dataset of Parallel Images8 Feb 2024
- 2023Finetuning Text-to-Image Diffusion Models for Fairnesscited by 90
- 2023'Person' == Light-skinned, Western Man, and Sexualization of Women of Color: Stereotypes in Stable Diffusioncited by 33
- 2023Stable Diffusion Exposed: Gender Bias from Prompt to Imagecited by 25
- 2025Bias Amplification in Stable Diffusion's Representation of Stigma Through Skin Tones and Their Homogeneitycited by 5
- 2025Bias Amplification in Stable Diffusion's Representation of Stigma Through Skin Tones and Their Homogeneity24 Aug 2025
- 2023Stable Diffusion Exposed: Gender Bias from Prompt to Image5 Dec 2023
- 2023Finetuning Text-to-Image Diffusion Models for Fairness11 Nov 2023
- 2023'Person' == Light-skinned, Western Man, and Sexualization of Women of Color: Stereotypes in Stable Diffusion30 Oct 2023
- 2023AI's Regimes of Representation: A Community-centered Study of Text-to-Image Models in South Asiacited by 54
- 2024LLM-Driven Robots Risk Enacting Discrimination, Violence, and Unlawful Actionscited by 21
- 2024Grounding and Evaluation for Large Language Models: Practical Challenges and Lessons Learned (Survey)cited by 20
- 2023Fairness in Language Models Beyond English: Gaps and Challengescited by 16
- 2024Multilingual Text-to-Image Generation Magnifies Gender Stereotypes and Prompt Engineering May Not Help Youcited by 15
- 2024Who's in and who's out? A case study of multimodal CLIP-filtering in DataCompcited by 15
- 2024Harm Amplification in Text-to-Image Modelscited by 14
- 2023Pre-trained Speech Processing Models Contain Human-Like Biases that Propagate to Speech Emotion Recognitioncited by 9
- 2023Regulation and NLP (RegNLP): Taming Large Language Modelscited by 5
- 2023Biased Attention: Do Vision Transformers Amplify Gender Bias More than Convolutional Neural Networks?cited by 4
- 2024ML-EAT: A Multilevel Embedding Association Test for Interpretable and Transparent Social Sciencecited by 3
- 2025Attention IoU: Examining Biases in CelebA using Attention Mapscited by 3
12 most cited of 24 All 24 (JSON)
- 2026Unequal Verdicts: Investigating Gender Bias in LLM-Based Fake News Detection4 Aug 2026
- 2026Is Seeing Believing? Evaluating Human Sensitivity to Synthetic Video14 Mar 2026
- 2026Aesthetics as Structural Harm: Algorithmic Lookism Across Text-to-Image Generation and Classification15 Jan 2026
- 2025From Global to Local: Social Bias Transfer in CLIP25 Aug 2025
- 2025Understanding Gender Bias in AI-Generated Product Descriptions3 Jun 2025
- 2025A Feature-level Bias Evaluation Framework for Facial Expression Recognition Models26 May 2025
- 2025TEDI: Trustworthy and Ethical Dataset Indicators to Analyze and Compare Dataset Documentation23 May 2025
- 2025Attention IoU: Examining Biases in CelebA using Attention Maps25 Mar 2025
- 2025A Critical Review of Predominant Bias in Neural Networks16 Feb 2025
- 2024ML-EAT: A Multilevel Embedding Association Test for Interpretable and Transparent Social Science4 Aug 2024
- 2024Grounding and Evaluation for Large Language Models: Practical Challenges and Lessons Learned (Survey)10 Jul 2024
- 2024LLM-Driven Robots Risk Enacting Discrimination, Violence, and Unlawful Actions13 Jun 2024
12 newest of 24 All 24 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2024Dataset Scale and Societal Consistency Mediate Facial Impression Bias in Vision-Language AI
- 2024Bias in Generative AI
- 2025Vision-Language Models display a strong gender bias
- 2025Hidden Bias in the Machine: Stereotypes in Text-to-Image Models
- 2024AI-generated faces influence gender stereotypes and racial homogenization
- 2024Identifying Implicit Social Biases in Vision-Language Models
- 2024Generating Fearful Images: Investigating Potential Emotional Biases in Image-Generation Models
- 2023MultiModal Bias: Introducing a Framework for Stereotypical Bias Assessment beyond Gender and Race in Vision Language Models