The LLM Wears Prada: Analysing Gender Bias and Stereotypes through Online Shopping Data
Not on the map. Why?
Abstract (arXiv)
With the wide and cross-domain adoption of Large Language Models, it becomes crucial to assess to which extent the statistical correlations in training data, which underlie their impressive performance, hide subtle and potentially troubling biases. Gender bias in LLMs has been widely investigated from the perspectives of works, hobbies, and emotions typically associated with a specific gender. In this study, we introduce a novel perspective. We investigate whether LLMs can predict an individual's gender based solely on online shopping histories and whether these predictions are influenced by gender biases and stereotypes. Using a dataset of historical online purchases from users in the United States, we evaluate the ability of six LLMs to classify gender and we then analyze their reasoning and products-gender co-occurrences. Results indicate that while models can infer gender with moderate accuracy, their decisions are often rooted in stereotypical associations between product categories and gender. Furthermore, explicit instructions to avoid bias reduce the certainty of model predictions, but do not eliminate stereotypical patterns. Our findings highlight the persistent nature of gender biases in LLMs and emphasize the need for robust bias-mitigation strategies.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 52 of its 79 references that are in the map. First posted on arXiv 2 Apr 2025.
Builds on
52 of 79 references.
References · 52
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,568
- 2020Extracting Training Data from Large Language Modelscited by 2,189
- 2016Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddingscited by 1,312
- 2022WebShop: Towards Scalable Real-World Web Interaction with Grounded Language Agentscited by 1,251
- 2020Language (Technology) is Power: A Critical Survey of "Bias" in NLPcited by 956
- 2020StereoSet: Measuring stereotypical bias in pretrained language modelscited by 924
- 2022Quantifying Memorization Across Neural Language Modelscited by 763
- 2022Out of One, Many: Using Language Models to Simulate Human Samplescited by 752
- 2023Bias and Fairness in Large Language Models: A Surveycited by 639
- 2019Release Strategies and the Social Impacts of Language Modelscited by 513
38 more
- 2017Men Also Like Shopping: Reducing Gender Bias Amplification using Corpus-level Constraintscited by 420
- 2019On Measuring Social Biases in Sentence Encoderscited by 398
- 2023Detecting Pretraining Data from Large Language Modelscited by 387
- 2023A Survey on Large Language Models for Recommendationcited by 379
- 2019Measuring Bias in Contextualized Word Representationscited by 276
- 2017Word Embeddings Quantify 100 Years of Gender and Ethnic Stereotypescited by 253
- 2019Evaluating Gender Bias in Machine Translationcited by 249
- 2018Examining Gender and Race Bias in Two Hundred Sentiment Analysis Systemscited by 234
- 2019Gender Bias in Contextualized Word Embeddingscited by 203
- 2023Recommender Systems in the Era of Large Language Models (LLMs)cited by 189
- 2023Gender bias and stereotypes in Large Language Modelscited by 187
- 2023The Capacity for Moral Self-Correction in Large Language Modelscited by 173
- 2018Learning Gender-Neutral Word Embeddingscited by 169
- 2022"I'm sorry to hear that": Finding New Biases in Language Models with a Holistic Descriptor Datasetcited by 162
- 2018Reducing Gender Bias in Abusive Language Detectioncited by 152
- 2024Large language models that replace human participants can harmfully misportray and flatten identity groupscited by 144
- 2023How Can Recommender Systems Benefit from Large Language Models: A Surveycited by 142
- 2023Recommender AI Agent: Integrating Large Language Models for Interactive Recommendationscited by 131
- 2018Assessing Gender Bias in Machine Translation -- A Case Study with Google Translatecited by 121
- 2021Gender Bias in Machine Translationcited by 117
- 2019Getting Gender Right in Neural Machine Translationcited by 98
- 2019Evaluating the Underlying Gender Bias in Contextualized Word Embeddingscited by 94
- 2024Fairness in Large Language Models: A Taxonomic Surveycited by 58
- 2024Measuring Implicit Bias in Explicitly Unbiased Large Language Modelscited by 51
- 2024Understanding the Impact of Negative Prompts: When and How Do They Take Effect?cited by 51
- 2020Mitigating Gender Bias in Captioning Systemscited by 50
- 2024Angry Men, Sad Women: Large Language Models Reflect Gendered Stereotypes in Emotion Attributioncited by 40
- 2024Gender Bias in Large Language Models across Multiple Languagescited by 35
- 2024Decoding Biases: Automated Methods and LLM Judges for Gender Bias Detection in Language Modelscited by 33
- 2023Unveiling Gender Bias in Terms of Profession Across LLMs: Analyzing and Addressing Sociological Implicationscited by 29
- 2024Take Caution in Using LLMs as Human Surrogates: Scylla Ex Machinacited by 29
- 2024Large Language Models are Zero-Shot Next Location Predictorscited by 22
- 2024From 'Showgirls' to 'Performers': Fine-tuning with Gender-inclusive Language for Bias Reduction in LLMscited by 15
- 2024Are Large Language Models (LLMs) Good Social Predictors?cited by 13
- 2024Exploring the Impact of Large Language Models on Recommender Systems: An Extensive Reviewcited by 12
- 2024Gender Bias in LLM-generated Interview Responsescited by 10
- 2024Leveraging Large Language Models to Enhance Personalized Recommendations in E-commercecited by 8
- 2024TravelAgent: Generative Agents in the Built Environmentcited by 5
50 most cited of 52 All 52 (JSON)
Built on by
Citing papers per year: 2025: 1.
1 paper.