mlsanityData to 14 Oct 2026

Gender Bias in Decision-Making with Large Language Models: A Study of Relationship Conflicts

arXiv 2410.11084 ↗First posted 14 Oct 2024cs.CLcited by 15

Not on the map. Why?

Abstract (arXiv)

Large language models (LLMs) acquire beliefs about gender from training data and can therefore generate text with stereotypical gender attitudes. Prior studies have demonstrated model generations favor one gender or exhibit stereotypes about gender, but have not investigated the complex dynamics that can influence model reasoning and decision-making involving gender. We study gender equity within LLMs through a decision-making lens with a new dataset, DeMET Prompts, containing scenarios related to intimate, romantic relationships. We explore nine relationship configurations through name pairs across three name lists (men, women, neutral). We investigate equity in the context of gender roles through numerous lenses: typical and gender-neutral names, with and without model safety enhancements, same and mixed-gender relationships, and egalitarian versus traditional scenarios across various topics. While all models exhibit the same biases (women favored, then those with gender-neutral names, and lastly men), safety guardrails reduce bias. In addition, models tend to circumvent traditional male dominance stereotypes and side with 'traditionally female' individuals more often, suggesting relationships are viewed as a female domain by the models.

Key facts. Cited by 15 papers in the map (data through 14 Oct 2026). Builds on 23 of its 43 references that are in the map. First posted on arXiv 14 Oct 2024.

Builds on

23 of 43 references.

References · 23

  1. 2022Training language models to follow instructions with human feedbackcited by 15,971
  2. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  3. 2020Measuring Massive Multitask Language Understandingcited by 7,963
  4. 2017Deep reinforcement learning from human preferencescited by 3,912
  5. 2022Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedbackcited by 3,720
  6. 2022Scaling Instruction-Finetuned Language Modelscited by 3,024
  7. 2016Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddingscited by 1,312
  8. 2022Red Teaming Language Models with Language Modelscited by 1,026
  9. 2020StereoSet: Measuring stereotypical bias in pretrained language modelscited by 924
  10. 2020CrowS-Pairs: A Challenge Dataset for Measuring Social Biases in Masked Language Modelscited by 710
  11. 2021BBQ: A Hand-Built Bias Benchmark for Question Answeringcited by 701
  12. 2018Gender Bias in Coreference Resolution: Evaluation and Debiasing Methodscited by 659
11 more
  1. 2019The Woman Worked as a Babysitter: On Biases in Language Generationcited by 541
  2. 2021BOLD: Dataset and Metrics for Measuring Biases in Open-Ended Language Generationcited by 412
  3. 2021Understanding Dataset Difficulty with V-Usable Informationcited by 291
  4. 2020Multi-Dimensional Gender Bias Classificationcited by 80
  5. 2022Gender Bias in Masked Language Models for Multiple Languagescited by 60
  6. 2021Stereotype and Skew: Quantifying Gender Bias in Pre-trained and Fine-tuned Language Modelscited by 57
  7. 2024Angry Men, Sad Women: Large Language Models Reflect Gendered Stereotypes in Emotion Attributioncited by 40
  8. 2023Probing Explicit and Implicit Gender Bias through LLM Conditional Text Generationcited by 31
  9. 2021Responsible AI: Gender bias assessment in emotion recognitioncited by 22
  10. 2022Mapping the Multilingual Margins: Intersectional Biases of Sentiment Analysis Systems in English, Spanish, and Arabiccited by 13
  11. 2023DiFair: A Benchmark for Disentangled Assessment of Gender Knowledge and Biascited by 9

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 6; 2026: 9.

15 papers.

Sort:

By area:

  1. 2025Guardians and Offenders: A Survey on Harmful Content Generation and Safety Mitigation of LLMcited by 9
  2. 2025Gender and Positional Biases in LLM-Based Hiring Decisions: Evidence from Comparative CV/R'esum'e Evaluationscited by 4
  3. 2026RedBench: A Universal Dataset for Comprehensive Red Teaming of Large Language Modelscited by 3
  4. 2025From Individuals to Interactions: Benchmarking Gender Bias in Multimodal Large Language Models from the Lens of Social Relationshipcited by 2
  5. 2025Investigating Gender Bias in LLM-Generated Stories via Psychological Stereotypescited by 2
  6. 2026ProText: A benchmark dataset for measuring (mis)gendering in long-form textscited by 2
  7. 2026Harsher on Male? Evaluating LLMs on Gender-Asymmetric Moral Framing Across Diverse Conflict Scenarioscited by 2
  8. 2025Gender Encoding Patterns in Pretrained Language Model Representationscited by 1
  9. 2025GenderBench: Evaluation Suite for Gender Biases in LLMscited by 1
  10. 2026Analysing LLM Persona Generation and Fairness Interpretation in Polarised Geopolitical Contextscited by 0
  11. 2026Do Gender Cues Affect LLM Value Trade-offs? Evidence from a Controlled Decision Benchmarkcited by 0
  12. 2026Contaminated Collaboration: Measuring Gender Bias Transfer in LLM-Assisted Student Writingcited by 0
3 more
  1. 2026How Do Large Language Models Judge Social Attraction? Evidence from Theory-Grounded Persona Ratings Across Multiple LLMs and Humanscited by 0
  2. 2026Personas Differ from Native-Language Generation: Language Pathways Shape LLM Interpersonal Advicecited by 0
  3. 2026Who Gets a Token, and What Does It Carry? Unequal Name Support and Concept Access in Large Language Modelscited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2023Gender bias and stereotypes in Large Language Models
  2. 2024The Root Shapes the Fruit: On the Persistence of Gender-Exclusive Harms in Aligned Language Models
  3. 2025More Women, Same Stereotypes: Unpacking the Gender Bias Paradox in Large Language Models
  4. 2024Prompt and Prejudice
  5. 2025Mitigating Gender Bias via Fostering Exploratory Thinking in LLMs
  6. 2024Gender Bias of LLM in Economics: An Existentialism Perspective
  7. 2024Protected group bias and stereotypes in Large Language Models
  8. 2025EuroGEST: Investigating gender stereotypes in multilingual language models