mlsanityData to 14 Oct 2026

LLMs Mirror Country-Specific Gender Patterns If Asked, but Skew Male When Generating Media in Local Languages

arXiv 2609.06545 ↗First posted 6 Sep 2026cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Large language models (LLMs) are increasingly used to generate media, but whether their content perpetuates gender stereotypes is unknown: standard benchmarks rely on selection-based formats rather than long-form generation, and surveyed baselines for local gender associations are scarce outside the West. We collect gender associations for 22 occupational and domestic roles from 695 respondents across the United States, India, Kenya, and Nigeria, and evaluate eight LLMs under two regimes: direct questioning and media generation. Models track the surveyed associations under direct questioning but skew substantially more male under media generation in major local-language cells, consistent with the male bias documented in human-produced media. Outside the US, the shift is much smaller and non-significant under English prompting, so English-only or country-agnostic evaluation would miss this bias in the languages where these models are most deployed. Instruction prompting reduces the shift directionally, but trades off against alignment with the surveyed associations. Evaluating LLM gender bias for global deployment therefore requires generation-format testing, local-language prompting, and locally-collected human baselines.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 27 of its 57 references that are in the map. First posted on arXiv 6 Sep 2026.

Builds on

27 of 57 references.

References · 27

  1. 2016Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddingscited by 1,312
  2. 2020Language (Technology) is Power: A Critical Survey of "Bias" in NLPcited by 956
  3. 2016Semantics derived automatically from language corpora contain human-like biasescited by 901
  4. 2019The Woman Worked as a Babysitter: On Biases in Language Generationcited by 541
  5. 2023Towards Measuring the Representation of Subjective Global Opinions in Language Modelscited by 437
  6. 2022Easily Accessible Text-to-Image Generation Amplifies Demographic Stereotypes at Large Scalecited by 262
  7. 2017Word Embeddings Quantify 100 Years of Gender and Ethnic Stereotypescited by 253
  8. 2023Marked Personas: Using Natural Language Prompts to Measure Stereotypes in Language Modelscited by 207
  9. 2023"Kelly is a Warm Person, Joseph is a Role Model": Gender Biases in LLM-Generated Reference Letterscited by 199
  10. 2023Bias Runs Deep: Implicit Reasoning Biases in Persona-Assigned LLMscited by 199
  11. 2024Political Compass or Spinning Arrow? Towards More Meaningful Evaluations for Values and Opinions in Large Language Modelscited by 162
  12. 2020Intrinsic Bias Metrics Do Not Correlate with Application Biascited by 148
15 more
  1. 2025The Widespread Adoption of Large Language Model-Assisted Writing Across Societycited by 51
  2. 2024NormAd: A Framework for Measuring the Cultural Adaptability of Large Language Modelscited by 48
  3. 2024Bias in Language Models: Beyond Trick Tests and Toward RUTEd Evaluationcited by 41
  4. 2024IndiBias: A Benchmark Dataset to Measure Social Biases in Language Models for Indian Contextcited by 32
  5. 2025Actions Speak Louder than Words: Agent Decisions Reveal Implicit Biases in Language Modelscited by 30
  6. 2022Causally Testing Gender Bias in LLMs: A Case Study on Occupational Biascited by 28
  7. 2025Multilingual Prompting for Improving LLM Generation Diversitycited by 25
  8. 2024Akal Badi ya Bias: An Exploratory Study of Gender Bias in Hindi Language Technologycited by 17
  9. 2024Beyond Binary Gender Labels: Revealing Gender Biases in LLMs through Gender-Neutral Name Predictionscited by 17
  10. 2024Gender Bias in LLM-generated Interview Responsescited by 10
  11. 2024'Since Lawyers are Males..': Examining Implicit Gender Bias in Hindi Language Generation by LLMscited by 8
  12. 2024Cultural Fidelity in Large-Language Models: An Evaluation of Online Language Resources as a Driver of Model Performance in Value Representationcited by 7
  13. 2024Towards Region-aware Bias Evaluation Metricscited by 5
  14. 2025Fine-Tuned LLMs are "Time Capsules" for Tracking Societal Bias Through Bookscited by 5
  15. 2025Generating the Modal Worker: A Cross-Model Audit of Race and Gender in LLM-Generated Personas Across 41 Occupationscited by 3

Built on by

Not cited yet.