mlsanityData to 7 Oct 2026

Gender Bias in Large Language Models across Multiple Languages

arXiv 2403.00277 ↗First posted 1 Mar 2024cs.CLcited by 35

Not on the map. Why?

Abstract (arXiv)

With the growing deployment of large language models (LLMs) across various applications, assessing the influence of gender biases embedded in LLMs becomes crucial. The topic of gender bias within the realm of natural language processing (NLP) has gained considerable focus, particularly in the context of English. Nonetheless, the investigation of gender bias in languages other than English is still relatively under-explored and insufficiently analyzed. In this work, We examine gender bias in LLMs-generated outputs for different languages. We use three measurements: 1) gender bias in selecting descriptive words given the gender-related context. 2) gender bias in selecting gender-related pronouns (she/he) given the descriptive words. 3) gender bias in the topics of LLM-generated dialogues. We investigate the outputs of the GPT series of LLMs in various languages using our three measurement methods. Our findings revealed significant gender biases across all the languages we examined.

Key facts. Cited by 35 papers in the map (data through 7 Oct 2026). Builds on 35 of its 63 references that are in the map. First posted on arXiv 1 Mar 2024.

Builds on

35 of 63 references.

References · 35

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  4. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
  5. 2016Equality of Opportunity in Supervised Learningcited by 2,000
  6. 2019A Survey on Bias and Fairness in Machine Learningcited by 1,911
  7. 2016Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddingscited by 1,304
  8. 2022LaMDA: Language Models for Dialog Applicationscited by 1,218
  9. 2021Ethical and social risks of harm from Language Modelscited by 957
  10. 2020StereoSet: Measuring stereotypical bias in pretrained language modelscited by 911
  11. 2023A Multitask, Multilingual, Multimodal Evaluation of ChatGPT on Reasoning, Hallucination, and Interactivitycited by 888
  12. 2014Certifying and removing disparate impactcited by 715
23 more
  1. 2020CrowS-Pairs: A Challenge Dataset for Measuring Social Biases in Masked Language Modelscited by 703
  2. 2018Gender Bias in Coreference Resolution: Evaluation and Debiasing Methodscited by 657
  3. 2019The Woman Worked as a Babysitter: On Biases in Language Generationcited by 540
  4. 2018Gender Bias in Coreference Resolutioncited by 438
  5. 2023Toxicity in ChatGPT: Analyzing Persona-assigned Language Modelscited by 356
  6. 2019Measuring Bias in Contextualized Word Representationscited by 275
  7. 2023Self-collaboration Code Generation via ChatGPTcited by 255
  8. 2023ChatGPT Beyond English: Towards a Comprehensive Evaluation of Large Language Models in Multilingual Learningcited by 203
  9. 2023"Kelly is a Warm Person, Joseph is a Role Model": Gender Biases in LLM-Generated Reference Letterscited by 196
  10. 2020Social Biases in NLP Models as Barriers for Persons with Disabilitiescited by 182
  11. 2018Learning Gender-Neutral Word Embeddingscited by 169
  12. 2016Fairness in Learning: Classic and Contextual Banditscited by 167
  13. 2017Beyond Parity: Fairness Objectives for Collaborative Filteringcited by 93
  14. 2022Gender Bias in Masked Language Models for Multiple Languagescited by 60
  15. 2019Examining Gender Bias in Languages with Grammatical Gendercited by 40
  16. 2022Mitigating Gender Bias in Distilled Language Models via Counterfactual Role Reversalcited by 40
  17. 2021Uncovering Implicit Gender Bias in Narratives through Commonsense Inferencecited by 32
  18. 2021Men Are Elected, Women Are Married: Events Gender Bias on Wikipediacited by 30
  19. 2022Building a Role Specified Open-Domain Dialogue System Leveraging Large-Scale Language Modelscited by 26
  20. 2023Hi Guys or Hi Folks? Benchmarking Gender-Neutral Machine Translation with the GeNTE Corpuscited by 20
  21. 2023A Tale of Pronouns: Interpretability Informs Gender Bias Mitigation for Fairer Instruction-Tuned Machine Translationcited by 19
  22. 2023Unraveling Downstream Gender Bias from Large Language Models: A Study on AI Educational Writing Assistancecited by 15
  23. 2023Public Perceptions of Gender Bias in Large Language Models: Cases of ChatGPT and Erniecited by 8

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 12; 2025: 19; 2026: 4.

35 papers.

Sort:

By area:

  1. 2024Evaluating Cultural Adaptability of a Large Language Model via Simulation of Synthetic Personascited by 36
  2. 2025Visual Large Language Models for Generalized and Specialized Applicationscited by 35
  3. 2024MBBQ: A Dataset for Cross-Lingual Comparison of Stereotypes in Generative LLMscited by 32
  4. 2024SELF-GUIDE: Better Task-Specific Instruction Following via Self-Synthetic Finetuningcited by 32
  5. 2024Evaluating Gender Bias of LLMs in Making Morality Judgementscited by 15
  6. 2024Social Bias in Large Language Models For Bangla: An Empirical Study on Gender and Religious Biascited by 13
  7. 2024Multi-OphthaLingua: A Multilingual Benchmark for Assessing and Debiasing LLM Ophthalmological QA in LMICscited by 10
  8. 2025UIPE: Enhancing LLM Unlearning by Removing Knowledge Related to Forgetting Targetscited by 10
  9. 2025FairI Tales: Evaluation of Fairness in Indian Contexts with a Focus on Bias and Stereotypescited by 9
  10. 2024Surprising gender biases in GPTcited by 7
  11. 2024'Since Lawyers are Males..': Examining Implicit Gender Bias in Hindi Language Generation by LLMscited by 7
  12. 2025Are We Paying Attention to Her? Investigating Gender Disambiguation and Attention in Machine Translationcited by 7
23 more
  1. 2024Role-Play Paradox in Large Language Models: Reasoning Performance Gains and Ethical Dilemmascited by 6
  2. 2025What's Not Said Still Hurts: A Description-Based Evaluation Framework for Measuring Social Bias in LLMscited by 6
  3. 2025Rethinking LLM Bias Probing Using Lessons from the Social Sciencescited by 6
  4. 2024An Empirical Study of Gendered Stereotypes in Emotional Attributes for Bangla in Multilingual Large Language Modelscited by 4
  5. 2024How far can bias go? Tracing bias from pretraining data to alignmentcited by 4
  6. 2025Distinct social-linguistic processing between humans and large audio-language models: Evidence from model-brain alignmentcited by 3
  7. 2025Gender Bias in English-to-Greek Machine Translationcited by 3
  8. 2024Enhancing Exchange Rate Forecasting with Explainable Deep Learning Modelscited by 2
  9. 2025Analysis of LLM Bias (Chinese Propaganda & Anti-US Sentiment) in DeepSeek-R1 vs. ChatGPT o3-mini-highcited by 2
  10. 2025Who Gets the Mic? Investigating Gender Bias in the Speaker Assignment of a Speech-LLMcited by 2
  11. 2025Measuring Gender Bias in Job Title Matching for Grammatical Gender Languagescited by 2
  12. 2025Man Made Language Models? Evaluating LLMs' Perpetuation of Masculine Generics Biascited by 1
  13. 2025The LLM Wears Prada: Analysing Gender Bias and Stereotypes through Online Shopping Datacited by 1
  14. 2025Is Lying Only Sinful in Islam? Exploring Religious Bias in Multilingual Large Language Models Across Major Religionscited by 1
  15. 2025Assessing Agentic Large Language Models in Multilingual National Biascited by 0
  16. 2025(Fact) Check Your Biascited by 0
  17. 2025Exploring Gender Bias Beyond Occupational Titlescited by 0
  18. 2025"Be My Cheese?": Assessing Cultural Nuance in Multilingual LLM Translationscited by 0
  19. 2025Unlocking Latent Discourse Translation in LLMs Through Quality-Aware Decodingcited by 0
  20. 2026CBMAS: Cognitive Behavioral Modeling via Activation Steeringcited by 0
  21. 2026Bias Dynamics in BabyLMs: Towards a Compute-Efficient Sandbox for Democratising Pre-Training Debiasingcited by 0
  22. 2026The GDN-CC Dataset: Automatic Corpus Clarification for AI-enhanced Democratic Citizen Consultationscited by 0
  23. 2026SPAGBias: Uncovering and Tracing Structured Spatial Gender Bias in Large Language Modelscited by 0