mlsanityData to 7 Oct 2026

Identifying and Reducing Gender Bias in Word-Level Language Models

arXiv 1904.03035 ↗First posted 5 Apr 2019cs.CLcited by 214

Not on the map. Why?

Abstract (arXiv)

Many text corpora exhibit socially problematic biases, which can be propagated or amplified in the models trained on such data. For example, doctor cooccurs more frequently with male pronouns than female pronouns. In this study we (i) propose a metric to measure gender bias; (ii) measure bias in a text corpus and the text generated from a recurrent neural network language model trained on the text corpus; (iii) propose a regularization loss term for the language model that minimizes the projection of encoder-trained embeddings onto an embedding subspace that encodes gender; (iv) finally, evaluate efficacy of our proposed method on reducing gender bias. We find this regularization method to be effective in reducing gender bias up to an optimal weight assigned to the loss term, beyond which the model becomes unstable as the perplexity increases. We replicate this study on three training corpora---Penn Treebank, WikiText-2, and CNN/Daily Mail---resulting in similar conclusions.

Key facts. Cited by 214 papers in the map (data through 7 Oct 2026). First posted on arXiv 5 Apr 2019.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 34; 2022: 43; 2023: 57; 2024: 49; 2025: 26; 2026: 5.

214 papers.

Sort:

By area:

  1. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  2. 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,579
  3. 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,765
  4. 2023Pythia: A Suite for Analyzing Large Language Models Across Training and Scalingcited by 1,734
  5. 2022LaMDA: Language Models for Dialog Applicationscited by 1,218
  6. 2021Towards a Unified View of Parameter-Efficient Transfer Learningcited by 863
  7. 2021BBQ: A Hand-Built Bias Benchmark for Question Answeringcited by 683
  8. 2023Bias and Fairness in Large Language Models: A Surveycited by 626
  9. 2023Towards Measuring the Representation of Subjective Global Opinions in Language Modelscited by 424
  10. 2023A Survey on Large Language Model (LLM) Security and Privacy: The Good, the Bad, and the Uglycited by 380
  11. 2021Persistent Anti-Muslim Bias in Large Language Modelscited by 376
  12. 2021Self-Diagnosis and Self-Debiasing: A Proposal for Reducing Corpus-Based Bias in NLPcited by 336
38 more
  1. 2022Quark: Controllable Text Generation with Reinforced Unlearningcited by 236
  2. 2021Societal Biases in Language Generation: Progress and Challengescited by 201
  3. 2023"Kelly is a Warm Person, Joseph is a Role Model": Gender Biases in LLM-Generated Reference Letterscited by 196
  4. 2021GPT3Mix: Leveraging Large-scale Language Models for Text Augmentationcited by 185
  5. 2021Efficient Large Scale Language Modeling with Mixtures of Expertscited by 175
  6. 2021Challenges in Detoxifying Language Modelscited by 169
  7. 2022"I'm sorry to hear that": Finding New Biases in Language Models with a Holistic Descriptor Datasetcited by 160
  8. 2021RedditBias: A Real-World Resource for Bias Evaluation and Debiasing of Conversational Language Modelscited by 149
  9. 2023Should ChatGPT be Biased? Challenges and Risks of Bias in Large Language Modelscited by 144
  10. 2024AI Agents Under Threat: A Survey of Key Security Challenges and Future Pathwayscited by 122
  11. 2021Debiasing Pre-trained Contextualised Embeddingscited by 107
  12. 2023Generative Language Models Exhibit Social Identity Biasescited by 107
  13. 2021Sustainable Modular Debiasing of Language Modelscited by 98
  14. 2024Systematic Biases in LLM Simulations of Debatescited by 98
  15. 2024Bias and Unfairness in Information Retrieval Systems: New Challenges in the LLM Eracited by 97
  16. 2021Trustworthy AI: A Computational Perspectivecited by 93
  17. 2024Unveiling Encoder-Free Vision-Language Modelscited by 90
  18. 2021A Survey on Gender Bias in Natural Language Processingcited by 89
  19. 2021What's in the Box? A Preliminary Analysis of Undesirable Content in the Common Crawl Corpuscited by 79
  20. 2024Bias in Large Language Models: Origin, Evaluation, and Mitigationcited by 77
  21. 2021FairFil: Contrastive Neural Debiasing Method for Pretrained Text Encoderscited by 75
  22. 2021Mitigating Political Bias in Language Models Through Reinforced Calibrationcited by 73
  23. 2023Can ChatGPT Assess Human Personalities? A General Evaluation Frameworkcited by 69
  24. 2024Risk Taxonomy, Mitigation, and Assessment Benchmarks of Large Language Model Systemscited by 63
  25. 2022Theories of "Gender" in NLP Bias Researchcited by 62
  26. 2022Keep Me Updated! Memory Management in Long-term Conversationscited by 62
  27. 2024Fairness in Large Language Models: A Taxonomic Surveycited by 57
  28. 2023TrustGPT: A Benchmark for Trustworthy and Responsible Large Language Modelscited by 56
  29. 2023BiasAsker: Measuring the Bias in Conversational AI Systemcited by 52
  30. 2023Bias Against 93 Stigmatized Groups in Masked Language Models and Downstream Sentiment Classification Taskscited by 51
  31. 2022BERTScore is Unfair: On Social Bias in Language Model-Based Metrics for Text Generationcited by 48
  32. 2022Welcome to the Modern World of Pronouns: Identity-Inclusive Natural Language Processing beyond Gendercited by 47
  33. 2022Estimating the Personality of White-Box Language Modelscited by 47
  34. 2021Towards Knowledge-Grounded Counter Narrative Generation for Hate Speechcited by 41
  35. 2022Identifying and Manipulating the Personality Traits of Language Modelscited by 40
  36. 2023Are Personalized Stochastic Parrots More Dangerous? Evaluating Persona Biases in Dialogue Systemscited by 37
  37. 2022Towards Identifying Social Bias in Dialog Systems: Frame, Datasets, and Benchmarkscited by 36
  38. 2024FairMT-Bench: Benchmarking Fairness for Multi-turn Dialogue in Conversational LLMscited by 36

50 most cited of 214 All 214 (JSON)