Examining Gender Bias in Languages with Grammatical Gender
Not on the map. Why?
Abstract (arXiv)
Recent studies have shown that word embeddings exhibit gender bias inherited from the training corpora. However, most studies to date have focused on quantifying and mitigating such bias only in English. These analyses cannot be directly extended to languages that exhibit morphological agreement on gender, such as Spanish and French. In this paper, we propose new metrics for evaluating gender bias in word embeddings of these languages and further demonstrate evidence of gender bias in bilingual embeddings which align these languages with English. Finally, we extend an existing approach to mitigate gender bias in word embeddings under both monolingual and bilingual settings. Experiments on modified Word Embedding Association Test, word similarity, word translation, and word pair translation tasks show that the proposed approaches effectively reduce the gender bias while preserving the utility of the embeddings.
Key facts. Cited by 40 papers in the map (data through 7 Oct 2026). First posted on arXiv 5 Sep 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 11; 2022: 13; 2023: 4; 2024: 4; 2025: 5; 2026: 3.
40 papers.
Sort:
- 2021Gender Bias in Machine Translationcited by 116
- 2021An Empirical Survey of the Effectiveness of Debiasing Techniques for Pre-trained Language Modelscited by 96
- 2021A Survey on Gender Bias in Natural Language Processingcited by 89
- 2022Theories of "Gender" in NLP Bias Researchcited by 62
- 2022Gender Bias in Masked Language Models for Multiple Languagescited by 60
- 2023Comparing Biases and the Impact of Multilingual Training across Multiple Languagescited by 36
- 2024Gender Bias in Large Language Models across Multiple Languagescited by 35
- 2021Lawyers are Dishonest? Quantifying Representational Harms in Commonsense Knowledge Resourcescited by 30
- 2021Socially Aware Bias Measurements for Hindi Language Representationscited by 29
- 2023Sociodemographic Bias in Language Models: A Survey and Forward Pathcited by 27
- 2022Under the Morphosyntactic Lens: A Multifaceted Evaluation of Gender Bias in Speech Translationcited by 23
- 2021Evaluating Gender Bias in Hindi-English Machine Translationcited by 19
28 more
- 2023CORGI-PM: A Chinese Corpus For Gender Bias Probing and Mitigationcited by 19
- 2023Fairness in Language Models Beyond English: Gaps and Challengescited by 16
- 2021Assessing the Reliability of Word Embedding Gender Bias Measurescited by 14
- 2022Mapping the Multilingual Margins: Intersectional Biases of Sentiment Analysis Systems in English, Spanish, and Arabiccited by 13
- 2024Do Multilingual Large Language Models Mitigate Stereotype Bias?cited by 13
- 2022Analyzing Gender Representation in Multilingual Modelscited by 10
- 2021WordBias: An Interactive Visual Tool for Discovering Intersectional Biases Encoded in Word Embeddingscited by 8
- 2021Debiasing Multilingual Word Embeddings: A Case Study of Three Indian Languagescited by 8
- 2022HERB: Measuring Hierarchical Regional Bias in Pre-trained Language Modelscited by 8
- 2021Evaluating Metrics for Bias in Word Embeddingscited by 7
- 2022Towards Robust NLG Bias Evaluation with Syntactically-diverse Promptscited by 7
- 2022Mitigating Gender Stereotypes in Hindi and Marathicited by 6
- 2021SWEAT: Scoring Polarization of Topics across Different Corporacited by 5
- 2022Measuring Gender Bias in Word Embeddings of Gendered Languages Requires Disentangling Grammatical Gender Signalscited by 5
- 2025Assumed Identities: Quantifying Gender Bias in Machine Translation of Gender-Ambiguous Occupational Termscited by 5
- 2022Undesirable Biases in NLP: Addressing Challenges of Measurementcited by 4
- 2022Efficient Gender Debiasing of Pre-trained Indic Language Modelscited by 3
- 2022A methodology to characterize bias and harmful stereotypes in natural language processing in Latin Americacited by 2
- 2024STOP! Benchmarking Large Language Models with Sensitivity Testing on Offensive Progressionscited by 2
- 2025Bias Beyond English: Evaluating Social Bias and Debiasing Methods in a Low-Resource Settingcited by 1
- 2025Iterative Multilingual Spectral Attribute Erasurecited by 1
- 2025GG-BBQ: German Gender Bias Benchmark for Question Answeringcited by 1
- 2022The SAME score: Improved cosine based bias score for word embeddingscited by 0
- 2024A Study on Bias Detection and Classification in Natural Language Processingcited by 0
- 2025Overview of the NLPCC 2025 Shared Task: Gender Bias Mitigation Challengecited by 0
- 2026Is She Even Relevant? When BERT Ignores Explicit Gender Cuescited by 0
- 2026Estimating Grammatical Gender Directions in Contextual Embeddings under Controlled and Natural Contextscited by 0
- 2026WinoQueer-NL: Assessing Bias in Dutch Language Models toward LGBTQ+ Identitiescited by 0
- 2026WinoQueer-NL: Assessing Bias in Dutch Language Models toward LGBTQ+ Identities2 Sep 2026
- 2026Estimating Grammatical Gender Directions in Contextual Embeddings under Controlled and Natural Contexts29 Jun 2026
- 2026Is She Even Relevant? When BERT Ignores Explicit Gender Cues8 May 2026
- 2025GG-BBQ: German Gender Bias Benchmark for Question Answering22 Jul 2025
- 2025Overview of the NLPCC 2025 Shared Task: Gender Bias Mitigation Challenge14 Jun 2025
- 2025Iterative Multilingual Spectral Attribute Erasure12 Jun 2025
- 2025Bias Beyond English: Evaluating Social Bias and Debiasing Methods in a Low-Resource Setting15 Apr 2025
- 2025Assumed Identities: Quantifying Gender Bias in Machine Translation of Gender-Ambiguous Occupational Terms6 Mar 2025
- 2024STOP! Benchmarking Large Language Models with Sensitivity Testing on Offensive Progressions20 Sep 2024
- 2024A Study on Bias Detection and Classification in Natural Language Processing14 Aug 2024
- 2024Do Multilingual Large Language Models Mitigate Stereotype Bias?8 Jul 2024
- 2024Gender Bias in Large Language Models across Multiple Languages1 Mar 2024
28 more
- 2023Sociodemographic Bias in Language Models: A Survey and Forward Path13 Jun 2023
- 2023Comparing Biases and the Impact of Multilingual Training across Multiple Languages18 May 2023
- 2023Fairness in Language Models Beyond English: Gaps and Challenges24 Feb 2023
- 2023CORGI-PM: A Chinese Corpus For Gender Bias Probing and Mitigation1 Jan 2023
- 2022Towards Robust NLG Bias Evaluation with Syntactically-diverse Prompts3 Dec 2022
- 2022Undesirable Biases in NLP: Addressing Challenges of Measurement24 Nov 2022
- 2022HERB: Measuring Hierarchical Regional Bias in Pre-trained Language Models5 Nov 2022
- 2022Efficient Gender Debiasing of Pre-trained Indic Language Models8 Sep 2022
- 2022A methodology to characterize bias and harmful stereotypes in natural language processing in Latin America14 Jul 2022
- 2022Measuring Gender Bias in Word Embeddings of Gendered Languages Requires Disentangling Grammatical Gender Signals3 Jun 2022
- 2022Mitigating Gender Stereotypes in Hindi and Marathi12 May 2022
- 2022Theories of "Gender" in NLP Bias Research5 May 2022
- 2022Gender Bias in Masked Language Models for Multiple Languages1 May 2022
- 2022Analyzing Gender Representation in Multilingual Models20 Apr 2022
- 2022Mapping the Multilingual Margins: Intersectional Biases of Sentiment Analysis Systems in English, Spanish, and Arabic7 Apr 2022
- 2022The SAME score: Improved cosine based bias score for word embeddings28 Mar 2022
- 2022Under the Morphosyntactic Lens: A Multifaceted Evaluation of Gender Bias in Speech Translation18 Mar 2022
- 2021A Survey on Gender Bias in Natural Language Processing28 Dec 2021
- 2021Evaluating Metrics for Bias in Word Embeddings15 Nov 2021
- 2021An Empirical Survey of the Effectiveness of Debiasing Techniques for Pre-trained Language Models16 Oct 2021
- 2021Socially Aware Bias Measurements for Hindi Language Representations15 Oct 2021
- 2021SWEAT: Scoring Polarization of Topics across Different Corpora15 Sep 2021
- 2021Assessing the Reliability of Word Embedding Gender Bias Measures10 Sep 2021
- 2021Debiasing Multilingual Word Embeddings: A Case Study of Three Indian Languages21 Jul 2021
- 2021Evaluating Gender Bias in Hindi-English Machine Translation16 Jun 2021
- 2021Gender Bias in Machine Translation13 Apr 2021
- 2021Lawyers are Dishonest? Quantifying Representational Harms in Commonsense Knowledge Resources21 Mar 2021
- 2021WordBias: An Interactive Visual Tool for Discovering Intersectional Biases Encoded in Word Embeddings5 Mar 2021
- 2021Gender Bias in Machine Translationcited by 116
- 2021An Empirical Survey of the Effectiveness of Debiasing Techniques for Pre-trained Language Modelscited by 96
- 2021A Survey on Gender Bias in Natural Language Processingcited by 89
- 2022Theories of "Gender" in NLP Bias Researchcited by 62
- 2022Gender Bias in Masked Language Models for Multiple Languagescited by 60
- 2023Comparing Biases and the Impact of Multilingual Training across Multiple Languagescited by 36
- 2024Gender Bias in Large Language Models across Multiple Languagescited by 35
- 2021Lawyers are Dishonest? Quantifying Representational Harms in Commonsense Knowledge Resourcescited by 30
- 2021Socially Aware Bias Measurements for Hindi Language Representationscited by 29
- 2023Sociodemographic Bias in Language Models: A Survey and Forward Pathcited by 27
- 2022Under the Morphosyntactic Lens: A Multifaceted Evaluation of Gender Bias in Speech Translationcited by 23
- 2021Evaluating Gender Bias in Hindi-English Machine Translationcited by 19
12 most cited of 40 All 40 (JSON)
- 2026WinoQueer-NL: Assessing Bias in Dutch Language Models toward LGBTQ+ Identities2 Sep 2026
- 2026Estimating Grammatical Gender Directions in Contextual Embeddings under Controlled and Natural Contexts29 Jun 2026
- 2026Is She Even Relevant? When BERT Ignores Explicit Gender Cues8 May 2026
- 2025GG-BBQ: German Gender Bias Benchmark for Question Answering22 Jul 2025
- 2025Overview of the NLPCC 2025 Shared Task: Gender Bias Mitigation Challenge14 Jun 2025
- 2025Iterative Multilingual Spectral Attribute Erasure12 Jun 2025
- 2025Bias Beyond English: Evaluating Social Bias and Debiasing Methods in a Low-Resource Setting15 Apr 2025
- 2025Assumed Identities: Quantifying Gender Bias in Machine Translation of Gender-Ambiguous Occupational Terms6 Mar 2025
- 2024STOP! Benchmarking Large Language Models with Sensitivity Testing on Offensive Progressions20 Sep 2024
- 2024A Study on Bias Detection and Classification in Natural Language Processing14 Aug 2024
- 2024Do Multilingual Large Language Models Mitigate Stereotype Bias?8 Jul 2024
- 2024Gender Bias in Large Language Models across Multiple Languages1 Mar 2024
12 newest of 40 All 40 (JSON)