Gender Bias in Machine Translation
Not on the map. Why?
Abstract (arXiv)
Machine translation (MT) technology has facilitated our daily tasks by providing accessible shortcuts for gathering, elaborating and communicating information. However, it can suffer from biases that harm users and society at large. As a relatively new field of inquiry, gender bias in MT still lacks internal cohesion, which advocates for a unified framework to ease future research. To this end, we: i) critically review current conceptualizations of bias in light of theoretical insights from related disciplines, ii) summarize previous analyses aimed at assessing gender bias in MT, iii) discuss the mitigating strategies proposed so far, and iv) point toward potential directions for future work.
Key facts. Cited by 116 papers in the map (data through 7 Oct 2026). Builds on 68 of its 261 references that are in the map. First posted on arXiv 13 Apr 2021.
Builds on
68 of 261 references.
References · 68
- 2020Shortcut Learning in Deep Neural Networkscited by 1,928
- 2019A Survey on Bias and Fairness in Machine Learningcited by 1,911
- 2016Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddingscited by 1,304
- 2020Language (Technology) is Power: A Critical Survey of "Bias" in NLPcited by 951
- 2016Semantics derived automatically from language corpora contain human-like biasescited by 894
- 2019Right for the Wrong Reasons: Diagnosing Syntactic Heuristics in Natural Language Inferencecited by 864
- 2018Gender Bias in Coreference Resolution: Evaluation and Debiasing Methodscited by 657
- 2018Gender Bias in Coreference Resolutioncited by 438
- 2017Men Also Like Shopping: Reducing Gender Bias Amplification using Corpus-level Constraintscited by 420
- 2019Social Bias Frames: Reasoning about Social and Power Implications of Languagecited by 377
- 2019Measurement and Fairnesscited by 299
- 2019Mitigating Gender Bias in Natural Language Processing: Literature Reviewcited by 287
38 more
- 2019Lipstick on a Pig: Debiasing Methods Cover up Systematic Gender Biases in Word Embeddings But do not Remove Themcited by 268
- 2020Data and its (dis)contents: A survey of dataset development and use in machine learning researchcited by 259
- 2019Evaluating Gender Bias in Machine Translationcited by 247
- 2018Women also Snowboard: Overcoming Bias in Captioning Modelscited by 236
- 2018Gender Bias in Neural Natural Language Processingcited by 210
- 2019Counterfactual Data Augmentation for Mitigating Gender Stereotypes in Languages with Rich Morphologycited by 200
- 2019Are We Modeling the Task or the Annotator? An Investigation of Annotator Bias in Natural Language Understanding Datasetscited by 173
- 2018Learning Gender-Neutral Word Embeddingscited by 169
- 2020Intrinsic Bias Metrics Do Not Correlate with Application Biascited by 148
- 2019Black is to Criminal as Caucasian is to Police: Detecting and Removing Multiclass Bias in Word Embeddingscited by 146
- 2019Towards Debiasing Fact Verification Modelscited by 143
- 2020Towards Accountability for Machine Learning Datasets: Practices from Software Engineering and Infrastructurecited by 138
- 2019Predictive Biases in Natural Language Processing Models: A Conceptual Framework and Overviewcited by 137
- 2019End-to-End Bias Mitigation by Modelling Biases in Corporacited by 127
- 2018Assessing Gender Bias in Machine Translation -- A Case Study with Google Translatecited by 121
- 2019Getting Gender Right in Neural Machine Translationcited by 98
- 2020Reducing Gender Bias in Neural Machine Translation as a Domain Adaptation Problemcited by 86
- 2019Toward Gender-Inclusive Coreference Resolutioncited by 84
- 2020Multi-Dimensional Gender Bias Classificationcited by 80
- 2018Towards Robust and Privacy-preserving Text Representationscited by 75
- 2021Machine Translationese: Effects of Algorithmic Bias on Linguistic Complexity in Machine Translationcited by 70
- 2019Equalizing Gender Biases in Neural Machine Translation with Word Embeddings Techniquescited by 65
- 2019On Measuring Gender Bias in Translation of Gender-neutral Pronounscited by 59
- 2020Gender in Danger? Evaluating Speech Translation Technology on the MuST-SHE Corpuscited by 57
- 2020Gender Bias in Multilingual Embeddings and Cross-Lingual Transfercited by 55
- 2016Personalized Machine Translation: Preserving Original Author Traitscited by 47
- 2019Lost in Translation: Loss and Decay of Linguistic Richness in Machine Translationcited by 45
- 2019When and Why is Document-level Context Useful in Neural Machine Translation?cited by 45
- 2021They, Them, Theirs: Rewriting with Gender-Neutral Englishcited by 44
- 2020Mitigating Gender Bias in Machine Translation with Target Gender Annotationscited by 42
- 2019Examining Gender Bias in Languages with Grammatical Gendercited by 40
- 2020Neural Machine Translation Doesn't Translate Gender Coreference Right Unless You Make Itcited by 40
- 2016How Grammatical is Character-level Neural Machine Translation? Assessing MT Quality with Contrastive Translation Pairscited by 39
- 2021Disembodied Machine Learning: On the Illusion of Objectivity in NLPcited by 37
- 2015Computational Sociolinguistics: A Surveycited by 35
- 2019On the Linguistic Representational Power of Neural Machine Translation Modelscited by 34
- 2015It's a Man's Wikipedia? Assessing Gender Inequality in an Online Encyclopediacited by 30
- 2019Distilling Translations with Visual Awarenesscited by 30
50 most cited of 68 All 68 (JSON)
Built on by
Citing papers per year: 2021: 10; 2022: 9; 2023: 32; 2024: 32; 2025: 24; 2026: 9.
116 papers.
Sort:
By area:
- 2021Societal Biases in Language Generation: Progress and Challengescited by 201
- 2023Accelerating Transformer Inference for Translation via Parallel Decodingcited by 123
- 2021A Survey on Gender Bias in Natural Language Processingcited by 89
- 2021Quantifying Social Biases in NLP: A Generalization and Empirical Comparison of Extrinsic Fairness Metricscited by 83
- 2023Inseq: An Interpretability Toolkit for Sequence Generation Modelscited by 78
- 2024INCLUDE: Evaluating Multilingual Language Understanding with Regional Knowledgecited by 78
- 2024The Multilingual Alignment Prism: Aligning Global and Local Preferences to Reduce Harmcited by 67
- 2022Theories of "Gender" in NLP Bias Researchcited by 62
- 2021Domain Adaptation and Multi-Domain Adaptation for Neural Machine Translation: A Surveycited by 46
- 2024IrokoBench: A New Benchmark for African Languages in the Age of Large Language Modelscited by 43
- 2025The State of Multilingual LLM Safety Research: From Measuring the Language Gap to Mitigating Itcited by 42
- 2024Angry Men, Sad Women: Large Language Models Reflect Gendered Stereotypes in Emotion Attributioncited by 39
38 more
- 2022MT-GenEval: A Counterfactual and Contextual Dataset for Evaluating Gender Accuracy in Machine Translationcited by 38
- 2022Representation Bias in Data: A Survey on Identification and Resolution Techniquescited by 37
- 2023Lost in Translation: Large Language Models in Non-English Content Analysiscited by 34
- 2024IndiBias: A Benchmark Dataset to Measure Social Biases in Language Models for Indian Contextcited by 32
- 2023Sociodemographic Bias in Language Models: A Survey and Forward Pathcited by 27
- 2023Survey of Social Bias in Vision-Language Modelscited by 26
- 2024Culturally Aware and Adapted NLP: A Taxonomy and a Survey of the State of the Artcited by 26
- 2023Debiasing Algorithm through Model Adaptationcited by 24
- 2021Hi, my name is Martha: Using names to measure and mitigate bias in generative dialogue modelscited by 23
- 2022Under the Morphosyntactic Lens: A Multifaceted Evaluation of Gender Bias in Speech Translationcited by 23
- 2023Multilingual Holistic Bias: Extending Descriptors and Patterns to Unveil Demographic Biases in Languages at Scalecited by 23
- 2023Gender Neutralization for an Inclusive Machine Translation: from Theoretical Foundations to Open Challengescited by 22
- 2023Hi Guys or Hi Folks? Benchmarking Gender-Neutral Machine Translation with the GeNTE Corpuscited by 20
- 2021Evaluating Gender Bias in Hindi-English Machine Translationcited by 19
- 2023What about em? How Commercial Machine Translation Fails to Handle (Neo-)Pronounscited by 19
- 2023A Tale of Pronouns: Interpretability Informs Gender Bias Mitigation for Fairer Instruction-Tuned Machine Translationcited by 19
- 2024What the Harm? Quantifying the Tangible Impact of Gender Bias in Machine Translation with a Human-centered Studycited by 15
- 2021The Arabic Parallel Gender Corpus 2.0: Extensions and Analysescited by 12
- 2023Women Are Beautiful, Men Are Leaders: Gender Stereotypes in Machine Translation and Language Modelingcited by 12
- 2024A Prompt Response to the Demand for Automatic Gender-Neutral Translationcited by 12
- 2024The power of Prompts: Evaluating and Mitigating Gender Bias in MT with LLMscited by 12
- 2021How to Split: the Effect of Word Segmentation on Gender Bias in Speech Translationcited by 11
- 2024ALaRM: Align Language Models via Hierarchical Rewards Modelingcited by 11
- 2023Target-Agnostic Gender-Aware Contrastive Learning for Mitigating Bias in Multilingual Machine Translationcited by 10
- 2024Watching the Watchers: Exposing Gender Disparities in Machine Translation Quality Estimationcited by 10
- 2025The Multilingual Divide and Its Impact on Global AI Safetycited by 10
- 2023In the Name of Fairness: Assessing the Bias in Clinical Record De-identificationcited by 9
- 2022User-Centric Gender Rewritingcited by 7
- 2023Gender, names and other mysteries: Towards the ambiguous for gender-inclusive translationcited by 7
- 2023Exploring the Impact of Training Data Distribution and Subword Tokenization on Gender Bias in Machine Translationcited by 7
- 2024Enhancing Gender-Inclusive Machine Translation with Neomorphemes and Large Language Modelscited by 7
- 2025Are We Paying Attention to Her? Investigating Gender Disambiguation and Attention in Machine Translationcited by 7
- 2025What Is The Political Content in LLMs' Pre- and Post-Training Data?cited by 7
- 2023Perturbation-based QE: An Explainable, Unsupervised Word-level Quality Estimation Method for Blackbox Machine Translationcited by 6
- 2023Test Suites Task: Evaluation of Gender Fairness in MT with MuST-SHE and INEScited by 6
- 2024Whose wife is it anyway? Assessing bias against same-gender relationships in machine translationcited by 6
- 2024SAGED: A Holistic Bias-Benchmarking Pipeline for Language Models with Customisable Fairness Calibrationcited by 6
- 2025An Interdisciplinary Approach to Human-Centered Machine Translationcited by 6
50 most cited of 116 All 116 (JSON)
- 2026Benchmarking Gender Bias in Machine Translation Evaluation Metrics across Occupations18 Sep 2026
- 2026Voice or Stereotype? Disentangling Acoustic and Content-Based Gender in Speech-to-Speech Models8 Sep 2026
- 2026Source-Free MT Evaluation Is Not MT Evaluation21 Aug 2026
- 2026Cultural Fidelity in English-to-Hindi Translation: A Preservation-Fluency Frontier for Gender Recoverability26 May 2026
- 2026Position: Natural Language Should Not Fully Replace Formal Languages10 May 2026
- 2026Explaining GAND: A Resource on Gender-Ambiguous Natural Data & Contrastive Attribution6 May 2026
- 2026FairQE: Multi-Agent Framework for Mitigating Gender Bias in Translation Quality Estimation23 Apr 2026
- 2026ConGA: Guidelines for Contextual Gender Annotation. A Framework for Annotating Gender in Machine Translation18 Mar 2026
- 2026Gender Disambiguation in Machine Translation: Diagnostic Evaluation in Decoder-Only Architectures18 Mar 2026
- 2025Identifying Bias in Machine-generated Text Detection10 Dec 2025
- 2025Evaluating Machine Translation Datasets for Low-Web Data Languages: A Gendered Lens5 Nov 2025
- 2025Pragyaan: Designing and Curating High-Quality Cultural Post-Training Datasets for Indian Languages8 Oct 2025
38 more
- 2025GAMBIT+: A Challenge Set for Evaluating Gender Bias in Machine Translation Quality Estimation Metrics8 Oct 2025
- 2025What Is The Political Content in LLMs' Pre- and Post-Training Data?26 Sep 2025
- 2025Measuring Gender Bias in Job Title Matching for Grammatical Gender Languages17 Sep 2025
- 2025Exploring Causal Effect of Social Bias on Faithfulness Hallucinations in Large Language Models11 Aug 2025
- 2025Learning the Topic, Not the Language: How LLMs Classify Online Immigration Discourse Across Languages8 Aug 2025
- 2025Uncertainty Quantification for Evaluating Machine Translation Bias24 Jul 2025
- 2025Gender-Neutral Machine Translation Strategies in Practice18 Jun 2025
- 2025An Interdisciplinary Approach to Human-Centered Machine Translation16 Jun 2025
- 2025Gender Bias in English-to-Greek Machine Translation11 Jun 2025
- 2025EuroGEST: Investigating gender stereotypes in multilingual language models4 Jun 2025
- 2025Different Speech Translation Models Encode and Translate Speaker Gender Differently2 Jun 2025
- 2025The State of Multilingual LLM Safety Research: From Measuring the Language Gap to Mitigating It30 May 2025
- 2025GeNRe: A French Gender-Neutral Rewriting System Using Collective Nouns29 May 2025
- 2025The Multilingual Divide and Its Impact on Global AI Safety27 May 2025
- 2025Are We Paying Attention to Her? Investigating Gender Disambiguation and Attention in Machine Translation13 May 2025
- 2025The LLM Wears Prada: Analysing Gender Bias and Stereotypes through Online Shopping Data2 Apr 2025
- 2025Assumed Identities: Quantifying Gender Bias in Machine Translation of Gender-Ambiguous Occupational Terms6 Mar 2025
- 2025Are All Spanish Doctors Male? Evaluating Gender Bias in German Machine Translation26 Feb 2025
- 2025Identifying Gender Stereotypes and Biases in Automated Translation from English to Italian using Similarity Networks17 Feb 2025
- 2025Man Made Language Models? Evaluating LLMs' Perpetuation of Masculine Generics Bias14 Feb 2025
- 2025Dual Debiasing: Remove Stereotypes and Keep Factual Gender for Fair Language Modeling and Translation17 Jan 2025
- 2024INCLUDE: Evaluating Multilingual Language Understanding with Regional Knowledge29 Nov 2024
- 2024WMT24 Test Suite: Gender Resolution in Speaker-Listener Dialogue Roles9 Nov 2024
- 2024Current State-of-the-Art of Bias Detection and Mitigation in Machine Translation for African and European Languages: a Review28 Oct 2024
- 2024Ethics Whitepaper: Whitepaper on Ethical Research into Large Language Models17 Oct 2024
- 2024Advancing Fairness in Natural Language Processing: From Traditional Methods to Explainability16 Oct 2024
- 2024Watching the Watchers: Exposing Gender Disparities in Machine Translation Quality Estimation14 Oct 2024
- 2024What the Harm? Quantifying the Tangible Impact of Gender Bias in Machine Translation with a Human-centered Study1 Oct 2024
- 2024SAGED: A Holistic Bias-Benchmarking Pipeline for Language Models with Customisable Fairness Calibration17 Sep 2024
- 2024The power of Prompts: Evaluating and Mitigating Gender Bias in MT with LLMs26 Jul 2024
- 2024Fine-grained Gender Control in Machine Translation with Large Language Models21 Jul 2024
- 2024Towards Massive Multilingual Holistic Bias29 Jun 2024
- 2024The Multilingual Alignment Prism: Aligning Global and Local Preferences to Reduce Harm26 Jun 2024
- 2024Evaluating Short-Term Temporal Fluctuations of Social Biases in Social Media Data and Masked Language Models19 Jun 2024
- 2024Reconsidering Sentence-Level Sign Language Translation16 Jun 2024
- 2024Culturally Aware and Adapted NLP: A Taxonomy and a Survey of the State of the Art6 Jun 2024
- 2024IrokoBench: A New Benchmark for African Languages in the Age of Large Language Models5 Jun 2024
- 2024Significance of Chain of Thought in Gender Bias Mitigation for English-Dravidian Machine Translation30 May 2024
50 newest of 116 All 116 (JSON)
- 2024The Multilingual Alignment Prism: Aligning Global and Local Preferences to Reduce Harmcited by 67
- 2025The State of Multilingual LLM Safety Research: From Measuring the Language Gap to Mitigating Itcited by 42
- 2025Evaluating Machine Translation Datasets for Low-Web Data Languages: A Gendered Lenscited by 0
- 2025Evaluating Machine Translation Datasets for Low-Web Data Languages: A Gendered Lens5 Nov 2025
- 2025The State of Multilingual LLM Safety Research: From Measuring the Language Gap to Mitigating It30 May 2025
- 2024The Multilingual Alignment Prism: Aligning Global and Local Preferences to Reduce Harm26 Jun 2024
- 2023Survey of Social Bias in Vision-Language Modelscited by 26
- 2023Survey of Social Bias in Vision-Language Models24 Sep 2023
- 2021Societal Biases in Language Generation: Progress and Challengescited by 201
- 2021A Survey on Gender Bias in Natural Language Processingcited by 89
- 2021Quantifying Social Biases in NLP: A Generalization and Empirical Comparison of Extrinsic Fairness Metricscited by 83
- 2023Inseq: An Interpretability Toolkit for Sequence Generation Modelscited by 78
- 2024INCLUDE: Evaluating Multilingual Language Understanding with Regional Knowledgecited by 78
- 2022Theories of "Gender" in NLP Bias Researchcited by 62
- 2021Domain Adaptation and Multi-Domain Adaptation for Neural Machine Translation: A Surveycited by 46
- 2024IrokoBench: A New Benchmark for African Languages in the Age of Large Language Modelscited by 43
- 2024Angry Men, Sad Women: Large Language Models Reflect Gendered Stereotypes in Emotion Attributioncited by 39
- 2022MT-GenEval: A Counterfactual and Contextual Dataset for Evaluating Gender Accuracy in Machine Translationcited by 38
- 2022Representation Bias in Data: A Survey on Identification and Resolution Techniquescited by 37
- 2023Lost in Translation: Large Language Models in Non-English Content Analysiscited by 34
12 most cited of 108 All 108 (JSON)
- 2026Benchmarking Gender Bias in Machine Translation Evaluation Metrics across Occupations18 Sep 2026
- 2026Voice or Stereotype? Disentangling Acoustic and Content-Based Gender in Speech-to-Speech Models8 Sep 2026
- 2026Source-Free MT Evaluation Is Not MT Evaluation21 Aug 2026
- 2026Cultural Fidelity in English-to-Hindi Translation: A Preservation-Fluency Frontier for Gender Recoverability26 May 2026
- 2026Position: Natural Language Should Not Fully Replace Formal Languages10 May 2026
- 2026Explaining GAND: A Resource on Gender-Ambiguous Natural Data & Contrastive Attribution6 May 2026
- 2026ConGA: Guidelines for Contextual Gender Annotation. A Framework for Annotating Gender in Machine Translation18 Mar 2026
- 2026Gender Disambiguation in Machine Translation: Diagnostic Evaluation in Decoder-Only Architectures18 Mar 2026
- 2025Identifying Bias in Machine-generated Text Detection10 Dec 2025
- 2025Pragyaan: Designing and Curating High-Quality Cultural Post-Training Datasets for Indian Languages8 Oct 2025
- 2025GAMBIT+: A Challenge Set for Evaluating Gender Bias in Machine Translation Quality Estimation Metrics8 Oct 2025
- 2025What Is The Political Content in LLMs' Pre- and Post-Training Data?26 Sep 2025
12 newest of 108 All 108 (JSON)