Explaining GAND: A Resource on Gender-Ambiguous Natural Data & Contrastive Attribution
Not on the map. Why?
Abstract (arXiv)
Machine translation (MT) systems continue to produce gender-biased translations. In a time where self-expression is paramount, mistranslations based on default behaviour and stereotyping can lead to harm for users of these systems. To better understand how these systems translate gender in the absence of clear gender cues, we need benchmarking resources that reflect gender-ambiguous scenarios in a natural way. To this end, we present GAND, a gender-ambiguous natural data benchmarking resource for MT consisting of English source sentences, specifically designed to analyse the influence of contextual cues on gender in translation. We leverage GAND to conduct an interpretability analysis: we translate a subset of GAND into two grammatical gender languages and extend these with manually crafted contrastive translations. A following feature attribution analysis reveals source words in context that inform the gender translation of an ambiguous referent entity in the target translation.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 30 of its 48 references that are in the map. First posted on arXiv 6 May 2026.
Builds on
30 of 48 references.
References · 30
- 2016Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddingscited by 1,312
- 2020Language (Technology) is Power: A Critical Survey of "Bias" in NLPcited by 956
- 2020Stanza: A Python Natural Language Processing Toolkit for Many Human Languagescited by 723
- 2018Gender Bias in Coreference Resolution: Evaluation and Debiasing Methodscited by 659
- 2019Evaluating Gender Bias in Machine Translationcited by 249
- 2021Gender Bias in Machine Translationcited by 117
- 2019Getting Gender Right in Neural Machine Translationcited by 98
- 2022Interpreting Language Models with Contrastive Explanationscited by 92
- 2020Reducing Gender Bias in Neural Machine Translation as a Domain Adaptation Problemcited by 86
- 2023Inseq: An Interpretability Toolkit for Sequence Generation Modelscited by 78
- 2019An Evaluation of the Human-Interpretability of Explanationcited by 71
- 2021Collecting a Large-Scale Gender Bias Dataset for Coreference Resolution and Machine Translationcited by 62
18 more
- 2020Gender in Danger? Evaluating Speech Translation Technology on the MuST-SHE Corpuscited by 57
- 2022MT-GenEval: A Counterfactual and Contextual Dataset for Evaluating Gender Accuracy in Machine Translationcited by 38
- 2021First the worst: Finding better gender translations during beam searchcited by 29
- 2021Gender Bias Amplification During Speed-Quality Optimization in Neural Machine Translationcited by 28
- 2023Gender Neutralization for an Inclusive Machine Translation: from Theoretical Foundations to Open Challengescited by 22
- 2020Gender Coreference and Bias Evaluation at WMT 2020cited by 21
- 2023Hi Guys or Hi Folks? Benchmarking Gender-Neutral Machine Translation with the GeNTE Corpuscited by 20
- 2023A Tale of Pronouns: Interpretability Informs Gender Bias Mitigation for Fairer Instruction-Tuned Machine Translationcited by 19
- 2023GATE: A Challenge Set for Gender-Ambiguous Translation Examplescited by 18
- 2025Mind the Inclusivity Gap: Multilingual Gender-Neutral Translation Evaluation with mGeNTEcited by 12
- 2023Gender, names and other mysteries: Towards the ambiguous for gender-inclusive translationcited by 7
- 2025Are We Paying Attention to Her? Investigating Gender Disambiguation and Attention in Machine Translationcited by 7
- 2024MiTTenS: A Dataset for Evaluating Gender Mistranslationcited by 5
- 2025Voice, Bias, and Coreference: An Interpretability Study of Gender in Speech Translationcited by 5
- 2025GAMBIT+: A Challenge Set for Evaluating Gender Bias in Machine Translation Quality Estimation Metricscited by 4
- 2025Gender Bias in English-to-Greek Machine Translationcited by 3
- 2025The Unheard Alternative: Contrastive Explanations for Speech-to-Text Modelscited by 3
- 2025What Triggers my Model? Contrastive Explanations Inform Gender Choices by Translation Modelscited by 2
Built on by
Not cited yet.