They, Them, Theirs: Rewriting with Gender-Neutral English
Not on the map. Why?
Abstract (arXiv)
Responsible development of technology involves applications being inclusive of the diverse set of users they hope to support. An important part of this is understanding the many ways to refer to a person and being able to fluently change between the different forms as needed. We perform a case study on the singular they, a common way to promote gender inclusion in English. We define a re-writing task, create an evaluation benchmark, and show how a model can be trained to produce gender-neutral English with <1% word error rate with no human-labeled data. We discuss the practical applications and ethical considerations of the task, providing direction for future work into inclusive natural language systems.
Key facts. Cited by 44 papers in the map (data through 7 Oct 2026). Builds on 17 of its 26 references that are in the map. First posted on arXiv 12 Feb 2021.
Builds on
17 of 26 references.
References · 17
- 2017Attention Is All You Needcited by 59,932
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,530
- 2014Sequence to Sequence Learning with Neural Networkscited by 2,974
- 2015Neural Machine Translation of Rare Words with Subword Unitscited by 2,898
- 2019fairseq: A Fast, Extensible Toolkit for Sequence Modelingcited by 1,486
- 2016Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translationcited by 1,471
- 2018Model Cards for Model Reportingcited by 1,068
- 2020Language (Technology) is Power: A Critical Survey of "Bias" in NLPcited by 951
- 2020StereoSet: Measuring stereotypical bias in pretrained language modelscited by 911
- 2018Gender Bias in Coreference Resolution: Evaluation and Debiasing Methodscited by 657
- 2019The Woman Worked as a Babysitter: On Biases in Language Generationcited by 540
5 more
- 2018Gender Bias in Coreference Resolutioncited by 438
- 2017Six Challenges for Neural Machine Translationcited by 334
- 2019Mitigating Gender Bias in Natural Language Processing: Literature Reviewcited by 287
- 2019Lipstick on a Pig: Debiasing Methods Cover up Systematic Gender Biases in Word Embeddings But do not Remove Themcited by 268
- 2019Resolving Gendered Ambiguous Pronouns with BERTcited by 16
Built on by
Citing papers per year: 2021: 9; 2022: 7; 2023: 11; 2024: 11; 2025: 5; 2026: 1.
44 papers.
Sort:
- 2023Bias and Fairness in Large Language Models: A Surveycited by 626
- 2021Societal Biases in Language Generation: Progress and Challengescited by 201
- 2021Harms of Gender Exclusivity and Challenges in Non-Binary Representation in Language Technologiescited by 128
- 2021Gender Bias in Machine Translationcited by 116
- 2021A Survey on Gender Bias in Natural Language Processingcited by 89
- 2021NL-Augmenter: A Framework for Task-Sensitive Natural Language Augmentationcited by 72
- 2024Self-Debiasing Large Language Models: Zero-Shot Recognition and Reduction of Stereotypescited by 58
- 2022Perturbation Augmentation for Fairer NLPcited by 51
- 2021NeuTral Rewriter: A Rule-Based and Neural Approach to Automatic Rewriting into Gender-Neutral Alternativescited by 46
- 2021Improving Gender Fairness of Pre-Trained Language Models without Catastrophic Forgettingcited by 34
- 2021First the worst: Finding better gender translations during beam searchcited by 28
- 2022Text Style Transfer for Bias Mitigation using Masked Language Modelingcited by 27
32 more
- 2022Under the Morphosyntactic Lens: A Multifaceted Evaluation of Gender Bias in Speech Translationcited by 23
- 2022Challenges in Measuring Bias via Open-Ended Language Generationcited by 23
- 2024Deconstructing The Ethics of Large Language Models from Long-standing Issues to New-emerging Dilemmas: A Surveycited by 23
- 2023Gender Neutralization for an Inclusive Machine Translation: from Theoretical Foundations to Open Challengescited by 22
- 2023Hi Guys or Hi Folks? Benchmarking Gender-Neutral Machine Translation with the GeNTE Corpuscited by 20
- 2023GATE: A Challenge Set for Gender-Ambiguous Translation Examplescited by 18
- 2022How Conservative are Language Models? Adapting to the Introduction of Gender-Neutral Pronounscited by 16
- 2024From 'Showgirls' to 'Performers': Fine-tuning with Gender-inclusive Language for Bias Reduction in LLMscited by 15
- 2023Exploiting Biased Models to De-bias Text: A Gender-Fair Rewriting Modelcited by 14
- 2024Harmful Speech Detection by Language Models Exhibits Gender-Queer Dialect Biascited by 14
- 2023Queer People are People First: Deconstructing Sexual Identity Stereotypes in Large Language Modelscited by 13
- 2021The Arabic Parallel Gender Corpus 2.0: Extensions and Analysescited by 12
- 2024A Prompt Response to the Demand for Automatic Gender-Neutral Translationcited by 12
- 2023Tackling Bias in Pre-trained Language Models: Current Trends and Under-represented Societiescited by 11
- 2023Measuring Gender Bias in West Slavic Language Modelscited by 10
- 2022User-Centric Gender Rewritingcited by 7
- 2025Are We Paying Attention to Her? Investigating Gender Disambiguation and Attention in Machine Translationcited by 7
- 2023Gender-Inclusive Grammatical Error Correction through Augmentationcited by 6
- 2023Evaluating Bias and Fairness in Gender-Neutral Pretrained Vision-and-Language Modelscited by 6
- 2024MisgenderMender: A Community-Informed Approach to Interventions for Misgenderingcited by 6
- 2025Agree to Disagree? A Meta-Evaluation of LLM Misgenderingcited by 6
- 2024Gender Bias in Machine Translation and The Era of Large Language Modelscited by 4
- 2024GATE X-E : A Challenge Set for Gender-Fair Translations from Weakly-Gendered Languagescited by 4
- 2024The Life Cycle of Large Language Models: A Review of Biases in Educationcited by 3
- 2024Generating Gender Alternatives in Machine Translationcited by 3
- 2022The User-Aware Arabic Gender Rewritercited by 1
- 2025Man Made Language Models? Evaluating LLMs' Perpetuation of Masculine Generics Biascited by 1
- 2025GeNRe: A French Gender-Neutral Rewriting System Using Collective Nounscited by 1
- 2026Gender Disambiguation in Machine Translation: Diagnostic Evaluation in Decoder-Only Architecturescited by 1
- 2023Evaluating Gender Bias in the Translation of Gender-Neutral Languages into Englishcited by 0
- 2024Pronoun Logiccited by 0
- 2025Gender-Neutral Rewriting in Italian: Models, Approaches, and Trade-offscited by 0
- 2026Gender Disambiguation in Machine Translation: Diagnostic Evaluation in Decoder-Only Architectures18 Mar 2026
- 2025Gender-Neutral Rewriting in Italian: Models, Approaches, and Trade-offs16 Sep 2025
- 2025GeNRe: A French Gender-Neutral Rewriting System Using Collective Nouns29 May 2025
- 2025Are We Paying Attention to Her? Investigating Gender Disambiguation and Attention in Machine Translation13 May 2025
- 2025Agree to Disagree? A Meta-Evaluation of LLM Misgendering23 Apr 2025
- 2025Man Made Language Models? Evaluating LLMs' Perpetuation of Masculine Generics Bias14 Feb 2025
- 2024Pronoun Logic13 Sep 2024
- 2024Generating Gender Alternatives in Machine Translation29 Jul 2024
- 2024From 'Showgirls' to 'Performers': Fine-tuning with Gender-inclusive Language for Bias Reduction in LLMs5 Jul 2024
- 2024Deconstructing The Ethics of Large Language Models from Long-standing Issues to New-emerging Dilemmas: A Survey8 Jun 2024
- 2024The Life Cycle of Large Language Models: A Review of Biases in Education3 Jun 2024
- 2024Harmful Speech Detection by Language Models Exhibits Gender-Queer Dialect Bias23 May 2024
32 more
- 2024MisgenderMender: A Community-Informed Approach to Interventions for Misgendering23 Apr 2024
- 2024GATE X-E : A Challenge Set for Gender-Fair Translations from Weakly-Gendered Languages22 Feb 2024
- 2024A Prompt Response to the Demand for Automatic Gender-Neutral Translation8 Feb 2024
- 2024Self-Debiasing Large Language Models: Zero-Shot Recognition and Reduction of Stereotypes3 Feb 2024
- 2024Gender Bias in Machine Translation and The Era of Large Language Models18 Jan 2024
- 2023Tackling Bias in Pre-trained Language Models: Current Trends and Under-represented Societies3 Dec 2023
- 2023Evaluating Gender Bias in the Translation of Gender-Neutral Languages into English15 Nov 2023
- 2023Evaluating Bias and Fairness in Gender-Neutral Pretrained Vision-and-Language Models26 Oct 2023
- 2023Hi Guys or Hi Folks? Benchmarking Gender-Neutral Machine Translation with the GeNTE Corpus8 Oct 2023
- 2023Bias and Fairness in Large Language Models: A Survey2 Sep 2023
- 2023Queer People are People First: Deconstructing Sexual Identity Stereotypes in Large Language Models30 Jun 2023
- 2023Gender-Inclusive Grammatical Error Correction through Augmentation12 Jun 2023
- 2023Exploiting Biased Models to De-bias Text: A Gender-Fair Rewriting Model18 May 2023
- 2023Measuring Gender Bias in West Slavic Language Models12 Apr 2023
- 2023GATE: A Challenge Set for Gender-Ambiguous Translation Examples7 Mar 2023
- 2023Gender Neutralization for an Inclusive Machine Translation: from Theoretical Foundations to Open Challenges24 Jan 2023
- 2022The User-Aware Arabic Gender Rewriter14 Oct 2022
- 2022Perturbation Augmentation for Fairer NLP25 May 2022
- 2022Challenges in Measuring Bias via Open-Ended Language Generation23 May 2022
- 2022User-Centric Gender Rewriting4 May 2022
- 2022How Conservative are Language Models? Adapting to the Introduction of Gender-Neutral Pronouns11 Apr 2022
- 2022Under the Morphosyntactic Lens: A Multifaceted Evaluation of Gender Bias in Speech Translation18 Mar 2022
- 2022Text Style Transfer for Bias Mitigation using Masked Language Modeling21 Jan 2022
- 2021A Survey on Gender Bias in Natural Language Processing28 Dec 2021
- 2021NL-Augmenter: A Framework for Task-Sensitive Natural Language Augmentation6 Dec 2021
- 2021The Arabic Parallel Gender Corpus 2.0: Extensions and Analyses18 Oct 2021
- 2021Improving Gender Fairness of Pre-Trained Language Models without Catastrophic Forgetting11 Oct 2021
- 2021NeuTral Rewriter: A Rule-Based and Neural Approach to Automatic Rewriting into Gender-Neutral Alternatives13 Sep 2021
- 2021Harms of Gender Exclusivity and Challenges in Non-Binary Representation in Language Technologies27 Aug 2021
- 2021Societal Biases in Language Generation: Progress and Challenges10 May 2021
- 2021First the worst: Finding better gender translations during beam search15 Apr 2021
- 2021Gender Bias in Machine Translation13 Apr 2021
- 2023Bias and Fairness in Large Language Models: A Surveycited by 626
- 2021Societal Biases in Language Generation: Progress and Challengescited by 201
- 2021Harms of Gender Exclusivity and Challenges in Non-Binary Representation in Language Technologiescited by 128
- 2021Gender Bias in Machine Translationcited by 116
- 2021A Survey on Gender Bias in Natural Language Processingcited by 89
- 2021NL-Augmenter: A Framework for Task-Sensitive Natural Language Augmentationcited by 72
- 2024Self-Debiasing Large Language Models: Zero-Shot Recognition and Reduction of Stereotypescited by 58
- 2022Perturbation Augmentation for Fairer NLPcited by 51
- 2021NeuTral Rewriter: A Rule-Based and Neural Approach to Automatic Rewriting into Gender-Neutral Alternativescited by 46
- 2021Improving Gender Fairness of Pre-Trained Language Models without Catastrophic Forgettingcited by 34
- 2021First the worst: Finding better gender translations during beam searchcited by 28
- 2022Text Style Transfer for Bias Mitigation using Masked Language Modelingcited by 27
12 most cited of 44 All 44 (JSON)
- 2026Gender Disambiguation in Machine Translation: Diagnostic Evaluation in Decoder-Only Architectures18 Mar 2026
- 2025Gender-Neutral Rewriting in Italian: Models, Approaches, and Trade-offs16 Sep 2025
- 2025GeNRe: A French Gender-Neutral Rewriting System Using Collective Nouns29 May 2025
- 2025Are We Paying Attention to Her? Investigating Gender Disambiguation and Attention in Machine Translation13 May 2025
- 2025Agree to Disagree? A Meta-Evaluation of LLM Misgendering23 Apr 2025
- 2025Man Made Language Models? Evaluating LLMs' Perpetuation of Masculine Generics Bias14 Feb 2025
- 2024Pronoun Logic13 Sep 2024
- 2024Generating Gender Alternatives in Machine Translation29 Jul 2024
- 2024From 'Showgirls' to 'Performers': Fine-tuning with Gender-inclusive Language for Bias Reduction in LLMs5 Jul 2024
- 2024Deconstructing The Ethics of Large Language Models from Long-standing Issues to New-emerging Dilemmas: A Survey8 Jun 2024
- 2024The Life Cycle of Large Language Models: A Review of Biases in Education3 Jun 2024
- 2024Harmful Speech Detection by Language Models Exhibits Gender-Queer Dialect Bias23 May 2024
12 newest of 44 All 44 (JSON)