Harms of Gender Exclusivity and Challenges in Non-Binary Representation in Language Technologies
Not on the map. Why?
Abstract (arXiv)
Gender is widely discussed in the context of language tasks and when examining the stereotypes propagated by language models. However, current discussions primarily treat gender as binary, which can perpetuate harms such as the cyclical erasure of non-binary gender identities. These harms are driven by model and dataset biases, which are consequences of the non-recognition and lack of understanding of non-binary genders in society. In this paper, we explain the complexity of gender and language around it, and survey non-binary persons to understand harms associated with the treatment of gender as binary in English language technologies. We also detail how current language representations (e.g., GloVe, BERT) capture and perpetuate these harms and related challenges that need to be acknowledged and addressed for representations to equitably encode gender information.
Key facts. Cited by 128 papers in the map (data through 7 Oct 2026). Builds on 24 of its 56 references that are in the map. First posted on arXiv 27 Aug 2021.
Builds on
24 of 56 references.
References · 24
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2016Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddingscited by 1,304
- 2020Language (Technology) is Power: A Critical Survey of "Bias" in NLPcited by 951
- 2016Semantics derived automatically from language corpora contain human-like biasescited by 894
- 2018Gender Bias in Coreference Resolution: Evaluation and Debiasing Methodscited by 657
- 2020Null It Out: Guarding Protected Attributes by Iterative Nullspace Projectioncited by 442
- 2018Gender Bias in Coreference Resolutioncited by 438
- 2017Men Also Like Shopping: Reducing Gender Bias Amplification using Corpus-level Constraintscited by 420
- 2018Fairness Without Demographics in Repeated Loss Minimizationcited by 363
- 2018AllenNLP: A Deep Semantic Natural Language Processing Platformcited by 347
- 2019Bias in Bios: A Case Study of Semantic Representation Bias in a High-Stakes Settingcited by 346
- 2019Mitigating Gender Bias in Natural Language Processing: Literature Reviewcited by 287
12 more
- 2019Gender Bias in Contextualized Word Embeddingscited by 203
- 2021Societal Biases in Language Generation: Progress and Challengescited by 201
- 2019Assessing Social and Intersectional Biases in Contextualized Word Representationscited by 134
- 2019On Measuring and Mitigating Biased Inferences of Word Embeddingscited by 112
- 2019Toward Gender-Inclusive Coreference Resolutioncited by 84
- 2019Attenuating Bias in Word Vectorscited by 64
- 2021They, Them, Theirs: Rewriting with Gender-Neutral Englishcited by 44
- 2020OSCaR: Orthogonal Subspace Correction and Rectification of Biases in Word Embeddingscited by 40
- 2019Man is to Person as Woman is to Location: Measuring Gender Bias in Named Entity Recognitioncited by 28
- 2016Shirtless and Dangerous: Quantifying Linguistic Signals of Gender Bias in an Online Fiction Writing Communitycited by 21
- 2021Adapting Coreference Resolution for Processing Violent Death Narrativescited by 3
- 2020The Geometry of Distributed Representations for Better Alignment, Attenuated Bias, and Improved Interpretabilitycited by 1
Built on by
Citing papers per year: 2021: 2; 2022: 31; 2023: 37; 2024: 28; 2025: 19; 2026: 11.
128 papers.
Sort:
By area:
- 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
- 2022Scaling Instruction-Finetuned Language Modelscited by 2,997
- 2023PaLM 2 Technical Reportcited by 1,154
- 2022GLM-130B: An Open Bilingual Pre-trained Modelcited by 837
- 2022DALL-Eval: Probing the Reasoning Skills and Social Biases of Text-to-Image Generation Modelscited by 230
- 2022MERLOT Reserve: Neural Script Knowledge through Vision and Language and Soundcited by 184
- 2023HRS-Bench: Holistic, Reliable and Scalable Benchmark for Text-to-Image Modelscited by 94
- 2022How well can Text-to-Image Generative Models understand Ethical Natural Language Interventions?cited by 92
- 2023Language Model Behavior: A Comprehensive Surveycited by 92
- 2023NLPositionality: Characterizing Design Biases of Datasets and Modelscited by 91
- 2022Theories of "Gender" in NLP Bias Researchcited by 62
- 2022Handling Bias in Toxic Speech Detection: A Surveycited by 60
38 more
- 2024Fairness in Large Language Models: A Taxonomic Surveycited by 57
- 2023"I'm fully who I am": Towards Centering Transgender and Non-Binary Voices to Measure Biases in Open Language Generationcited by 56
- 2023VisoGender: A dataset for benchmarking gender bias in image-text pronoun resolutioncited by 52
- 2022Perturbation Augmentation for Fairer NLPcited by 51
- 2024Evaluating Gender Bias in Large Language Models via Chain-of-Thought Promptingcited by 49
- 2022Debiasing isn't enough! -- On the Effectiveness of Debiasing MLMs and their Social Biases in Downstream Taskscited by 48
- 2022Welcome to the Modern World of Pronouns: Identity-Inclusive Natural Language Processing beyond Gendercited by 47
- 2023MISGENDERED: Limits of Large Language Models in Understanding Pronounscited by 43
- 2022Controllable Text Generation with Neurally-Decomposed Oraclecited by 41
- 2024Segment Any Text: A Universal Approach for Robust, Efficient and Adaptable Sentence Segmentationcited by 41
- 2022Mitigating Gender Bias in Distilled Language Models via Counterfactual Role Reversalcited by 40
- 2023Queer In AI: A Case Study in Community-Led Participatory AIcited by 33
- 2022The Tail Wagging the Dog: Dataset Construction Biases of Social Bias Benchmarkscited by 31
- 2024Large Language Models Portray Socially Subordinate Groups as More Homogeneous, Consistent with a Bias Observed in Humanscited by 31
- 2024GenderBias-VL: Benchmarking Gender Bias in Vision Language Models via Counterfactual Probingcited by 31
- 2022GeoMLAMA: Geo-Diverse Commonsense Probing on Multilingual Pre-Trained Language Modelscited by 30
- 2021Socially Aware Bias Measurements for Hindi Language Representationscited by 29
- 2022Choose Your Lenses: Flaws in Gender Bias Evaluationcited by 29
- 2022Causally Testing Gender Bias in LLMs: A Case Study on Occupational Biascited by 28
- 2022Text Style Transfer for Bias Mitigation using Masked Language Modelingcited by 27
- 2023Stereotypes and Smut: The (Mis)representation of Non-cisgender Identities by Text-to-Image Modelscited by 26
- 2023It Takes Two to Tango: Navigating Conceptualizations of NLP Tasks and Measurements of Performancecited by 25
- 2022Gender Bias in Word Embeddings: A Comprehensive Analysis of Frequency, Syntax, and Semanticscited by 24
- 2023Gender Biases in Automatic Evaluation Metrics for Image Captioningcited by 24
- 2024On Behalf of the Stakeholders: Trends in NLP Model Interpretability in the Era of LLMscited by 24
- 2023STAIR: Learning Sparse Text and Image Representation in Grounded Tokenscited by 23
- 2023Evaluating General-Purpose AI with Psychometricscited by 23
- 2023Gender Neutralization for an Inclusive Machine Translation: from Theoretical Foundations to Open Challengescited by 22
- 2024Stop! In the Name of Flaws: Disentangling Personal Names and Sociodemographic Attributes in NLPcited by 22
- 2021DS-TOD: Efficient Domain Specialization for Task Oriented Dialogcited by 21
- 2024AboutMe: Using Self-Descriptions in Webpages to Document the Effects of English Pretraining Data Filterscited by 21
- 2023Automated Ableism: An Exploration of Explicit Disability Biases in Sentiment and Toxicity Analysis Modelscited by 20
- 2023Hi Guys or Hi Folks? Benchmarking Gender-Neutral Machine Translation with the GeNTE Corpuscited by 20
- 2024The Colorful Future of LLMs: Evaluating and Improving LLMs as Emotional Supporters for Queer Youthcited by 20
- 2023What about em? How Commercial Machine Translation Fails to Handle (Neo-)Pronounscited by 19
- 2022Fair and Argumentative Language Modeling for Computational Argumentationcited by 18
- 2022Better Hit the Nail on the Head than Beat around the Bush: Removing Protected Attributes with a Single Projectioncited by 17
- 2024Robust Pronoun Fidelity with English LLMs: Are they Reasoning, Repeating, or Just Biased?cited by 17
50 most cited of 128 All 128 (JSON)
- 2026Voice or Stereotype? Disentangling Acoustic and Content-Based Gender in Speech-to-Speech Models8 Sep 2026
- 2026Symphony of Bias: Exploring Gender Associations with Musical Instruments in Multimodal LLMs29 Jul 2026
- 2026Beyond wheelchairs and blindfolds: Investigating disability stereotypes in T2I models with INCLUDE-BENCH9 Jul 2026
- 2026On Defining Erasure Harms for NLP14 Jun 2026
- 2026Vision-Language Models Suppress Female Representations Under Ambiguous Input29 May 2026
- 2026Omissive Bias in Religious Representation: Benchmarking LLM Answers to Everyday Ethical Decision-making23 May 2026
- 2026Magic, Madness, Heaven, Sin: LLM Output Diversity is Everything, Everywhere, All at Once2 Apr 2026
- 2026ProText: A benchmark dataset for measuring (mis)gendering in long-form texts29 Mar 2026
- 2026Operationalizing Perceptions of Agent Gender: Foundations and Guidelines10 Mar 2026
- 2026Implicit Bias in LLMs for Transgender Populations2 Feb 2026
- 2026When LLMs Imagine People: A Human-Centered Persona Brainstorm Audit for Bias and Fairness in Creative Applications19 Jan 2026
- 2025Identifying Bias in Machine-generated Text Detection10 Dec 2025
38 more
- 2025SLAyiNG: A Diverse and Community-validated Dataset of Queer Slang22 Sep 2025
- 2025Gender-Neutral Rewriting in Italian: Models, Approaches, and Trade-offs16 Sep 2025
- 2025Gender-Neutral Machine Translation Strategies in Practice18 Jun 2025
- 2025Gender Inclusivity Fairness Index (GIFI): A Multilevel Framework for Evaluating Gender Diversity in Large Language Models18 Jun 2025
- 2025Iterative Multilingual Spectral Attribute Erasure12 Jun 2025
- 2025Understanding and Meeting Practitioner Needs When Measuring Representational Harms Caused by LLM-Based Systems4 Jun 2025
- 2025EuroGEST: Investigating gender stereotypes in multilingual language models4 Jun 2025
- 2025Understanding Gender Bias in AI-Generated Product Descriptions3 Jun 2025
- 2025Analyzing values about gendered language reform in LLMs' revisions27 May 2025
- 2025Identities are not Interchangeable: The Problem of Overgeneralization in Fair Machine Learning7 May 2025
- 2025Colombian Waitresses y Jueces canadienses: Gender and Country Biases in Occupation Recommendations from LLMs5 May 2025
- 2025Agree to Disagree? A Meta-Evaluation of LLM Misgendering23 Apr 2025
- 2025An LLM-as-a-judge Approach for Scalable Gender-Neutral Translation Evaluation16 Apr 2025
- 2025A Bayesian account of pronoun and neopronoun acquisition3 Apr 2025
- 2025Scaling Crowdsourced Election Monitoring: Construction and Evaluation of Classification Models for Multilingual and Cross-Domain Classification Settings5 Mar 2025
- 2025Robust Bias Detection in MLMs and its Application to Human Trait Ratings21 Feb 2025
- 2025The Cake that is Intelligence and Who Gets to Bake it: An AI Analogy and its Implications for Participation5 Feb 2025
- 2025LLMs Reproduce Stereotypes of Sexual and Gender Minorities10 Jan 2025
- 2024Vision-Language Models Generate More Homogeneous Stories for Phenotypically Black Individuals12 Dec 2024
- 2024How far can bias go? Tracing bias from pretraining data to alignment28 Nov 2024
- 2024The Root Shapes the Fruit: On the Persistence of Gender-Exclusive Harms in Aligned Language Models6 Nov 2024
- 2024Speciesism in Natural Language Processing Research18 Oct 2024
- 2024Ethics Whitepaper: Whitepaper on Ethical Research into Large Language Models17 Oct 2024
- 2024What the Harm? Quantifying the Tangible Impact of Gender Bias in Machine Translation with a Human-centered Study1 Oct 2024
- 2024Do language models practice what they preach? Examining language ideologies about gendered language reform encoded in LLMs20 Sep 2024
- 2024Gender Representation and Bias in Indian Civil Service Mock Interviews18 Sep 2024
- 2024On Behalf of the Stakeholders: Trends in NLP Model Interpretability in the Era of LLMs27 Jul 2024
- 2024How Are LLMs Mitigating Stereotyping Harms? Learning from Search Engine Studies16 Jul 2024
- 2024GenderBias-VL: Benchmarking Gender Bias in Vision Language Models via Counterfactual Probing30 Jun 2024
- 2024Segment Any Text: A Universal Approach for Robust, Efficient and Adaptable Sentence Segmentation24 Jun 2024
- 2024Evaluating Short-Term Temporal Fluctuations of Social Biases in Social Media Data and Masked Language Models19 Jun 2024
- 2024Stop! In the Name of Flaws: Disentangling Personal Names and Sociodemographic Attributes in NLP27 May 2024
- 2024Enhancing Gender-Inclusive Machine Translation with Neomorphemes and Large Language Models14 May 2024
- 2024Hire Me or Not? Examining Language Model's Behavior with Occupation Attributes6 May 2024
- 2024Transforming Dutch: Debiasing Dutch Coreference Resolution Systems for Non-binary Pronouns30 Apr 2024
- 2024MisgenderMender: A Community-Informed Approach to Interventions for Misgendering23 Apr 2024
- 2024Robust Pronoun Fidelity with English LLMs: Are they Reasoning, Repeating, or Just Biased?4 Apr 2024
- 2024Fairness in Large Language Models: A Taxonomic Survey31 Mar 2024
50 newest of 128 All 128 (JSON)
- 2023PaLM 2 Technical Reportcited by 1,154
- 2022DALL-Eval: Probing the Reasoning Skills and Social Biases of Text-to-Image Generation Modelscited by 230
- 2024Evaluating Gender Bias in Large Language Models via Chain-of-Thought Promptingcited by 49
- 2024Robust Pronoun Fidelity with English LLMs: Are they Reasoning, Repeating, or Just Biased?cited by 17
- 2022Do Vision-and-Language Transformers Learn Grounded Predicate-Noun Dependencies?cited by 8
- 2024Robust Pronoun Fidelity with English LLMs: Are they Reasoning, Repeating, or Just Biased?4 Apr 2024
- 2024Evaluating Gender Bias in Large Language Models via Chain-of-Thought Prompting28 Jan 2024
- 2023PaLM 2 Technical Report17 May 2023
- 2022Do Vision-and-Language Transformers Learn Grounded Predicate-Noun Dependencies?21 Oct 2022
- 2022DALL-Eval: Probing the Reasoning Skills and Social Biases of Text-to-Image Generation Models8 Feb 2022
- 2023VisoGender: A dataset for benchmarking gender bias in image-text pronoun resolutioncited by 52
- 2024GenderBias-VL: Benchmarking Gender Bias in Vision Language Models via Counterfactual Probingcited by 31
- 2024Vision-Language Models Generate More Homogeneous Stories for Phenotypically Black Individualscited by 6
- 2026Vision-Language Models Suppress Female Representations Under Ambiguous Inputcited by 1
- 2026Vision-Language Models Suppress Female Representations Under Ambiguous Input29 May 2026
- 2024Vision-Language Models Generate More Homogeneous Stories for Phenotypically Black Individuals12 Dec 2024
- 2024GenderBias-VL: Benchmarking Gender Bias in Vision Language Models via Counterfactual Probing30 Jun 2024
- 2023VisoGender: A dataset for benchmarking gender bias in image-text pronoun resolution21 Jun 2023
- 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
- 2022Scaling Instruction-Finetuned Language Modelscited by 2,997
- 2022GLM-130B: An Open Bilingual Pre-trained Modelcited by 837
- 2022MERLOT Reserve: Neural Script Knowledge through Vision and Language and Soundcited by 184
- 2022How well can Text-to-Image Generative Models understand Ethical Natural Language Interventions?cited by 92
- 2023Language Model Behavior: A Comprehensive Surveycited by 92
- 2023NLPositionality: Characterizing Design Biases of Datasets and Modelscited by 91
- 2022Theories of "Gender" in NLP Bias Researchcited by 62
- 2022Handling Bias in Toxic Speech Detection: A Surveycited by 60
- 2024Fairness in Large Language Models: A Taxonomic Surveycited by 57
- 2023"I'm fully who I am": Towards Centering Transgender and Non-Binary Voices to Measure Biases in Open Language Generationcited by 56
- 2022Perturbation Augmentation for Fairer NLPcited by 51
12 most cited of 116 All 116 (JSON)
- 2026Voice or Stereotype? Disentangling Acoustic and Content-Based Gender in Speech-to-Speech Models8 Sep 2026
- 2026Symphony of Bias: Exploring Gender Associations with Musical Instruments in Multimodal LLMs29 Jul 2026
- 2026Beyond wheelchairs and blindfolds: Investigating disability stereotypes in T2I models with INCLUDE-BENCH9 Jul 2026
- 2026On Defining Erasure Harms for NLP14 Jun 2026
- 2026Omissive Bias in Religious Representation: Benchmarking LLM Answers to Everyday Ethical Decision-making23 May 2026
- 2026Magic, Madness, Heaven, Sin: LLM Output Diversity is Everything, Everywhere, All at Once2 Apr 2026
- 2026ProText: A benchmark dataset for measuring (mis)gendering in long-form texts29 Mar 2026
- 2026Implicit Bias in LLMs for Transgender Populations2 Feb 2026
- 2026When LLMs Imagine People: A Human-Centered Persona Brainstorm Audit for Bias and Fairness in Creative Applications19 Jan 2026
- 2025Identifying Bias in Machine-generated Text Detection10 Dec 2025
- 2025SLAyiNG: A Diverse and Community-validated Dataset of Queer Slang22 Sep 2025
- 2025Gender-Neutral Rewriting in Italian: Models, Approaches, and Trade-offs16 Sep 2025
12 newest of 116 All 116 (JSON)