Black is to Criminal as Caucasian is to Police: Detecting and Removing Multiclass Bias in Word Embeddings
Not on the map. Why?
Abstract (arXiv)
Online texts -- across genres, registers, domains, and styles -- are riddled with human stereotypes, expressed in overt or subtle ways. Word embeddings, trained on these texts, perpetuate and amplify these stereotypes, and propagate biases to machine learning models that use word embeddings as features. In this work, we propose a method to debias word embeddings in multiclass settings such as race and religion, extending the work of (Bolukbasi et al., 2016) from the binary setting, such as binary gender. Next, we propose a novel methodology for the evaluation of multiclass debiasing. We demonstrate that our multiclass debiasing is robust and maintains the efficacy in standard NLP tasks.
Key facts. Cited by 146 papers in the map (data through 7 Oct 2026). First posted on arXiv 3 Apr 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 39; 2022: 34; 2023: 26; 2024: 28; 2025: 14; 2026: 5.
146 papers.
Sort:
By area:
- 2023Bias and Fairness in Large Language Models: A Surveycited by 626
- 2022Using DeepSpeed and Megatron to Train Megatron-Turing NLG 530B, A Large-Scale Generative Language Modelcited by 557
- 2021Towards Understanding and Mitigating Social Biases in Language Modelscited by 294
- 2021Latent Hatred: A Benchmark for Understanding Implicit Hate Speechcited by 216
- 2023Debiasing Vision-Language Models via Biased Promptscited by 147
- 2021Gender Bias in Machine Translationcited by 116
- 2022A Prompt Array Keeps the Bias Away: Debiasing Vision-Language Models with Adversarial Learningcited by 104
- 2021Re-imagining Algorithmic Fairness in India and Beyondcited by 102
- 2021An Empirical Survey of the Effectiveness of Debiasing Techniques for Pre-trained Language Modelscited by 96
- 2021An Interpretability Illusion for BERTcited by 94
- 2024Large Language Models are Geographically Biasedcited by 91
- 2021Are Gender-Neutral Queries Really Gender-Neutral? Mitigating Gender Bias in Image Searchcited by 90
38 more
- 2021A Survey on Gender Bias in Natural Language Processingcited by 89
- 2021Mitigating Language-Dependent Ethnic Bias in BERTcited by 87
- 2021What's in the Box? A Preliminary Analysis of Undesirable Content in the Common Crawl Corpuscited by 79
- 2021FairFil: Contrastive Neural Debiasing Method for Pretrained Text Encoderscited by 75
- 2021A Survey of Race, Racism, and Anti-Racism in NLPcited by 74
- 2021Low-Complexity Probing via Finding Subnetworkscited by 63
- 2022Theories of "Gender" in NLP Bias Researchcited by 62
- 2021Unmasking the Mask -- Evaluating Social Biases in Masked Language Modelscited by 60
- 2022Re-contextualizing Fairness in NLP: The Case of Indiacited by 55
- 2023Bias Against 93 Stigmatized Groups in Masked Language Models and Downstream Sentiment Classification Taskscited by 51
- 2022Representation Bias in Data: A Survey on Identification and Resolution Techniquescited by 37
- 2022Gold Doesn't Always Glitter: Spectral Removal of Linear and Nonlinear Guarded Attribute Informationcited by 33
- 2024IndiBias: A Benchmark Dataset to Measure Social Biases in Language Models for Indian Contextcited by 32
- 2021Evaluating Debiasing Techniques for Intersectional Biasescited by 30
- 2021Unpacking the Interdependent Systems of Discrimination: Ableist Bias in NLP Systems through an Intersectional Lenscited by 30
- 2021Socially Aware Bias Measurements for Hindi Language Representationscited by 29
- 2022Causally Testing Gender Bias in LLMs: A Case Study on Occupational Biascited by 28
- 2023Sociodemographic Bias in Language Models: A Survey and Forward Pathcited by 27
- 2023Survey of Social Bias in Vision-Language Modelscited by 26
- 2024VLBiasBench: A Comprehensive Benchmark for Evaluating Bias in Large Vision-Language Modelcited by 26
- 2021Dictionary-based Debiasing of Pre-trained Word Embeddingscited by 24
- 2021Understanding and Countering Stereotypes: A Computational Approach to the Stereotype Content Modelcited by 23
- 2023MultiModal Bias: Introducing a Framework for Stereotypical Bias Assessment beyond Gender and Race in Vision Language Modelscited by 23
- 2023NBIAS: A Natural Language Processing Framework for Bias Identification in Textcited by 23
- 2023Analyzing And Editing Inner Mechanisms Of Backdoored Language Modelscited by 22
- 2022Deep Learning on a Healthy Data Diet: Finding Important Examples for Fairnesscited by 21
- 2022ADEPT: A DEbiasing PrompT Frameworkcited by 20
- 2023Evaluating Biased Attitude Associations of Language Models in an Intersectional Contextcited by 20
- 2022Sense Embeddings are also Biased--Evaluating Social Biases in Static and Contextualised Sense Embeddingscited by 18
- 2022Fair and Argumentative Language Modeling for Computational Argumentationcited by 18
- 2025BiasEdit: Debiasing Stereotyped Language Models via Model Editingcited by 18
- 2024Spoken Stereoset: On Evaluating Social Bias Toward Speaker in Speech Large Language Modelscited by 15
- 2021Assessing the Reliability of Word Embedding Gender Bias Measurescited by 14
- 2022StereoKG: Data-Driven Knowledge Graph Construction for Cultural Knowledge and Stereotypescited by 14
- 2021On the Interaction of Belief Bias and Explanationscited by 13
- 2022Mapping the Multilingual Margins: Intersectional Biases of Sentiment Analysis Systems in English, Spanish, and Arabiccited by 13
- 2023Bias A-head? Analyzing Bias in Transformer-Based Language Model Attention Headscited by 13
- 2021The Arabic Parallel Gender Corpus 2.0: Extensions and Analysescited by 12
50 most cited of 146 All 146 (JSON)
- 2026GGSS: Geodesic-Gated Spherical Steering for Inference-Time Debiasing of Generative Vision-Language Models26 Aug 2026
- 2026Towards Distillation Guarantees under Algorithmic Alignment for Combinatorial Optimization19 May 2026
- 2026Shiny Stories, Hidden Struggles: Investigating the Representation of Disability Through the Lens of LLMs2 Apr 2026
- 2026Investigating Associational Biases in Inter-Model Communication of Large Generative Models29 Jan 2026
- 2026Assessing the quality and coherence of word embeddings after SCM-based intersectional bias mitigation7 Jan 2026
- 2025Eliminating Inductive Bias in Reward Models with Information-Theoretic Guidance29 Dec 2025
- 2025Textual Data Bias Detection and Mitigation -- An Extensible Pipeline with Experimental Evaluation11 Dec 2025
- 2025Erasing 'Ugly' from the Internet: Propagation of the Beauty Myth in Text-Image Models2 Nov 2025
- 2025Fair-GPTQ: Bias-Aware Quantization for Large Language Models18 Sep 2025
- 2025From Charts to Fair Narratives: Uncovering and Mitigating Geo-Economic Biases in Chart-to-Text13 Aug 2025
- 2025Exploring Gender Bias in Large Language Models: An In-depth Dive into the German Language22 Jul 2025
- 2025Theories of "Sexuality" in Natural Language Processing Bias Research22 Jun 2025
38 more
- 2025HESEIA: A community-based dataset for evaluating social biases in large language models, co-designed in real school settings in Latin America30 May 2025
- 2025A Comprehensive Analysis of Large Language Model Outputs: Similarity, Diversity, and Bias14 May 2025
- 2025A Comparative Analysis of Ethical and Safety Gaps in LLMs using Relative Danger Coefficient6 May 2025
- 2025Word Embeddings Track Social Group Changes Across 70 Years in China12 Apr 2025
- 2025BiasEdit: Debiasing Stereotyped Language Models via Model Editing11 Mar 2025
- 2025Rethinking Word Similarity: Semantic Similarity through Classification Confusion8 Feb 2025
- 2025Bridging the Fairness Gap: Enhancing Pre-trained Models with LLM-Generated Sentences12 Jan 2025
- 2024More is Less? A Simulation-Based Approach to Dynamic Interactions between Biases in Multimodal Models23 Dec 2024
- 2024The "LLM World of Words" English free association norms generated by large language models2 Dec 2024
- 2024The Master-Slave Encoder Model for Improving Patent Text Summarization: A New Approach to Combining Specifications and Claims21 Nov 2024
- 2024Advancing Crime Linkage Analysis with Machine Learning: A Comprehensive Review and Framework for Data-Driven Approaches30 Oct 2024
- 2024Attention Speaks Volumes: Localizing and Mitigating Bias in Language Models29 Oct 2024
- 2024On Debiasing Text Embeddings Through Context Injection14 Oct 2024
- 2024Collapsed Language Models Promote Fairness6 Oct 2024
- 2024Responsible AI in Open Ecosystems: Reconciling Innovation with Risk Assessment and Disclosure27 Sep 2024
- 2024GrEmLIn: A Repository of Green Baseline Embeddings for 87 Low-Resource Languages Injected with Multilingual Graph Knowledge26 Sep 2024
- 2024Bias Begets Bias: The Impact of Biased Embeddings on Diffusion Models15 Sep 2024
- 2024Spoken Stereoset: On Evaluating Social Bias Toward Speaker in Speech Large Language Models14 Aug 2024
- 2024Social Debiasing for Fair Multi-modal LLMs13 Aug 2024
- 2024ML-EAT: A Multilevel Embedding Association Test for Interpretable and Transparent Social Science4 Aug 2024
- 2024How Are LLMs Mitigating Stereotyping Harms? Learning from Search Engine Studies16 Jul 2024
- 2024Characterizing Stereotypical Bias from Privacy-preserving Pre-Training30 Jun 2024
- 2024VLBiasBench: A Comprehensive Benchmark for Evaluating Bias in Large Vision-Language Model20 Jun 2024
- 2024GECOBench: A Gender-Controlled Text Dataset and Benchmark for Quantifying Biases in Explanations17 Jun 2024
- 2024Improving Commonsense Bias Classification by Mitigating the Influence of Demographic Terms11 Jun 2024
- 2024A Comprehensive Analysis of Static Word Embeddings for Turkish13 May 2024
- 2024A Comparative Analysis of Word-Level Metric Differential Privacy: Benchmarking The Privacy-Utility Trade-off4 Apr 2024
- 2024Polarity Calibration for Opinion Summarization2 Apr 2024
- 2024IndiBias: A Benchmark Dataset to Measure Social Biases in Language Models for Indian Context29 Mar 2024
- 2024Debiasing Sentence Embedders through Contrastive Word Pairs27 Mar 2024
- 2024Measuring Social Biases in Masked Language Models by Proxy of Prediction Quality21 Feb 2024
- 2024From Prejudice to Parity: A New Approach to Debiasing Large Language Model Word Embeddings18 Feb 2024
- 2024MAFIA: Multi-Adapter Fused Inclusive LanguAge Models12 Feb 2024
- 2024Measuring Machine Learning Harms from Stereotypes Requires Understanding Who Is Harmed by Which Errors in What Ways6 Feb 2024
- 2024Large Language Models are Geographically Biased5 Feb 2024
- 2023The Media Bias Taxonomy: A Systematic Literature Review on the Forms and Automated Detection of Media Bias26 Dec 2023
- 2023Bias A-head? Analyzing Bias in Transformer-Based Language Model Attention Heads17 Nov 2023
- 2023P^3SUM: Preserving Author's Perspective in News Summarization with Diffusion Language Models16 Nov 2023
50 newest of 146 All 146 (JSON)
- 2023Debiasing Vision-Language Models via Biased Promptscited by 147
- 2022A Prompt Array Keeps the Bias Away: Debiasing Vision-Language Models with Adversarial Learningcited by 104
- 2023Survey of Social Bias in Vision-Language Modelscited by 26
- 2024VLBiasBench: A Comprehensive Benchmark for Evaluating Bias in Large Vision-Language Modelcited by 26
- 2023MultiModal Bias: Introducing a Framework for Stereotypical Bias Assessment beyond Gender and Race in Vision Language Modelscited by 23
- 2024Social Debiasing for Fair Multi-modal LLMscited by 8
- 2026GGSS: Geodesic-Gated Spherical Steering for Inference-Time Debiasing of Generative Vision-Language Modelscited by 0
- 2026GGSS: Geodesic-Gated Spherical Steering for Inference-Time Debiasing of Generative Vision-Language Models26 Aug 2026
- 2024Social Debiasing for Fair Multi-modal LLMs13 Aug 2024
- 2024VLBiasBench: A Comprehensive Benchmark for Evaluating Bias in Large Vision-Language Model20 Jun 2024
- 2023Survey of Social Bias in Vision-Language Models24 Sep 2023
- 2023MultiModal Bias: Introducing a Framework for Stereotypical Bias Assessment beyond Gender and Race in Vision Language Models16 Mar 2023
- 2023Debiasing Vision-Language Models via Biased Prompts31 Jan 2023
- 2022A Prompt Array Keeps the Bias Away: Debiasing Vision-Language Models with Adversarial Learning22 Mar 2022
- 2024Large Language Models are Geographically Biasedcited by 91
- 2024Large Language Models are Geographically Biased5 Feb 2024
- 2023Bias and Fairness in Large Language Models: A Surveycited by 626
- 2022Using DeepSpeed and Megatron to Train Megatron-Turing NLG 530B, A Large-Scale Generative Language Modelcited by 557
- 2021Towards Understanding and Mitigating Social Biases in Language Modelscited by 294
- 2021Latent Hatred: A Benchmark for Understanding Implicit Hate Speechcited by 216
- 2021Gender Bias in Machine Translationcited by 116
- 2021Re-imagining Algorithmic Fairness in India and Beyondcited by 102
- 2021An Empirical Survey of the Effectiveness of Debiasing Techniques for Pre-trained Language Modelscited by 96
- 2021An Interpretability Illusion for BERTcited by 94
- 2021Are Gender-Neutral Queries Really Gender-Neutral? Mitigating Gender Bias in Image Searchcited by 90
- 2021A Survey on Gender Bias in Natural Language Processingcited by 89
- 2021Mitigating Language-Dependent Ethnic Bias in BERTcited by 87
- 2021What's in the Box? A Preliminary Analysis of Undesirable Content in the Common Crawl Corpuscited by 79
12 most cited of 134 All 134 (JSON)
- 2026Towards Distillation Guarantees under Algorithmic Alignment for Combinatorial Optimization19 May 2026
- 2026Shiny Stories, Hidden Struggles: Investigating the Representation of Disability Through the Lens of LLMs2 Apr 2026
- 2026Investigating Associational Biases in Inter-Model Communication of Large Generative Models29 Jan 2026
- 2026Assessing the quality and coherence of word embeddings after SCM-based intersectional bias mitigation7 Jan 2026
- 2025Textual Data Bias Detection and Mitigation -- An Extensible Pipeline with Experimental Evaluation11 Dec 2025
- 2025Erasing 'Ugly' from the Internet: Propagation of the Beauty Myth in Text-Image Models2 Nov 2025
- 2025Fair-GPTQ: Bias-Aware Quantization for Large Language Models18 Sep 2025
- 2025From Charts to Fair Narratives: Uncovering and Mitigating Geo-Economic Biases in Chart-to-Text13 Aug 2025
- 2025Exploring Gender Bias in Large Language Models: An In-depth Dive into the German Language22 Jul 2025
- 2025Theories of "Sexuality" in Natural Language Processing Bias Research22 Jun 2025
- 2025HESEIA: A community-based dataset for evaluating social biases in large language models, co-designed in real school settings in Latin America30 May 2025
- 2025A Comprehensive Analysis of Large Language Model Outputs: Similarity, Diversity, and Bias14 May 2025
12 newest of 134 All 134 (JSON)