Unsupervised Discovery of Implicit Gender Bias
Not on the map. Why?
Abstract (arXiv)
Despite their prevalence in society, social biases are difficult to identify, primarily because human judgements in this domain can be unreliable. We take an unsupervised approach to identifying gender bias against women at a comment level and present a model that can surface text likely to contain bias. Our main challenge is forcing the model to focus on signs of implicit bias, rather than other artifacts in the data. Thus, our methodology involves reducing the influence of confounds through propensity matching and adversarial learning. Our analysis shows how biased comments directed towards female politicians contain mixed criticisms, while comments directed towards other female public figures focus on appearance and sexualization. Ultimately, our work offers a way to capture subtle biases in various domains without relying on subjective human judgements.
Key facts. Cited by 34 papers in the map (data through 7 Oct 2026). First posted on arXiv 17 Apr 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 9; 2022: 10; 2023: 9; 2024: 4; 2025: 2.
34 papers.
Sort:
By area:
- 2022Language Generation Models Can Cause Harm: So What Can We Do About It? An Actionable Surveycited by 80
- 2021Controlled Text Generation as Continuous Optimization with Multiple Constraintscited by 70
- 2022Gradient-Based Constrained Sampling from Language Modelscited by 64
- 2021Uncovering Implicit Gender Bias in Narratives through Commonsense Inferencecited by 32
- 2023Sociodemographic Bias in Language Models: A Survey and Forward Pathcited by 27
- 2022SODAPOP: Open-Ended Discovery of Social Biases in Social Commonsense Reasoning Modelscited by 22
- 2023Gender Bias in BERT -- Measuring and Analysing Biases through Sentiment Rating in a Realistic Downstream Classification Taskcited by 21
- 2021Detecting Community Sensitive Norm Violations in Online Conversationscited by 18
- 2022Gendered Mental Health Stigma in Masked Language Modelscited by 17
- 2021Stepmothers are mean and academics are pretentious: What do pretrained language models learn about you?cited by 16
- 2022Causal Intervention Improves Implicit Sentiment Analysiscited by 16
- 2022Improving Generalizability in Implicitly Abusive Language Detection with Concept Activation Vectorscited by 14
22 more
- 2021Style Pooling: Automatic Text Style Obfuscation for Improved Classification Fairnesscited by 12
- 2023The Media Bias Taxonomy: A Systematic Literature Review on the Forms and Automated Detection of Media Biascited by 11
- 2024mCSQA: Multilingual Commonsense Reasoning Dataset with Unified Creation Strategy by Language Models and Humanscited by 10
- 2022Trustworthy Social Bias Measurementcited by 7
- 2021Social Norm Bias: Residual Harms of Fairness-Aware Algorithmscited by 6
- 2025What's Not Said Still Hurts: A Description-Based Evaluation Framework for Measuring Social Bias in LLMscited by 6
- 2021Quantifying Gender Biases Towards Politicians on Redditcited by 5
- 2023Transcending the "Male Code": Implicit Masculine Biases in NLP Contextscited by 5
- 2023How Prevalent is Gender Bias in ChatGPT? -- Exploring German and English ChatGPT Responsescited by 5
- 2022Undesirable Biases in NLP: Addressing Challenges of Measurementcited by 4
- 2023"I'm" Lost in Translation: Pronoun Missteps in Crowdsourced Data Setscited by 4
- 2023TaCo: Targeted Concept Erasure Prevents Non-Linear Classifiers From Detecting Protected Attributescited by 4
- 2022A Moral- and Event- Centric Inspection of Gender Bias in Fairy Tales at A Large Scalecited by 3
- 2023TalkUp: Paving the Way for Understanding Empowering Languagecited by 3
- 2021CO-STAR: Conceptualisation of Stereotypes for Analysis and Reasoningcited by 2
- 2024KTCR: Improving Implicit Hate Detection with Knowledge Transfer driven Concept Refinementcited by 2
- 2025Structured Reasoning for Fairness: A Multi-Agent Approach to Bias Detection in Textual Datacited by 2
- 2023Clinical Notes Reveal Physician Fatiguecited by 1
- 2024Who Speaks Matters: Analysing the Influence of the Speaker's Ethnicity on Hate Classificationcited by 1
- 2021#ContextMatters: Advantages and Limitations of Using Machine Learning to Support Women in Politicscited by 0
- 2022Religion and Spirituality on Social Media in the Aftermath of the Global Pandemiccited by 0
- 2024Advancing Fairness in Natural Language Processing: From Traditional Methods to Explainabilitycited by 0
- 2025Structured Reasoning for Fairness: A Multi-Agent Approach to Bias Detection in Textual Data1 Mar 2025
- 2025What's Not Said Still Hurts: A Description-Based Evaluation Framework for Measuring Social Bias in LLMs27 Feb 2025
- 2024Who Speaks Matters: Analysing the Influence of the Speaker's Ethnicity on Hate Classification27 Oct 2024
- 2024KTCR: Improving Implicit Hate Detection with Knowledge Transfer driven Concept Refinement20 Oct 2024
- 2024Advancing Fairness in Natural Language Processing: From Traditional Methods to Explainability16 Oct 2024
- 2024mCSQA: Multilingual Commonsense Reasoning Dataset with Unified Creation Strategy by Language Models and Humans6 Jun 2024
- 2023The Media Bias Taxonomy: A Systematic Literature Review on the Forms and Automated Detection of Media Bias26 Dec 2023
- 2023TaCo: Targeted Concept Erasure Prevents Non-Linear Classifiers From Detecting Protected Attributes11 Dec 2023
- 2023Clinical Notes Reveal Physician Fatigue5 Dec 2023
- 2023How Prevalent is Gender Bias in ChatGPT? -- Exploring German and English ChatGPT Responses21 Sep 2023
- 2023Gender Bias in BERT -- Measuring and Analysing Biases through Sentiment Rating in a Realistic Downstream Classification Task27 Jun 2023
- 2023Sociodemographic Bias in Language Models: A Survey and Forward Path13 Jun 2023
22 more
- 2023TalkUp: Paving the Way for Understanding Empowering Language23 May 2023
- 2023"I'm" Lost in Translation: Pronoun Missteps in Crowdsourced Data Sets22 Apr 2023
- 2023Transcending the "Male Code": Implicit Masculine Biases in NLP Contexts22 Apr 2023
- 2022Trustworthy Social Bias Measurement20 Dec 2022
- 2022Religion and Spirituality on Social Media in the Aftermath of the Global Pandemic11 Dec 2022
- 2022A Moral- and Event- Centric Inspection of Gender Bias in Fairy Tales at A Large Scale25 Nov 2022
- 2022Undesirable Biases in NLP: Addressing Challenges of Measurement24 Nov 2022
- 2022Gendered Mental Health Stigma in Masked Language Models27 Oct 2022
- 2022Language Generation Models Can Cause Harm: So What Can We Do About It? An Actionable Survey14 Oct 2022
- 2022SODAPOP: Open-Ended Discovery of Social Biases in Social Commonsense Reasoning Models13 Oct 2022
- 2022Causal Intervention Improves Implicit Sentiment Analysis19 Aug 2022
- 2022Gradient-Based Constrained Sampling from Language Models25 May 2022
- 2022Improving Generalizability in Implicitly Abusive Language Detection with Concept Activation Vectors5 Apr 2022
- 2021Quantifying Gender Biases Towards Politicians on Reddit22 Dec 2021
- 2021CO-STAR: Conceptualisation of Stereotypes for Analysis and Reasoning1 Dec 2021
- 2021Detecting Community Sensitive Norm Violations in Online Conversations9 Oct 2021
- 2021#ContextMatters: Advantages and Limitations of Using Machine Learning to Support Women in Politics30 Sep 2021
- 2021Stepmothers are mean and academics are pretentious: What do pretrained language models learn about you?21 Sep 2021
- 2021Uncovering Implicit Gender Bias in Narratives through Commonsense Inference14 Sep 2021
- 2021Style Pooling: Automatic Text Style Obfuscation for Improved Classification Fairness10 Sep 2021
- 2021Social Norm Bias: Residual Harms of Fairness-Aware Algorithms25 Aug 2021
- 2021Controlled Text Generation as Continuous Optimization with Multiple Constraints4 Aug 2021
- 2022SODAPOP: Open-Ended Discovery of Social Biases in Social Commonsense Reasoning Modelscited by 22
- 2024mCSQA: Multilingual Commonsense Reasoning Dataset with Unified Creation Strategy by Language Models and Humanscited by 10
- 2025Structured Reasoning for Fairness: A Multi-Agent Approach to Bias Detection in Textual Datacited by 2
- 2025Structured Reasoning for Fairness: A Multi-Agent Approach to Bias Detection in Textual Data1 Mar 2025
- 2024mCSQA: Multilingual Commonsense Reasoning Dataset with Unified Creation Strategy by Language Models and Humans6 Jun 2024
- 2022SODAPOP: Open-Ended Discovery of Social Biases in Social Commonsense Reasoning Models13 Oct 2022
- 2022Language Generation Models Can Cause Harm: So What Can We Do About It? An Actionable Surveycited by 80
- 2021Controlled Text Generation as Continuous Optimization with Multiple Constraintscited by 70
- 2022Gradient-Based Constrained Sampling from Language Modelscited by 64
- 2021Uncovering Implicit Gender Bias in Narratives through Commonsense Inferencecited by 32
- 2023Sociodemographic Bias in Language Models: A Survey and Forward Pathcited by 27
- 2023Gender Bias in BERT -- Measuring and Analysing Biases through Sentiment Rating in a Realistic Downstream Classification Taskcited by 21
- 2021Detecting Community Sensitive Norm Violations in Online Conversationscited by 18
- 2022Gendered Mental Health Stigma in Masked Language Modelscited by 17
- 2021Stepmothers are mean and academics are pretentious: What do pretrained language models learn about you?cited by 16
- 2022Causal Intervention Improves Implicit Sentiment Analysiscited by 16
- 2022Improving Generalizability in Implicitly Abusive Language Detection with Concept Activation Vectorscited by 14
- 2021Style Pooling: Automatic Text Style Obfuscation for Improved Classification Fairnesscited by 12
12 most cited of 31 All 31 (JSON)
- 2025What's Not Said Still Hurts: A Description-Based Evaluation Framework for Measuring Social Bias in LLMs27 Feb 2025
- 2024Who Speaks Matters: Analysing the Influence of the Speaker's Ethnicity on Hate Classification27 Oct 2024
- 2024KTCR: Improving Implicit Hate Detection with Knowledge Transfer driven Concept Refinement20 Oct 2024
- 2024Advancing Fairness in Natural Language Processing: From Traditional Methods to Explainability16 Oct 2024
- 2023The Media Bias Taxonomy: A Systematic Literature Review on the Forms and Automated Detection of Media Bias26 Dec 2023
- 2023TaCo: Targeted Concept Erasure Prevents Non-Linear Classifiers From Detecting Protected Attributes11 Dec 2023
- 2023Clinical Notes Reveal Physician Fatigue5 Dec 2023
- 2023How Prevalent is Gender Bias in ChatGPT? -- Exploring German and English ChatGPT Responses21 Sep 2023
- 2023Gender Bias in BERT -- Measuring and Analysing Biases through Sentiment Rating in a Realistic Downstream Classification Task27 Jun 2023
- 2023Sociodemographic Bias in Language Models: A Survey and Forward Path13 Jun 2023
- 2023TalkUp: Paving the Way for Understanding Empowering Language23 May 2023
- 2023"I'm" Lost in Translation: Pronoun Missteps in Crowdsourced Data Sets22 Apr 2023
12 newest of 31 All 31 (JSON)