mlsanityData to 7 Oct 2026

Towards Understanding Gender Bias in Relation Extraction

arXiv 1911.03642 ↗First posted 9 Nov 2019cs.LG cs.CL stat.MLcited by 23

Not on the map. Why?

Abstract (arXiv)

Recent developments in Neural Relation Extraction (NRE) have made significant strides towards Automated Knowledge Base Construction (AKBC). While much attention has been dedicated towards improvements in accuracy, there have been no attempts in the literature to our knowledge to evaluate social biases in NRE systems. We create WikiGenderBias, a distantly supervised dataset with a human annotated test set. WikiGenderBias has sentences specifically curated to analyze gender bias in relation extraction systems. We use WikiGenderBias to evaluate systems for bias and find that NRE systems exhibit gender biased predictions and lay groundwork for future evaluation of bias in NRE. We also analyze how name anonymization, hard debiasing for word embeddings, and counterfactual data augmentation affect gender bias in predictions and performance.

Key facts. Cited by 23 papers in the map (data through 7 Oct 2026). First posted on arXiv 9 Nov 2019.

Builds on

No reference list yet.

Built on by

Cited by year

Citing papers per year: 2021: 4; 2022: 5; 2023: 7; 2024: 5; 2025: 2.

23 papers.

Sort:

By area:

  1. 2023Large Language Model Alignment: A Surveycited by 241
  2. 2021Quantifying Social Biases in NLP: A Generalization and Empirical Comparison of Extrinsic Fairness Metricscited by 83
  3. 2021On Measures of Biases and Harms in NLPcited by 81
  4. 2022Theories of "Gender" in NLP Bias Researchcited by 62
  5. 2022On Learning Fairness and Accuracy on Multiple Subgroupscited by 31
  6. 2021Evaluating Gender Bias in Natural Language Inferencecited by 27
  7. 2023Sociodemographic Bias in Language Models: A Survey and Forward Pathcited by 27
  8. 2024Twists, Humps, and Pebbles: Multilingual Speech Recognition Models Exhibit Gender Performance Gapscited by 24
  9. 2023ASSERT: Automated Safety Scenario Red Teaming for Evaluating the Robustness of Large Language Modelscited by 12
  10. 2024Watching the Watchers: Exposing Gender Disparities in Machine Translation Quality Estimationcited by 10
  11. 2023ChatGPT is on the Horizon: Could a Large Language Model be Suitable for Intelligent Traffic Safety Research and Applications?cited by 9
  12. 2023Mitigating Bias for Question Answering Models by Tracking Bias Influencecited by 8
11 more
  1. 2024Mitigating Social Bias in Large Language Models: A Multi-Objective Approach within a Multi-Agent Frameworkcited by 8
  2. 2022Trustworthy Social Bias Measurementcited by 7
  3. 2023Fairness Evaluation in Text Classification: Machine Learning Practitioner Perspectives of Individual and Group Fairnesscited by 7
  4. 2021Learning Stable Classifiers by Transferring Unstable Featurescited by 6
  5. 2022The Lifecycle of "Facts": A Survey of Social Bias in Knowledge Graphscited by 4
  6. 2022A Comprehensive Study of Gender Bias in Chemical Named Entity Recognition Modelscited by 4
  7. 2025Multi-level Value Alignment in Agentic AI Systems: Survey and Perspectivescited by 4
  8. 2024Formulation Comparison for Timeline Construction using LLMscited by 2
  9. 2024Human Bias in the Face of AI: Examining Human Judgment Against Text Labeled as AI Generatedcited by 2
  10. 2025From Charts to Fair Narratives: Uncovering and Mitigating Geo-Economic Biases in Chart-to-Textcited by 2
  11. 2023Challenges in Annotating Datasets to Quantify Bias in Under-represented Societycited by 1