Second Order WinoBias (SoWinoBias) Test Set for Latent Gender Bias Detection in Coreference Resolution
Not on the map. Why?
Abstract (arXiv)
We observe an instance of gender-induced bias in a downstream application, despite the absence of explicit gender words in the test cases. We provide a test set, SoWinoBias, for the purpose of measuring such latent gender bias in coreference resolution systems. We evaluate the performance of current debiasing methods on the SoWinoBias test set, especially in reference to the method's design and altered embedding space properties. See https://github.com/hillarydawkins/SoWinoBias.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 12 of its 17 references that are in the map. First posted on arXiv 28 Sep 2021.
Builds on
12 of 17 references.
References · 12
- 2018Deep contextualized word representationscited by 2,285
- 2016Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddingscited by 1,304
- 2016Semantics derived automatically from language corpora contain human-like biasescited by 894
- 2018Gender Bias in Coreference Resolution: Evaluation and Debiasing Methodscited by 657
- 2020Null It Out: Guarding Protected Attributes by Iterative Nullspace Projectioncited by 442
- 2019Lipstick on a Pig: Debiasing Methods Cover up Systematic Gender Biases in Word Embeddings But do not Remove Themcited by 268
- 2017End-to-end Neural Coreference Resolutioncited by 240
- 2018Learning Gender-Neutral Word Embeddingscited by 169
- 2018Higher-order Coreference Resolution with Coarse-to-fine Inferencecited by 150
- 2020Nurse is Closer to Woman than Surgeon? Mitigating Gender-Biased Proximities in Word Embeddingscited by 20
- 2019Unsupervised Discovery of Gendered Language through Latent-Variable Modelingcited by 19
- 2019Decision-Directed Data Decompositioncited by 2
Built on by
Citing papers per year: 2024: 1; 2025: 2.
3 papers.
- 2025Investigating Intersectional Bias in Large Language Models using Confidence Disparities in Coreference Resolutioncited by 3
- 2025Bias after Prompting: Persistent Discrimination in Large Language Modelscited by 3
- 2024Evaluating Gender Bias Transfer between Pre-trained and Prompt-Adapted Language Modelscited by 2
- 2025Bias after Prompting: Persistent Discrimination in Large Language Models9 Sep 2025
- 2025Investigating Intersectional Bias in Large Language Models using Confidence Disparities in Coreference Resolution9 Aug 2025
- 2024Evaluating Gender Bias Transfer between Pre-trained and Prompt-Adapted Language Models4 Dec 2024