Gender Bias in Coreference Resolution
Not on the map. Why?
Abstract (arXiv)
We present an empirical study of gender bias in coreference resolution systems. We first introduce a novel, Winograd schema-style set of minimal pair sentences that differ only by pronoun gender. With these "Winogender schemas," we evaluate and confirm systematic gender bias in three publicly-available coreference resolution systems, and correlate this bias with real-world and textual gender statistics.
Key facts. Cited by 438 papers in the map (data through 7 Oct 2026). First posted on arXiv 25 Apr 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 59; 2022: 74; 2023: 98; 2024: 90; 2025: 78; 2026: 39.
438 papers.
Sort:
By area:
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
- 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,337
- 2022Scaling Instruction-Finetuned Language Modelscited by 2,997
- 2022Training Compute-Optimal Large Language Modelscited by 2,927
- 2023A Survey of Large Language Modelscited by 2,537
- 2021GLaM: Efficient Scaling of Language Models with Mixture-of-Expertscited by 890
- 2022GLM-130B: An Open Bilingual Pre-trained Modelcited by 837
- 2022Discovering Language Model Behaviors with Model-Written Evaluationscited by 805
- 2021BBQ: A Hand-Built Bias Benchmark for Question Answeringcited by 683
- 2023A Comprehensive Overview of Large Language Modelscited by 639
38 more
- 2023Bias and Fairness in Large Language Models: A Surveycited by 626
- 2022Improving alignment of dialogue agents via targeted human judgementscited by 527
- 2022Winoground: Probing Vision and Language Models for Visio-Linguistic Compositionalitycited by 523
- 2021Dynabench: Rethinking Benchmarking in NLPcited by 447
- 2021BOLD: Dataset and Metrics for Measuring Biases in Open-Ended Language Generationcited by 410
- 2022Text and Code Embeddings by Contrastive Pre-Trainingcited by 358
- 2021Self-Diagnosis and Self-Debiasing: A Proposal for Reducing Corpus-Based Bias in NLPcited by 336
- 2023Principle-Driven Self-Alignment of Language Models from Scratch with Minimal Human Supervisioncited by 318
- 2023MEGA: Multilingual Evaluation of Generative AIcited by 291
- 2022Prompting GPT-3 To Be Reliablecited by 258
- 2023PaLI-X: On Scaling up a Multilingual Vision and Language Modelcited by 254
- 2023Large Language Model Alignment: A Surveycited by 241
- 2022OPT-IML: Scaling Language Model Instruction Meta Learning through the Lens of Generalizationcited by 235
- 2023Red-Teaming Large Language Models using Chain of Utterances for Safety-Alignmentcited by 213
- 2021What Will it Take to Fix Benchmarking in Natural Language Understanding?cited by 200
- 2022On Second Thought, Let's Not Think Step by Step! Bias and Toxicity in Zero-Shot Reasoningcited by 191
- 2023Bias Runs Deep: Implicit Reasoning Biases in Persona-Assigned LLMscited by 191
- 2023SafetyBench: Evaluating the Safety of Large Language Modelscited by 189
- 2023Gender bias and stereotypes in Large Language Modelscited by 185
- 2023The Capacity for Moral Self-Correction in Large Language Modelscited by 171
- 2022"I'm sorry to hear that": Finding New Biases in Language Models with a Holistic Descriptor Datasetcited by 160
- 2022Impact of Pretraining Term Frequencies on Few-Shot Reasoningcited by 142
- 2023Auditing large language models: a three-layered approachcited by 135
- 2021Harms of Gender Exclusivity and Challenges in Non-Binary Representation in Language Technologiescited by 128
- 2023A Systematic Study and Comprehensive Evaluation of ChatGPT on Benchmark Datasetscited by 123
- 2021Gender Bias in Machine Translationcited by 116
- 2021Robustness Gym: Unifying the NLP Evaluation Landscapecited by 107
- 2021Debiasing Pre-trained Contextualised Embeddingscited by 107
- 2021Measure and Improve Robustness in NLP Models: A Surveycited by 107
- 2024Language models scale reliably with over-training and on downstream taskscited by 105
- 2021UNICORN on RAINBOW: A Universal Commonsense Reasoning Model on a New Multitask Benchmarkcited by 98
- 2021Sustainable Modular Debiasing of Language Modelscited by 98
- 2021Competency Problems: On Finding and Removing Artifacts in Language Datacited by 91
- 2023A Survey on Fairness in Large Language Modelscited by 91
- 2021The MultiBERTs: BERT Reproductions for Robustness Analysiscited by 89
- 2021A Survey on Gender Bias in Natural Language Processingcited by 89
- 2024Aligning to Thousands of Preferences via System Message Generalizationcited by 84
- 2021Quantifying Social Biases in NLP: A Generalization and Empirical Comparison of Extrinsic Fairness Metricscited by 83
50 most cited of 438 All 438 (JSON)
- 2026Debias It Yourself: Teaching LLMs Cognitive Bias Mitigation Interventions30 Sep 2026
- 2026Evaluating Persistent Calibration under Evolving Model Knowledge30 Sep 2026
- 2026FineWeb-CLaR: Culture, Language, and Region Annotations for Benchmark-Aligned Corpus Auditing21 Sep 2026
- 2026Voice or Stereotype? Disentangling Acoustic and Content-Based Gender in Speech-to-Speech Models8 Sep 2026
- 2026Beyond Retraining-Free MoE Compression: A Cost-Normalized Study of Post-Compression Adjustment5 Sep 2026
- 2026Effects of Answer Format Variation on Gender Bias in Large Language Models18 Aug 2026
- 2026Position: Fairness Failure in Generative Models is an Evaluation Problem17 Aug 2026
- 2026Unifying Depth and Width Pruning for LLMs via Binary Knapsack Optimization13 Aug 2026
- 2026Mitigating Gender Bias in English to Romanian Machine Translation9 Aug 2026
- 2026When and Why Do Linear Bias Probes Fail? A Geometric and Statistical Theory of Bias Detectability in Large Language Model Representations21 Jul 2026
- 2026Filtering Harmful Actions Isn't Enough: Phantom Transfer in Agentic SDF12 Jul 2026
- 2026It Takes a MAESTRO To Prune Bad Experts9 Jul 2026
38 more
- 2026RPAM: A Principled Metric for Evaluating Associations in Language Models with High Predictive Validity in Downstream Outputs6 Jul 2026
- 2026The Contagion Tensor: A Framework for Measuring Output-Distribution Coupling in Multi-Agent LLM Systems -- and Auditing the Claims It Enables27 Jun 2026
- 2026Contaminated Collaboration: Measuring Gender Bias Transfer in LLM-Assisted Student Writing14 Jun 2026
- 2026Multi-component Causal Tracing in Large Language Models2 Jun 2026
- 2026Anchoring LLM Gender Bias to Human Baselines: A Cross-Lingual Audit29 May 2026
- 2026GRUFF: LLM Pronoun Fidelity, Reasoning, and Biases in German28 May 2026
- 2026Is She Even Relevant? When BERT Ignores Explicit Gender Cues8 May 2026
- 2026Misaligned by Reward: Socially Undesirable Preferences in LLMs6 May 2026
- 2026Compared to What? Baselines and Metrics for Counterfactual Prompting1 May 2026
- 2026Parcae: Scaling Laws For Stable Looped Language Models14 Apr 2026
- 2026Identifying and Mitigating Gender Cues in Academic Recommendation Letters: An Interpretability Case Study14 Apr 2026
- 2026Redirected, Not Removed: Task-Dependent Stereotyping Reveals the Limits of LLM Alignments3 Apr 2026
- 2026ImplicitBBQ: Benchmarking Implicit Bias in Large Language Models through Characteristic Based Cues2 Apr 2026
- 2026ProText: A benchmark dataset for measuring (mis)gendering in long-form texts29 Mar 2026
- 2026Failure of contextual invariance in large language models24 Mar 2026
- 2026Greater accessibility can amplify discrimination in generative AI23 Mar 2026
- 2026ConGA: Guidelines for Contextual Gender Annotation. A Framework for Annotating Gender in Machine Translation18 Mar 2026
- 2026Gender Disambiguation in Machine Translation: Diagnostic Evaluation in Decoder-Only Architectures18 Mar 2026
- 2026A Representation-Level Assessment of Bias Mitigation in Foundation Models17 Mar 2026
- 2026A Family of LLMs Liberated from Static Vocabularies16 Mar 2026
- 2026Quantifying Gender Bias in Large Language Models: When ChatGPT Becomes a Hiring Manager10 Mar 2026
- 2026Gender Bias in MT for a Genderless Language: New Benchmarks for Basque9 Mar 2026
- 2026DeFrame: Debiasing Large Language Models Against Framing Effects4 Feb 2026
- 2026Equal Access, Unequal Interaction: A Counterfactual Audit of LLM Fairness3 Feb 2026
- 2026BinaryPPO: Efficient Policy Optimization for Binary Classification2 Feb 2026
- 2026Objective Matters: Fine-Tuning Objectives Shape Safety, Robustness, and Persona Drift19 Jan 2026
- 2026When to Invoke: Refining LLM Fairness with Toxicity Assessment14 Jan 2026
- 2025Measuring Mechanistic Independence: Can Bias Be Removed Without Erasing Demographics?23 Dec 2025
- 2025An Empirical Survey of Model Merging Algorithms for Social Bias Mitigation2 Dec 2025
- 2025Sycophancy Claims about Language Models: The Missing Human-in-the-Loop29 Nov 2025
- 2025AfriStereo: A Culturally Grounded Dataset for Evaluating Stereotypical Bias in Large Language Models27 Nov 2025
- 2025Estonian WinoGrande Dataset: Comparative Analysis of LLM Performance on Human and Machine Translation21 Nov 2025
- 2025Exploring and Mitigating Gender Bias in Encoder-Based Transformer Models1 Nov 2025
- 2025Charting the European LLM Benchmarking Landscape: A New Taxonomy and a Set of Best Practices28 Oct 2025
- 2025GIFT: Group-Relative Implicit Fine-Tuning Integrates GRPO with DPO and UNA27 Oct 2025
- 2025Compositional Bias Control in Large Language Models: Preference Learning Fails, Supervision Succeeds24 Oct 2025
- 2025PBBQ: A Persian Bias Benchmark Dataset Curated with Human-AI Collaboration for Large Language Models22 Oct 2025
- 2025Efficient Seq2seq Coreference Resolution Using Entity Representations16 Oct 2025
50 newest of 438 All 438 (JSON)
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2022Winoground: Probing Vision and Language Models for Visio-Linguistic Compositionalitycited by 523
- 2022On Second Thought, Let's Not Think Step by Step! Bias and Toxicity in Zero-Shot Reasoningcited by 191
- 2023Bias Runs Deep: Implicit Reasoning Biases in Persona-Assigned LLMscited by 191
- 2022Impact of Pretraining Term Frequencies on Few-Shot Reasoningcited by 142
- 2023CompA: Addressing the Gap in Compositional Reasoning in Audio-Language Modelscited by 43
- 2022SODAPOP: Open-Ended Discovery of Social Biases in Social Commonsense Reasoning Modelscited by 22
- 2022WinoGAViL: Gamified Association Benchmark to Challenge Vision-and-Language Modelscited by 20
- 2024Robust Pronoun Fidelity with English LLMs: Are they Reasoning, Repeating, or Just Biased?cited by 17
- 2023CRoW: Benchmarking Commonsense Reasoning in Real-World Taskscited by 8
- 2025Rethinking LLM Bias Probing Using Lessons from the Social Sciencescited by 6
- 2025MEDEQUALQA: Evaluating Biases in LLMs with Counterfactual Reasoningcited by 3
12 most cited of 18 All 18 (JSON)
- 2026GRUFF: LLM Pronoun Fidelity, Reasoning, and Biases in German28 May 2026
- 2025Estonian WinoGrande Dataset: Comparative Analysis of LLM Performance on Human and Machine Translation21 Nov 2025
- 2025GIFT: Group-Relative Implicit Fine-Tuning Integrates GRPO with DPO and UNA27 Oct 2025
- 2025MEDEQUALQA: Evaluating Biases in LLMs with Counterfactual Reasoning9 Oct 2025
- 2025Is Large Language Model Performance on Reasoning Tasks Impacted by Different Ways Questions Are Asked?21 Jul 2025
- 2025BiasCause: Evaluate Socially Biased Causal Reasoning of Large Language Models8 Apr 2025
- 2025WinoWhat: A Parallel Corpus of Paraphrased WinoGrande Sentences with Common Sense Categorization31 Mar 2025
- 2025Rethinking LLM Bias Probing Using Lessons from the Social Sciences28 Feb 2025
- 2024Robust Pronoun Fidelity with English LLMs: Are they Reasoning, Repeating, or Just Biased?4 Apr 2024
- 2023Bias Runs Deep: Implicit Reasoning Biases in Persona-Assigned LLMs8 Nov 2023
- 2023CRoW: Benchmarking Commonsense Reasoning in Real-World Tasks23 Oct 2023
- 2023CompA: Addressing the Gap in Compositional Reasoning in Audio-Language Models12 Oct 2023
12 newest of 18 All 18 (JSON)
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2022Discovering Language Model Behaviors with Model-Written Evaluationscited by 805
- 2023Principle-Driven Self-Alignment of Language Models from Scratch with Minimal Human Supervisioncited by 318
- 2023Large Language Model Alignment: A Surveycited by 241
- 2023The Capacity for Moral Self-Correction in Large Language Modelscited by 171
- 2024Aligning to Thousands of Preferences via System Message Generalizationcited by 84
- 2023From Instructions to Intrinsic Human Values -- A Survey of Alignment Goals for Big Modelscited by 45
- 2023Beyond Imitation: Leveraging Fine-grained Quality Signals for Alignmentcited by 35
- 2024GenderAlign: An Alignment Dataset for Mitigating Gender Bias in Large Language Modelscited by 18
- 2025CARE: Multilingual Human Preference Learning for Cultural Awarenesscited by 15
- 2023Generalization Analogies: A Testbed for Generalizing AI Oversight to Hard-To-Measure Domainscited by 8
- 2024The Root Shapes the Fruit: On the Persistence of Gender-Exclusive Harms in Aligned Language Modelscited by 5
12 most cited of 16 All 16 (JSON)
- 2026Misaligned by Reward: Socially Undesirable Preferences in LLMs6 May 2026
- 2026Redirected, Not Removed: Task-Dependent Stereotyping Reveals the Limits of LLM Alignments3 Apr 2026
- 2026Objective Matters: Fine-Tuning Objectives Shape Safety, Robustness, and Persona Drift19 Jan 2026
- 2025Compositional Bias Control in Large Language Models: Preference Learning Fails, Supervision Succeeds24 Oct 2025
- 2025CARE: Multilingual Human Preference Learning for Cultural Awareness7 Apr 2025
- 2024The Root Shapes the Fruit: On the Persistence of Gender-Exclusive Harms in Aligned Language Models6 Nov 2024
- 2024GenderAlign: An Alignment Dataset for Mitigating Gender Bias in Large Language Models20 Jun 2024
- 2024Aligning to Thousands of Preferences via System Message Generalization28 May 2024
- 2023Generalization Analogies: A Testbed for Generalizing AI Oversight to Hard-To-Measure Domains13 Nov 2023
- 2023Beyond Imitation: Leveraging Fine-grained Quality Signals for Alignment7 Nov 2023
- 2023Large Language Model Alignment: A Survey26 Sep 2023
- 2023From Instructions to Intrinsic Human Values -- A Survey of Alignment Goals for Big Models23 Aug 2023
12 newest of 16 All 16 (JSON)
- 2023Red-Teaming Large Language Models using Chain of Utterances for Safety-Alignmentcited by 213
- 2024SafetyPrompts: a Systematic Review of Open Datasets for Evaluating and Improving Large Language Model Safetycited by 75
- 2024CoSafe: Evaluating Large Language Model Safety in Multi-Turn Dialogue Coreferencecited by 51
- 2024Current state of LLM Risks and AI Guardrailscited by 44
- 2024Digital Forgetting in Large Language Models: A Survey of Unlearning Methodscited by 38
- 2025Implicit Bias in LLMs: A Surveycited by 8
- 2024Smaller Large Language Models Can Do Moral Self-Correctioncited by 5
- 2024Debiasing Text Safety Classifiers through a Fairness-Aware Ensemblecited by 2
- 2025Implicit Bias in LLMs: A Survey4 Mar 2025
- 2024Smaller Large Language Models Can Do Moral Self-Correction30 Oct 2024
- 2024Debiasing Text Safety Classifiers through a Fairness-Aware Ensemble5 Sep 2024
- 2024CoSafe: Evaluating Large Language Model Safety in Multi-Turn Dialogue Coreference25 Jun 2024
- 2024Current state of LLM Risks and AI Guardrails16 Jun 2024
- 2024SafetyPrompts: a Systematic Review of Open Datasets for Evaluating and Improving Large Language Model Safety8 Apr 2024
- 2024Digital Forgetting in Large Language Models: A Survey of Unlearning Methods2 Apr 2024
- 2023Red-Teaming Large Language Models using Chain of Utterances for Safety-Alignment18 Aug 2023
- 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,337
- 2023SocialCounterfactuals: Probing and Mitigating Intersectional Social Biases in Vision-Language Models with Counterfactual Examplescited by 53
- 2023VisoGender: A dataset for benchmarking gender bias in image-text pronoun resolutioncited by 52
- 2024Uncovering Bias in Large Vision-Language Models at Scale with Counterfactualscited by 27
- 2023Survey of Social Bias in Vision-Language Modelscited by 26
- 2024Fairness and Bias in Multimodal AI: A Surveycited by 19
- 2024Uncovering Bias in Large Vision-Language Models with Counterfactualscited by 9
- 2024Fairness and Bias in Multimodal AI: A Survey27 Jun 2024
- 2024Uncovering Bias in Large Vision-Language Models at Scale with Counterfactuals30 May 2024
- 2024Uncovering Bias in Large Vision-Language Models with Counterfactuals29 Mar 2024
- 2023SocialCounterfactuals: Probing and Mitigating Intersectional Social Biases in Vision-Language Models with Counterfactual Examples30 Nov 2023
- 2023Survey of Social Bias in Vision-Language Models24 Sep 2023
- 2023VisoGender: A dataset for benchmarking gender bias in image-text pronoun resolution21 Jun 2023
- 2022Flamingo: a Visual Language Model for Few-Shot Learning29 Apr 2022
- 2022Improving alignment of dialogue agents via targeted human judgementscited by 527
- 2024Towards Implicit Bias Detection and Mitigation in Multi-Agent LLM Interactionscited by 50
- 2025Multi-level Value Alignment in Agentic AI Systems: Survey and Perspectivescited by 4
- 2026Filtering Harmful Actions Isn't Enough: Phantom Transfer in Agentic SDFcited by 2
- 2026The Contagion Tensor: A Framework for Measuring Output-Distribution Coupling in Multi-Agent LLM Systems -- and Auditing the Claims It Enablescited by 0
- 2026Filtering Harmful Actions Isn't Enough: Phantom Transfer in Agentic SDF12 Jul 2026
- 2026The Contagion Tensor: A Framework for Measuring Output-Distribution Coupling in Multi-Agent LLM Systems -- and Auditing the Claims It Enables27 Jun 2026
- 2025Multi-level Value Alignment in Agentic AI Systems: Survey and Perspectives11 Jun 2025
- 2024Towards Implicit Bias Detection and Mitigation in Multi-Agent LLM Interactions3 Oct 2024
- 2022Improving alignment of dialogue agents via targeted human judgements28 Sep 2022
- 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
- 2022Scaling Instruction-Finetuned Language Modelscited by 2,997
- 2022Training Compute-Optimal Large Language Modelscited by 2,927
- 2023A Survey of Large Language Modelscited by 2,537
- 2022GLM-130B: An Open Bilingual Pre-trained Modelcited by 837
- 2021BBQ: A Hand-Built Bias Benchmark for Question Answeringcited by 683
- 2023A Comprehensive Overview of Large Language Modelscited by 639
- 2023Bias and Fairness in Large Language Models: A Surveycited by 626
- 2021Dynabench: Rethinking Benchmarking in NLPcited by 447
- 2021BOLD: Dataset and Metrics for Measuring Biases in Open-Ended Language Generationcited by 410
- 2022Text and Code Embeddings by Contrastive Pre-Trainingcited by 358
- 2021Self-Diagnosis and Self-Debiasing: A Proposal for Reducing Corpus-Based Bias in NLPcited by 336
12 most cited of 380 All 380 (JSON)
- 2026Debias It Yourself: Teaching LLMs Cognitive Bias Mitigation Interventions30 Sep 2026
- 2026Evaluating Persistent Calibration under Evolving Model Knowledge30 Sep 2026
- 2026FineWeb-CLaR: Culture, Language, and Region Annotations for Benchmark-Aligned Corpus Auditing21 Sep 2026
- 2026Voice or Stereotype? Disentangling Acoustic and Content-Based Gender in Speech-to-Speech Models8 Sep 2026
- 2026Effects of Answer Format Variation on Gender Bias in Large Language Models18 Aug 2026
- 2026Position: Fairness Failure in Generative Models is an Evaluation Problem17 Aug 2026
- 2026Unifying Depth and Width Pruning for LLMs via Binary Knapsack Optimization13 Aug 2026
- 2026Mitigating Gender Bias in English to Romanian Machine Translation9 Aug 2026
- 2026When and Why Do Linear Bias Probes Fail? A Geometric and Statistical Theory of Bias Detectability in Large Language Model Representations21 Jul 2026
- 2026RPAM: A Principled Metric for Evaluating Associations in Language Models with High Predictive Validity in Downstream Outputs6 Jul 2026
- 2026Contaminated Collaboration: Measuring Gender Bias Transfer in LLM-Assisted Student Writing14 Jun 2026
- 2026Multi-component Causal Tracing in Large Language Models2 Jun 2026
12 newest of 380 All 380 (JSON)