Counterfactual Fairness
Not on the map. Why?
Abstract (arXiv)
Machine learning can impact people with legal or ethical consequences when it is used to automate decisions in areas such as insurance, lending, hiring, and predictive policing. In many of these scenarios, previous decisions have been made that are unfairly biased against certain subpopulations, for example those of a particular race, gender, or sexual orientation. Since this past data may be biased, machine learning predictors must account for this to avoid perpetuating or creating discriminatory practices. In this paper, we develop a framework for modeling fairness using tools from causal inference. Our definition of counterfactual fairness captures the intuition that a decision is fair towards an individual if it is the same in (a) the actual world and (b) a counterfactual world where the individual belonged to a different demographic group. We demonstrate our framework on a real-world problem of fair prediction of success in law school.
Key facts. Cited by 804 papers in the map (data through 14 Oct 2026). First posted on arXiv 20 Mar 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 125; 2022: 161; 2023: 157; 2024: 119; 2025: 129; 2026: 113.
804 papers.
Sort:
By area:
- 2021Towards Out-Of-Distribution Generalization: A Surveycited by 436
- 2022A Holistic Approach to Undesired Content Detection in the Real Worldcited by 356
- 2023LEACE: Perfect linear concept erasure in closed formcited by 267
- 2023Reasoning or Reciting? Exploring the Capabilities and Limitations of Language Models Through Counterfactual Taskscited by 246
- 2024ShieldGemma: Generative AI Content Moderation Based on Gemmacited by 243
- 2021Towards Causal Representation Learningcited by 209
- 2021Causal Inference in Natural Language Processing: Estimation, Prediction, Interpretation and Beyondcited by 178
- 2023The Capacity for Moral Self-Correction in Large Language Modelscited by 173
- 2021A survey on datasets for fairness-aware machine learningcited by 157
- 2023Auditing large language models: a three-layered approachcited by 137
- 2021Towards a Unified Framework for Fair and Stable Graph Representation Learningcited by 128
- 2022Bias Mitigation for Machine Learning Classifiers: A Comprehensive Surveycited by 125
38 more
- 2021Data Collection and Quality Challenges in Deep Learning: A Data-Centric AI Perspectivecited by 116
- 2021Counterfactual Attention Learning for Fine-Grained Visual Categorization and Re-identificationcited by 114
- 2021DECAF: Generating Fair Synthetic Data Using Causally-Aware Generative Networkscited by 109
- 2021A Clarification of the Nuances in the Fairness Metrics Landscapecited by 98
- 2021Trustworthy AI: A Computational Perspectivecited by 93
- 2021EDITS: Modeling and Mitigating Data Bias for Graph Neural Networkscited by 92
- 2021Towards Principled Disentanglement for Domain Generalizationcited by 91
- 2021Are Gender-Neutral Queries Really Gender-Neutral? Mitigating Gender Bias in Image Searchcited by 90
- 2022Trustworthy Graph Neural Networks: Aspects, Methods and Trendscited by 89
- 2022Diffusion Causal Models for Counterfactual Estimationcited by 87
- 2021Quantifying Social Biases in NLP: A Generalization and Empirical Comparison of Extrinsic Fairness Metricscited by 83
- 2022Distilling Model Failures as Directions in Latent Spacecited by 82
- 2024Robust agents learn causal world modelscited by 81
- 2021Counterfactual Invariance to Spurious Correlations: Why and How to Pass Stress Testscited by 77
- 2022Fairness in Graph Mining: A Surveycited by 76
- 2023Synthcity: facilitating innovative use cases of synthetic data in different data modalitiescited by 76
- 2021Fair Conformal Predictors for Applications in Medical Imagingcited by 74
- 2021Mitigating Political Bias in Language Models Through Reinforced Calibrationcited by 73
- 2023Fast Model Debias with Machine Unlearningcited by 72
- 2022Fair Contrastive Learning for Facial Attribute Classificationcited by 71
- 2021Learning from Counterfactual Links for Link Predictioncited by 69
- 2021FairDrop: Biased Edge Dropout for Enhancing Fairness in Graph Representation Learningcited by 68
- 2021AutoDebias: Learning to Debias for Recommendationcited by 68
- 2022MEDFAIR: Benchmarking Fairness for Medical Imagingcited by 68
- 2022A Systematic Study of Bias Amplificationcited by 65
- 2021Fairness via Representation Neutralizationcited by 63
- 2021Fair Feature Distillation for Visual Recognitioncited by 59
- 2022Learning Fair Node Representations with Graph Counterfactual Fairnesscited by 58
- 2021Socially Responsible AI Algorithms: Issues, Purposes, and Challengescited by 56
- 2021DORO: Distributional and Outlier Robust Optimizationcited by 56
- 2021Explaining Black-Box Algorithms Using Probabilistic Contrastive Counterfactualscited by 55
- 2021Directional Bias Amplificationcited by 54
- 2022Improving the Fairness of Chest X-ray Classifierscited by 52
- 2023TIBET: Identifying and Evaluating Biases in Text-to-Image Generative Modelscited by 52
- 2021Agent Incentives: A Causal Perspectivecited by 51
- 2022Counterfactual Cycle-Consistent Learning for Instruction Following and Generation in Vision-Language Navigationcited by 51
- 2023Causal normalizing flows: from theory to practicecited by 51
- 2025Do-PFN: In-Context Learning for Causal Effect Estimationcited by 51
50 most cited of 804 All 804 (JSON)
- 2026Thin Evidence, Thick Priors: How Language Models Substitute Identity for Missing Financial Facts6 Oct 2026
- 2026Causally Fair Generation with Large Language Models3 Oct 2026
- 2026Causal Memory Policy: Making Memory Utility Identifiable by Intervening on Retrieval1 Oct 2026
- 2026Counterfactual Auditing of Bias in Open-Source Large Language Models for Clinical Triage1 Oct 2026
- 2026Minimax Optimal Regret for Causal Logistic Bandits with Counterfactual Fairness1 Oct 2026
- 2026Trustworthy Data- and ML-Ops for Intelligent Transportation Systems and Logistics1 Oct 2026
- 2026Security Properties of Neural Networks as Decision Problems30 Sep 2026
- 2026Where Privacy Belongs: Placement Diagnosis and Certified Selection for Private Counterfactual Explanations on Graphs29 Sep 2026
- 2026Certifying Interventional Agreement Among Observationally Equivalent Causal Models26 Sep 2026
- 2026Is invariance all you need for algorithmic fairness? Removing demographic information can create new bias25 Sep 2026
- 2026NNV3: Expanding Neural Network Verification to New Architectures and Domains24 Sep 2026
- 2026Path-specific harm decomposition: A partial identification framework24 Sep 2026
38 more
- 2026The Gold in Bias: Maturing the AI Design Process through Verification24 Sep 2026
- 2026Compiling Sufficient Governance Context from Declared Losses and Reachable States: Exact Observation-Contract Synthesis with Cardinality and Cost Objectives22 Sep 2026
- 2026Generating Chest X-Ray Counterfactuals by Specialising Foundation Image Models21 Sep 2026
- 2026Null importance: Disentangling relevance for interpretable machine learning16 Sep 2026
- 2026The Role of Uncertainty in Assessing the Fairness of Machine Learning Models7 Sep 2026
- 2026The Oversight Gap: What LLM Safety Monitors Miss, and Why It Is Not Capability7 Sep 2026
- 2026Instability Floors: Separating Bias from Noise in Fairness Audits of Clinical LLM Agents with FairMedAgent2 Sep 2026
- 2026Portable Causal Fairness Across Synthetic Data Generator Families2 Sep 2026
- 2026Unifying Conformal Language Tasks with In-Context Ensembles2 Sep 2026
- 2026Beyond Outcome Gaps: Process-Aware Fairness Diagnosis for LLM-based Multi-Agent Decision Systems2 Sep 2026
- 2026Causal Evidentiary Governance for High-Risk Machine Learning Systems1 Sep 2026
- 2026Taking the Whys Seriously: Limitations of Counterfactual Explanations in Justification and Recourse31 Aug 2026
- 2026Guardrail-Agnostic Societal Bias Evaluation in Large Vision-Language Models30 Aug 2026
- 2026Counterfactual Bias Testing for Application Tracking System27 Aug 2026
- 2026Fairness Invariants: A Relational Approach to Explaining and Mitigating Fairness Bugs26 Aug 2026
- 2026Proxy reliance in large language model decisions is uncalibrated to predictive evidence24 Aug 2026
- 2026Position: Fairness Failure in Generative Models is an Evaluation Problem17 Aug 2026
- 2026Training Fair Tabular Foundation Models14 Aug 2026
- 2026Mitigating Bias in Large Vision-Language Models via Counterfactual Ensemble Decoding12 Aug 2026
- 2026Conditional Independence Tests for Constraint-Based Causal Discovery: A Survey11 Aug 2026
- 2026A Joint-Distribution Route to Fair Representations with Continuous Sensitive Attributes11 Aug 2026
- 2026A Distribution Mapping Approach to Counterfactually Fair Reinforcement Learning9 Aug 2026
- 2026Signal or Spurious Cue? A Randomized Audit of Survey-Country Metadata in LLM Social Inference6 Aug 2026
- 2026Implementing Causal Perception: Competing SCMs and Situated Fairness4 Aug 2026
- 2026GoT-CD: Graph-of-Thoughts Causal Discovery and the Fragility of Post-hoc Path-Specific Fairness Audits3 Aug 2026
- 2026Who Should Be Generated? Justifying Demographic Targets in Open-Ended Generation3 Aug 2026
- 2026FairDiffuseVQVAE: Sampling-Time Fairness in Tabular Diffusion via Conditional Refinement of Vector-Quantized Latents31 Jul 2026
- 2026KAISEN: Reproducible Subgroup Fairness Auditing for Clinical Risk Models30 Jul 2026
- 2026Parameterized Fair Resource Allocation under Diversity Constraints29 Jul 2026
- 2026Unlearning Under Imbalance: Benchmarking Fairness in Multimodal LLM Unlearning23 Jul 2026
- 2026Equality, Equity, and Causality in Fairness Research: A Commentary on Cheng (2026)20 Jul 2026
- 2026Resist and Update: Counterfactual Report Coordinates for Incentive-Compatible LLMs14 Jul 2026
- 2026RED-Sphere: Hyperspherical Residual Edge Debiasing for Cross-Population Fundus Disease Domain Generalization12 Jul 2026
- 2026The complexities of patient-centred conversational artificial intelligence9 Jul 2026
- 2026Do Counterfactually Fair Image Classifiers Satisfy Group Fairness? -- A Theoretical and Empirical Study7 Jul 2026
- 2026Choosing a parallel heterogeneous ensemble method for tabular classification6 Jul 2026
- 2026AIFS-SUBS: Extending Data-Driven Forecasting to Sub-Seasonal Timescales6 Jul 2026
- 2026Reproducing FACTER: Fairness via Conformal Thresholding and Prompt Repair26 Jun 2026
50 newest of 804 All 804 (JSON)
- 2023Fast Model Debias with Machine Unlearningcited by 72
- 2022Causality-based Neural Network Repaircited by 47
- 2022Debiasing Learning for Membership Inference Attacks Against Recommender Systemscited by 12
- 2024Certifying Counterfactual Bias in LLMscited by 10
- 2025Watching the AI Watchdogs: A Fairness and Robustness Analysis of AI Safety Moderation Classifierscited by 5
- 2024Debiasing Text Safety Classifiers through a Fairness-Aware Ensemblecited by 3
- 2025Group-robust Machine Unlearningcited by 3
- 2025Let's Unlearn Stereotypes Before Decision-Making: Assessing the Impact of Intrinsic Bias Mitigation on Downstream Fairness in LLMscited by 1
- 2025CAF'E: Causal Black-Box Testing of Machine Unlearningcited by 0
- 2026Security Properties of Neural Networks as Decision Problemscited by 0
- 2026Security Properties of Neural Networks as Decision Problems30 Sep 2026
- 2025CAF'E: Causal Black-Box Testing of Machine Unlearning20 Sep 2025
- 2025Let's Unlearn Stereotypes Before Decision-Making: Assessing the Impact of Intrinsic Bias Mitigation on Downstream Fairness in LLMs19 Sep 2025
- 2025Group-robust Machine Unlearning12 Mar 2025
- 2025Watching the AI Watchdogs: A Fairness and Robustness Analysis of AI Safety Moderation Classifiers23 Jan 2025
- 2024Debiasing Text Safety Classifiers through a Fairness-Aware Ensemble5 Sep 2024
- 2024Certifying Counterfactual Bias in LLMs29 May 2024
- 2023Fast Model Debias with Machine Unlearning19 Oct 2023
- 2022Debiasing Learning for Membership Inference Attacks Against Recommender Systems24 Jun 2022
- 2022Causality-based Neural Network Repair20 Apr 2022
- 2023The Capacity for Moral Self-Correction in Large Language Modelscited by 173
- 2024Aligning (Medical) LLMs for (Counterfactual) Fairnesscited by 7
- 2025Towards Large Language Models that Benefit for All: Benchmarking Group Fairness in Reward Modelscited by 2
- 2025AMBEDKAR-A Multi-level Bias Elimination through a Decoding Approach with Knowledge Augmentation for Robust Constitutional Alignment of Language Modelscited by 2
- 2026Resist and Update: Counterfactual Report Coordinates for Incentive-Compatible LLMscited by 1
- 2026Multi-User Dueling Bandits: A Fair Approach using Nash Social Welfarecited by 0
- 2026Pareto-Guided Teacher Alignment for Fair Personalized Text Generationcited by 0
- 2026Resist and Update: Counterfactual Report Coordinates for Incentive-Compatible LLMs14 Jul 2026
- 2026Pareto-Guided Teacher Alignment for Fair Personalized Text Generation8 Jun 2026
- 2026Multi-User Dueling Bandits: A Fair Approach using Nash Social Welfare3 May 2026
- 2025AMBEDKAR-A Multi-level Bias Elimination through a Decoding Approach with Knowledge Augmentation for Robust Constitutional Alignment of Language Models2 Sep 2025
- 2025Towards Large Language Models that Benefit for All: Benchmarking Group Fairness in Reward Models10 Mar 2025
- 2024Aligning (Medical) LLMs for (Counterfactual) Fairness22 Aug 2024
- 2023The Capacity for Moral Self-Correction in Large Language Models15 Feb 2023
- 2025Counterfactually Fair Reinforcement Learning via Sequential Data Preprocessingcited by 5
- 2024What Hides behind Unfairness? Exploring Dynamics Fairness in Reinforcement Learningcited by 3
- 2025Fairness Aware Reinforcement Learning via Proximal Policy Optimizationcited by 2
- 2025The Cake that is Intelligence and Who Gets to Bake it: An AI Analogy and its Implications for Participationcited by 1
- 2025Unifying Causal Reinforcement Learning: Survey, Taxonomy, Algorithms and Applicationscited by 1
- 2026Counterfactually Safe Reinforcement Learningcited by 0
- 2026A Distribution Mapping Approach to Counterfactually Fair Reinforcement Learningcited by 0
- 2026A Distribution Mapping Approach to Counterfactually Fair Reinforcement Learning9 Aug 2026
- 2026Counterfactually Safe Reinforcement Learning24 May 2026
- 2025Unifying Causal Reinforcement Learning: Survey, Taxonomy, Algorithms and Applications19 Dec 2025
- 2025Fairness Aware Reinforcement Learning via Proximal Policy Optimization6 Feb 2025
- 2025The Cake that is Intelligence and Who Gets to Bake it: An AI Analogy and its Implications for Participation5 Feb 2025
- 2025Counterfactually Fair Reinforcement Learning via Sequential Data Preprocessing10 Jan 2025
- 2024What Hides behind Unfairness? Exploring Dynamics Fairness in Reinforcement Learning16 Apr 2024
- 2024GenderBias-VL: Benchmarking Gender Bias in Vision Language Models via Counterfactual Probingcited by 31
- 2023Survey of Social Bias in Vision-Language Modelscited by 26
- 2025Bias Beyond Demographics: Probing Decision Boundaries in Black-Box LVLMs via Counterfactual VQAcited by 2
- 2026Measuring Social Bias in Vision-Language Models with Face-Only Counterfactuals from Real Photoscited by 2
- 2026Unlearning Under Imbalance: Benchmarking Fairness in Multimodal LLM Unlearningcited by 0
- 2026Mitigating Bias in Large Vision-Language Models via Counterfactual Ensemble Decodingcited by 0
- 2026Guardrail-Agnostic Societal Bias Evaluation in Large Vision-Language Modelscited by 0
- 2026Guardrail-Agnostic Societal Bias Evaluation in Large Vision-Language Models30 Aug 2026
- 2026Mitigating Bias in Large Vision-Language Models via Counterfactual Ensemble Decoding12 Aug 2026
- 2026Unlearning Under Imbalance: Benchmarking Fairness in Multimodal LLM Unlearning23 Jul 2026
- 2026Measuring Social Bias in Vision-Language Models with Face-Only Counterfactuals from Real Photos11 Jan 2026
- 2025Bias Beyond Demographics: Probing Decision Boundaries in Black-Box LVLMs via Counterfactual VQA5 Aug 2025
- 2024GenderBias-VL: Benchmarking Gender Bias in Vision Language Models via Counterfactual Probing30 Jun 2024
- 2023Survey of Social Bias in Vision-Language Models24 Sep 2023
- 2023Reasoning or Reciting? Exploring the Capabilities and Limitations of Language Models Through Counterfactual Taskscited by 246
- 2023Causal normalizing flows: from theory to practicecited by 51
- 2024Causal Evaluation of Language Modelscited by 18
- 2025Counterfactual reasoning: an analysis of in-context emergencecited by 4
- 2026A Survey on Federated Causal Discovery and Inferencecited by 0
- 2026GoT-CD: Graph-of-Thoughts Causal Discovery and the Fragility of Post-hoc Path-Specific Fairness Auditscited by 0
- 2026GoT-CD: Graph-of-Thoughts Causal Discovery and the Fragility of Post-hoc Path-Specific Fairness Audits3 Aug 2026
- 2026A Survey on Federated Causal Discovery and Inference21 Jun 2026
- 2025Counterfactual reasoning: an analysis of in-context emergence5 Jun 2025
- 2024Causal Evaluation of Language Models1 May 2024
- 2023Reasoning or Reciting? Exploring the Capabilities and Limitations of Language Models Through Counterfactual Tasks5 Jul 2023
- 2023Causal normalizing flows: from theory to practice8 Jun 2023
- 2024Counterfactual Effect Decomposition in Multi-Agent Sequential Decision Makingcited by 4
- 2026AgentFairBench: Do LLM Agents Discriminate When They Act?cited by 3
- 2026Counterfactual Fairness Evaluation of LLM-Based Contact Center Agent Quality Assurance Systemcited by 2
- 2026Emergence of Agentic AI: A Review on Evolution, Background, Working Principles, Applications, Adoption Factors, and Future Research Directionscited by 0
- 2026Beyond Outcome Gaps: Process-Aware Fairness Diagnosis for LLM-based Multi-Agent Decision Systemscited by 0
- 2026Beyond Outcome Gaps: Process-Aware Fairness Diagnosis for LLM-based Multi-Agent Decision Systems2 Sep 2026
- 2026Emergence of Agentic AI: A Review on Evolution, Background, Working Principles, Applications, Adoption Factors, and Future Research Directions20 Jun 2026
- 2026AgentFairBench: Do LLM Agents Discriminate When They Act?15 Jun 2026
- 2026Counterfactual Fairness Evaluation of LLM-Based Contact Center Agent Quality Assurance System16 Feb 2026
- 2024Counterfactual Effect Decomposition in Multi-Agent Sequential Decision Making16 Oct 2024
- 2024Robust agents learn causal world modelscited by 81
- 2024Robust agents learn causal world models16 Feb 2024
- 2021Towards Out-Of-Distribution Generalization: A Surveycited by 436
- 2022A Holistic Approach to Undesired Content Detection in the Real Worldcited by 356
- 2023LEACE: Perfect linear concept erasure in closed formcited by 267
- 2024ShieldGemma: Generative AI Content Moderation Based on Gemmacited by 243
- 2021Towards Causal Representation Learningcited by 209
- 2021Causal Inference in Natural Language Processing: Estimation, Prediction, Interpretation and Beyondcited by 178
- 2021A survey on datasets for fairness-aware machine learningcited by 157
- 2023Auditing large language models: a three-layered approachcited by 137
- 2021Towards a Unified Framework for Fair and Stable Graph Representation Learningcited by 128
- 2022Bias Mitigation for Machine Learning Classifiers: A Comprehensive Surveycited by 125
- 2021Data Collection and Quality Challenges in Deep Learning: A Data-Centric AI Perspectivecited by 116
- 2021Counterfactual Attention Learning for Fine-Grained Visual Categorization and Re-identificationcited by 114
12 most cited of 754 All 754 (JSON)
- 2026Thin Evidence, Thick Priors: How Language Models Substitute Identity for Missing Financial Facts6 Oct 2026
- 2026Causally Fair Generation with Large Language Models3 Oct 2026
- 2026Causal Memory Policy: Making Memory Utility Identifiable by Intervening on Retrieval1 Oct 2026
- 2026Counterfactual Auditing of Bias in Open-Source Large Language Models for Clinical Triage1 Oct 2026
- 2026Minimax Optimal Regret for Causal Logistic Bandits with Counterfactual Fairness1 Oct 2026
- 2026Trustworthy Data- and ML-Ops for Intelligent Transportation Systems and Logistics1 Oct 2026
- 2026Where Privacy Belongs: Placement Diagnosis and Certified Selection for Private Counterfactual Explanations on Graphs29 Sep 2026
- 2026Certifying Interventional Agreement Among Observationally Equivalent Causal Models26 Sep 2026
- 2026Is invariance all you need for algorithmic fairness? Removing demographic information can create new bias25 Sep 2026
- 2026NNV3: Expanding Neural Network Verification to New Architectures and Domains24 Sep 2026
- 2026Path-specific harm decomposition: A partial identification framework24 Sep 2026
- 2026The Gold in Bias: Maturing the AI Design Process through Verification24 Sep 2026
12 newest of 754 All 754 (JSON)