Fairness Invariants: A Relational Approach to Explaining and Mitigating Fairness Bugs
Not on the map. Why?
Abstract (arXiv)
Data-driven software systems are increasingly deployed in high-stakes socio-economic domains, from criminal justice to financial lending. However, these systems often exhibit individual discrimination---unjustified disparities in which a program yields different outcomes for similar individuals who differ only in their protected attributes (e.g., race, gender, age). While existing research has focused on detecting and quantifying these bugs, there remains a critical lack of principled mechanisms to explain and localize individual fairness bugs. Current explanation techniques are largely designed for single-input decisions rather than the relational nature of discrimination, which inherently involves a comparison between an original and a counterfactual pair. We present REMI, a framework for the automated localization, explanation, and mitigation of individual discrimination. Inspired by loop-invariant synthesis in formal methods, we treat counterfactual fairness as a relational invariant discovery problem. We introduce a bidirectional relational explanation framework that learns over paired examples (x, x') to identify regions of the input space where fairness is violated. Unlike traditional one-way implication pairs used in invariant inference, our approach enforces bidirectional constraints: requiring identical outcomes for both original and counterfactual samples. REMI utilizes three data-alignment techniques to infer interpretable rule-based models that act as "fairness invariants." These rules serve as guardrails to selectively block or relabel unfair predictions without requiring model retraining. Our evaluation on symbolic and neural network programs demonstrates that REMI localizes ground-truth fairness bugs in over 83% of cases, significantly outperforming state-of-the-art baselines and reducing discriminatory decisions in black-box models by up to 70%.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 36 of its 69 references that are in the map. First posted on arXiv 26 Aug 2026.
Builds on
36 of 69 references.
References · 36
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
- 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,120
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,040
- 2016Equality of Opportunity in Supervised Learningcited by 2,000
- 2017Counterfactual Fairnesscited by 802
- 2018Mitigating Unwanted Biases with Adversarial Learningcited by 663
- 2019Explaining Machine Learning Classifiers through Diverse Counterfactual Explanationscited by 612
- 2018A Reductions Approach to Fair Classificationcited by 585
- 2018AI Fairness 360: An Extensible Toolkit for Detecting, Understanding, and Mitigating Unwanted Algorithmic Biascited by 319
- 2017Fairness Testing: Testing Software for Discriminationcited by 123
- 2021Bias in Machine Learning Software: Why? How? What to do?cited by 92
- 2018Automated Directed Fairness Testingcited by 77
24 more
- 2020Verifying Individual Fairness in Machine Learning Modelscited by 49
- 2022Causality-based Neural Network Repaircited by 44
- 2019Perfectly Parallel Fairness Certification of Neural Networkscited by 42
- 2021NeuronFair: Interpretable White-Box Fairness Testing through Biased Neuron Identificationcited by 42
- 2023Exploring and Interacting with the Set of Good Sparse Generalized Additive Modelscited by 30
- 2022Fairness-aware Configuration of Machine Learning Librariescited by 28
- 2023Latent Imitator: Generating Natural Individual Discriminatory Instances for Black-Box Fairness Testingcited by 23
- 2022Fairify: Fairness Verification of Neural Networkscited by 22
- 2018Automated Test Generation to Detect Individual Discrimination in AI Modelscited by 21
- 2022FairNeuron: Improving Deep Neural Network Fairness with Adversary Games on Selective Neuronscited by 20
- 2019Software Engineering for Fairness: A Case Study with Hyperparameter Optimizationcited by 18
- 2022Adaptive Fairness Improvement Based on Causality Analysiscited by 17
- 2020VerifyMed -- A blockchain platform for transparent trust in virtualized healthcare: Proof-of-conceptcited by 14
- 2022Fast Interpretable Greedy-Tree Sumscited by 12
- 2023Fix Fairness, Don't Ruin Accuracy: Performance Aware Fairness Repair using AutoMLcited by 9
- 2024NeuFair: Neural Network Fairness Repair with Dropoutcited by 9
- 2023Certifying the Fairness of KNN in the Presence of Dataset Biascited by 7
- 2024FairLay-ML: Intuitive Debugging of Fairness in Data-Driven Social-Critical Softwarecited by 4
- 2024MAFT: Efficient Model-Agnostic Fairness Testing for Deep Neural Networks via Zero-Order Gradient Searchcited by 4
- 2025Attention Pruning: Automated Fairness Repair of Language Models via Surrogate Simulated Annealingcited by 4
- 2024Predicting Fairness of ML Software Configurationscited by 1
- 2025Uncovering Discrimination Clusters: Quantifying and Explaining Systematic Fairness Violationscited by 1
- 2026On the Robustness of Fairness Practices: A Causal Framework for Systematic Evaluationcited by 1
- 2026Analyzing Fairness of Neural Network Prediction via Counterfactual Dataset Generationcited by 1
Built on by
Not cited yet.