Uncovering Discrimination Clusters: Quantifying and Explaining Systematic Fairness Violations
Not on the map. Why?
Abstract (arXiv)
Fairness in algorithmic decision-making is often framed in terms of individual fairness, which requires that similar individuals receive similar outcomes. A system violates individual fairness if there exists a pair of inputs differing only in protected attributes (such as race or gender) that lead to significantly different outcomes-for example, one favorable and the other unfavorable. While this notion highlights isolated instances of unfairness, it fails to capture broader patterns of systematic or clustered discrimination that may affect entire subgroups. We introduce and motivate the concept of discrimination clustering, a generalization of individual fairness violations. Rather than detecting single counterfactual disparities, we seek to uncover regions of the input space where small perturbations in protected features lead to k-significantly distinct clusters of outcomes. That is, for a given input, we identify a local neighborhood-differing only in protected attributes-whose members' outputs separate into many distinct clusters. These clusters reveal significant arbitrariness in treatment solely based on protected attributes that help expose patterns of algorithmic bias that elude pairwise fairness checks. We present HyFair, a hybrid technique that combines formal symbolic analysis (via SMT and MILP solvers) to certify individual fairness with randomized search to discover discriminatory clusters. This combination enables both formal guarantees-when no counterexamples exist-and the detection of severe violations that are computationally challenging for symbolic methods alone. Given a set of inputs exhibiting high k-unfairness, we introduce a novel explanation method to generate interpretable, decision-tree-style artifacts. Our experiments demonstrate that HyFair outperforms state-of-the-art fairness verification and local explanation methods.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 28 of its 59 references that are in the map. First posted on arXiv 29 Dec 2025.
Builds on
28 of 59 references.
References · 28
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,040
- 2017Counterfactual Explanations without Opening the Black Box: Automated Decisions and the GDPRcited by 1,086
- 2017Counterfactual Fairnesscited by 802
- 2019Explaining Machine Learning Classifiers through Diverse Counterfactual Explanationscited by 612
- 2018Local Rule-Based Explanations of Black Box Decision Systemscited by 165
- 2021Bias in Machine Learning Software: Why? How? What to do?cited by 92
- 2017Verifying Properties of Binarized Deep Neural Networkscited by 77
- 2018Automated Directed Fairness Testingcited by 77
- 2020Do the Machine Learning Models on a Crowd Sourced Platform Exhibit Bias? An Empirical Study on Model Fairnesscited by 52
- 2020Verifying Individual Fairness in Machine Learning Modelscited by 49
- 2019Perfectly Parallel Fairness Certification of Neural Networkscited by 42
16 more
- 2021Characterizing Intersectional Group Fairness with Worst-Case Comparisonscited by 42
- 2021NeuronFair: Interpretable White-Box Fairness Testing through Biased Neuron Identificationcited by 42
- 2022Fairness-aware Configuration of Machine Learning Librariescited by 28
- 2017Towards Proving the Adversarial Robustness of Deep Neural Networkscited by 26
- 2023Latent Imitator: Generating Natural Individual Discriminatory Instances for Black-Box Fairness Testingcited by 23
- 2022Fairify: Fairness Verification of Neural Networkscited by 22
- 2018Automated Test Generation to Detect Individual Discrimination in AI Modelscited by 21
- 2021FairMask: Better Fairness via Model-based Rebalancing of Protected Attributescited by 19
- 2022CertiFair: A Framework for Certified Global Fairness of Neural Networkscited by 17
- 2022Adaptive Fairness Improvement Based on Causality Analysiscited by 17
- 2023Information-Theoretic Testing and Debugging of Fairness Defects in Deep Neural Networkscited by 10
- 2024NeuFair: Neural Network Fairness Repair with Dropoutcited by 9
- 2023Certifying the Fairness of KNN in the Presence of Dataset Biascited by 7
- 2024FairLay-ML: Intuitive Debugging of Fairness in Data-Driven Social-Critical Softwarecited by 4
- 2024FairQuant: Certifying and Quantifying Fairness of Deep Neural Networkscited by 4
- 2025Fairness Testing through Extreme Value Theorycited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.