Two Simple Ways to Learn Individual Fairness Metrics from Data
Not on the map. Why?
Abstract (arXiv)
Individual fairness is an intuitive definition of algorithmic fairness that addresses some of the drawbacks of group fairness. Despite its benefits, it depends on a task specific fair metric that encodes our intuition of what is fair and unfair for the ML task at hand, and the lack of a widely accepted fair metric for many ML tasks is the main barrier to broader adoption of individual fairness. In this paper, we present two simple ways to learn fair metrics from a variety of data types. We show empirically that fair training with the learned metrics leads to improved fairness on three machine learning tasks susceptible to gender and racial biases. We also provide theoretical guarantees on the statistical performance of both approaches.
Key facts. Cited by 54 papers in the map (data through 7 Oct 2026). First posted on arXiv 19 Jun 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 7; 2022: 14; 2023: 16; 2024: 8; 2025: 6; 2026: 3.
54 papers.
Sort:
- 2021Post-processing for Individual Fairnesscited by 61
- 2021A Sociotechnical View of Algorithmic Fairnesscited by 24
- 2022Individual Fairness Guarantees for Neural Networkscited by 23
- 2022Learning fair representation with a parametric integral probability metriccited by 20
- 2021Latent Space Smoothing for Individually Fair Representationscited by 18
- 2022What-is and How-to for Fairness in Machine Learning: A Survey, Reflection, and Perspectivecited by 18
- 2021Unified Group Fairness on Federated Learningcited by 15
- 2023Uncertainty-based Fairness Measurescited by 15
- 2021Statistical inference for individual fairnesscited by 13
- 2022Domain Adaptation meets Individual Fairness. And they get alongcited by 13
- 2021Individually Fair Gradient Boostingcited by 12
- 2023Chasing Fairness Under Distribution Shift: A Model Weight Perturbation Approachcited by 12
38 more
- 2023Individual Fairness under Uncertaintycited by 11
- 2024Rethinking Fair Graph Neural Networks from Re-balancingcited by 11
- 2024AIM: Attributing, Interpreting, Mitigating Data Unfairnesscited by 9
- 2022Multi-disciplinary fairness considerations in machine learning for clinical trialscited by 8
- 2022Learning Antidote Data to Individual Unfairnesscited by 8
- 2021Individually Fair Rankingcited by 7
- 2023Fairness Evaluation in Text Classification: Machine Learning Practitioner Perspectives of Individual and Group Fairnesscited by 7
- 2025Fair Deepfake Detectors Can Generalizecited by 7
- 2022Private and Reliable Neural Network Inferencecited by 6
- 2023GFairHint: Improving Individual Fairness for Graph Neural Networks via Fairness Hintcited by 6
- 2022Individually Fair Learning with One-Sided Feedbackcited by 5
- 2022iFlipper: Label Flipping for Individual Fairnesscited by 5
- 2022Human-Guided Fair Classification for Natural Language Processingcited by 5
- 2024What is Fair? Defining Fairness in Machine Learning for Healthcited by 5
- 2022Manifestations of Xenophobia in AI Systemscited by 4
- 2023Retiring DeltaDP: New Distribution-Level Metrics for Demographic Paritycited by 4
- 2025Rethinking Individual Fairness in Deepfake Detectioncited by 4
- 2022SLIDE: a surrogate fairness constraint to ensure fairness consistencycited by 3
- 2023Causal Fair Metric: Bridging Causality, Individual Fairness, and Adversarial Robustnesscited by 3
- 2024Monotone Individual Fairnesscited by 3
- 2024FairFML: Fair Federated Machine Learning with a Case Study on Reducing Gender Disparities in Cardiac Arrest Outcome Predictioncited by 3
- 2023Achieving Counterfactual Fairness with Imperfect Structural Causal Modelcited by 2
- 2023To be Robust and to be Fair: Aligning Fairness with Robustnesscited by 2
- 2023Certification of Distributional Individual Fairnesscited by 2
- 2024Positive-Sum Fairness: Leveraging Demographic Attributes to Achieve Fair AI Outcomes Without Sacrificing Group Gainscited by 2
- 2022fAux: Testing Individual Fairness via Gradient Alignmentcited by 1
- 2023Software Doping Analysis for Human Oversightcited by 1
- 2023A Canonical Data Transformation for Achieving Inter- and Within-group Fairnesscited by 1
- 2023Identifying Reasons for Bias: An Argumentation-Based Approachcited by 1
- 2026Investigating Bias and Fairness in Appearance-based Gaze Estimationcited by 1
- 2022Comparing Apples to Oranges: Learning Similarity Functions for Data Produced by Different Distributionscited by 0
- 2023Counterpart Fairness -- Addressing Systematic between-group Differences in Fairness Evaluationcited by 0
- 2023The Flawed Foundations of Fair Machine Learningcited by 0
- 2023Democratize with Care: The need for fairness specific features in user-interface based open source AutoML toolscited by 0
- 2024On the Impact of Output Perturbation on Fairness in Binary Linear Classificationcited by 0
- 2024Individual Fairness Through Reweighting and Tuningcited by 0
- 2025Testing Individual Fairness in Graph Neural Networkscited by 0
- 2025SaGIF: Improving Individual Fairness in Graph Neural Networks via Similarity Encodingcited by 0
50 most cited of 54 All 54 (JSON)
- 2026Is Fairness Truly Fair? Towards Reliable Lipschitz Fairness in Multi-Task Learning via Fixed-texorpdfstringδdelta Alignment9 Jun 2026
- 2026Investigating Bias and Fairness in Appearance-based Gaze Estimation12 Apr 2026
- 2026Equitable Evaluation via Elicitation24 Feb 2026
- 2025FairExpand: Individual Fairness on Graphs with Partial Similarity Information20 Dec 2025
- 2025Wasserstein Distributionally Robust Optimization Through the Lens of Structural Causal Models and Individual Fairness30 Sep 2025
- 2025Rethinking Individual Fairness in Deepfake Detection18 Jul 2025
- 2025Fair Deepfake Detectors Can Generalize3 Jul 2025
- 2025SaGIF: Improving Individual Fairness in Graph Neural Networks via Similarity Encoding23 Jun 2025
- 2025Testing Individual Fairness in Graph Neural Networks25 Apr 2025
- 2024FairFML: Fair Federated Machine Learning with a Case Study on Reducing Gender Disparities in Cardiac Arrest Outcome Prediction7 Oct 2024
- 2024Positive-Sum Fairness: Leveraging Demographic Attributes to Achieve Fair AI Outcomes Without Sacrificing Group Gains30 Sep 2024
- 2024Rethinking Fair Graph Neural Networks from Re-balancing16 Jul 2024
38 more
- 2024What is Fair? Defining Fairness in Machine Learning for Health13 Jun 2024
- 2024AIM: Attributing, Interpreting, Mitigating Data Unfairness13 Jun 2024
- 2024Individual Fairness Through Reweighting and Tuning2 May 2024
- 2024Monotone Individual Fairness11 Mar 2024
- 2024On the Impact of Output Perturbation on Fairness in Binary Linear Classification5 Feb 2024
- 2023Uncertainty-based Fairness Measures18 Dec 2023
- 2023Democratize with Care: The need for fairness specific features in user-interface based open source AutoML tools16 Dec 2023
- 2023Certification of Distributional Individual Fairness20 Nov 2023
- 2023Causal Fair Metric: Bridging Causality, Individual Fairness, and Adversarial Robustness30 Oct 2023
- 2023Identifying Reasons for Bias: An Argumentation-Based Approach25 Oct 2023
- 2023A Canonical Data Transformation for Achieving Inter- and Within-group Fairness23 Oct 2023
- 2023Software Doping Analysis for Human Oversight11 Aug 2023
- 2023The Flawed Foundations of Fair Machine Learning2 Jun 2023
- 2023Counterpart Fairness -- Addressing Systematic between-group Differences in Fairness Evaluation29 May 2023
- 2023GFairHint: Improving Individual Fairness for Graph Neural Networks via Fairness Hint25 May 2023
- 2023To be Robust and to be Fair: Aligning Fairness with Robustness31 Mar 2023
- 2023Achieving Counterfactual Fairness with Imperfect Structural Causal Model26 Mar 2023
- 2023Chasing Fairness Under Distribution Shift: A Model Weight Perturbation Approach6 Mar 2023
- 2023Fairness Evaluation in Text Classification: Machine Learning Practitioner Perspectives of Individual and Group Fairness1 Mar 2023
- 2023Individual Fairness under Uncertainty16 Feb 2023
- 2023Retiring DeltaDP: New Distribution-Level Metrics for Demographic Parity31 Jan 2023
- 2022Human-Guided Fair Classification for Natural Language Processing20 Dec 2022
- 2022Manifestations of Xenophobia in AI Systems15 Dec 2022
- 2022Learning Antidote Data to Individual Unfairness29 Nov 2022
- 2022Private and Reliable Neural Network Inference27 Oct 2022
- 2022fAux: Testing Individual Fairness via Gradient Alignment10 Oct 2022
- 2022iFlipper: Label Flipping for Individual Fairness15 Sep 2022
- 2022Comparing Apples to Oranges: Learning Similarity Functions for Data Produced by Different Distributions26 Aug 2022
- 2022Individually Fair Learning with One-Sided Feedback9 Jun 2022
- 2022What-is and How-to for Fairness in Machine Learning: A Survey, Reflection, and Perspective8 Jun 2022
- 2022Multi-disciplinary fairness considerations in machine learning for clinical trials18 May 2022
- 2022Individual Fairness Guarantees for Neural Networks11 May 2022
- 2022Domain Adaptation meets Individual Fairness. And they get along1 May 2022
- 2022SLIDE: a surrogate fairness constraint to ensure fairness consistency7 Feb 2022
- 2022Learning fair representation with a parametric integral probability metric7 Feb 2022
- 2021Latent Space Smoothing for Individually Fair Representations26 Nov 2021
- 2021Unified Group Fairness on Federated Learning9 Nov 2021
- 2021Post-processing for Individual Fairness26 Oct 2021
50 newest of 54 All 54 (JSON)
- 2021Post-processing for Individual Fairnesscited by 61
- 2021A Sociotechnical View of Algorithmic Fairnesscited by 24
- 2022Individual Fairness Guarantees for Neural Networkscited by 23
- 2022Learning fair representation with a parametric integral probability metriccited by 20
- 2021Latent Space Smoothing for Individually Fair Representationscited by 18
- 2022What-is and How-to for Fairness in Machine Learning: A Survey, Reflection, and Perspectivecited by 18
- 2021Unified Group Fairness on Federated Learningcited by 15
- 2023Uncertainty-based Fairness Measurescited by 15
- 2021Statistical inference for individual fairnesscited by 13
- 2022Domain Adaptation meets Individual Fairness. And they get alongcited by 13
- 2021Individually Fair Gradient Boostingcited by 12
- 2023Chasing Fairness Under Distribution Shift: A Model Weight Perturbation Approachcited by 12
12 most cited of 54 All 54 (JSON)
- 2026Is Fairness Truly Fair? Towards Reliable Lipschitz Fairness in Multi-Task Learning via Fixed-texorpdfstringδdelta Alignment9 Jun 2026
- 2026Investigating Bias and Fairness in Appearance-based Gaze Estimation12 Apr 2026
- 2026Equitable Evaluation via Elicitation24 Feb 2026
- 2025FairExpand: Individual Fairness on Graphs with Partial Similarity Information20 Dec 2025
- 2025Wasserstein Distributionally Robust Optimization Through the Lens of Structural Causal Models and Individual Fairness30 Sep 2025
- 2025Rethinking Individual Fairness in Deepfake Detection18 Jul 2025
- 2025Fair Deepfake Detectors Can Generalize3 Jul 2025
- 2025SaGIF: Improving Individual Fairness in Graph Neural Networks via Similarity Encoding23 Jun 2025
- 2025Testing Individual Fairness in Graph Neural Networks25 Apr 2025
- 2024FairFML: Fair Federated Machine Learning with a Case Study on Reducing Gender Disparities in Cardiac Arrest Outcome Prediction7 Oct 2024
- 2024Positive-Sum Fairness: Leveraging Demographic Attributes to Achieve Fair AI Outcomes Without Sacrificing Group Gains30 Sep 2024
- 2024Rethinking Fair Graph Neural Networks from Re-balancing16 Jul 2024
12 newest of 54 All 54 (JSON)