Training Well-Generalizing Classifiers for Fairness Metrics and Other Data-Dependent Constraints
Not on the map. Why?
Abstract (arXiv)
Classifiers can be trained with data-dependent constraints to satisfy fairness goals, reduce churn, achieve a targeted false positive rate, or other policy goals. We study the generalization performance for such constrained optimization problems, in terms of how well the constraints are satisfied at evaluation time, given that they are satisfied at training time. To improve generalization performance, we frame the problem as a two-player game where one player optimizes the model parameters on a training dataset, and the other player enforces the constraints on an independent validation dataset. We build on recent work in two-player constrained optimization to show that if one uses this two-dataset approach, then constraint generalization can be significantly improved. As we illustrate experimentally, this approach works not only in theory, but also in practice.
Key facts. Cited by 53 papers in the map (data through 7 Oct 2026). First posted on arXiv 29 Jun 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 14; 2022: 9; 2023: 15; 2024: 4; 2025: 5; 2026: 6.
53 papers.
Sort:
By area:
- 2022Bias Mitigation for Machine Learning Classifiers: A Comprehensive Surveycited by 125
- 2021Fair Mixup: Fairness via Interpolationcited by 109
- 2021Constrained Learning with Non-Convex Lossescited by 42
- 2021Understanding and Improving Fairness-Accuracy Trade-offs in Multi-Task Learningcited by 34
- 2021An Empirical Framework for Domain Generalization in Clinical Settingscited by 32
- 2021Evaluating Debiasing Techniques for Intersectional Biasescited by 30
- 2022Escaping Saddle Points for Effective Generalization on Class-Imbalanced Datacited by 28
- 2021Measuring Generalization with Optimal Transportcited by 24
- 2021A Sociotechnical View of Algorithmic Fairnesscited by 24
- 2021Fast Approximations for Job Shop Scheduling: A Lagrangian Dual Deep Learning Methodcited by 20
- 2022What-is and How-to for Fairness in Machine Learning: A Survey, Reflection, and Perspectivecited by 18
- 2022Net benefit, calibration, threshold selection, and training objectives for algorithmic fairness in healthcarecited by 16
38 more
- 2022Active Learning with Safety Constraintscited by 16
- 2022Instance-optimal PAC Algorithms for Contextual Banditscited by 16
- 2022FIFA: Making Fairness More Generalizable in Classifiers Trained on Imbalanced Datacited by 13
- 2023FAIRER: Fairness as Decision Rationale Alignmentcited by 12
- 2021Training Over-parameterized Models with Non-decomposable Objectivescited by 11
- 2023Cross-Institutional Transfer Learning for Educational Models: Implications for Model Performance, Fairness, and Equitycited by 9
- 2024Near-Optimal Solutions of Constrained Learning Problemscited by 9
- 2024Fair Bilevel Neural Network (FairBiNN): On Balancing fairness and accuracy via Stackelberg Equilibriumcited by 9
- 2021Fairness Through Regularization for Learning to Rankcited by 8
- 2021Task-Adaptive Neural Network Search with Meta-Contrastive Learningcited by 8
- 2023Data Augmentation via Subgroup Mixup for Improving Fairnesscited by 8
- 2023Toward Operationalizing Pipeline-aware ML Fairness: A Research Agenda for Developing Practical Guidelines and Toolscited by 7
- 2024Secure and Confidential Certificates of Online Fairnesscited by 7
- 2022Estimating and Controlling for Equalized Odds via Sensitive Attribute Predictorscited by 5
- 2023fairml: A Statistician's Take on Fair Machine Learning Modellingcited by 4
- 2023A Theoretical Approach to Characterize the Accuracy-Fairness Trade-off Pareto Frontiercited by 4
- 2025Position: Adopt Constraints Over Fixed Penalties in Deep Learningcited by 4
- 2021Fairness-aware Summarization for Justified Decision-Makingcited by 3
- 2021A Pre-processing Method for Fairness in Rankingcited by 3
- 2023Fair-CDA: Continuous and Directional Augmentation for Group Fairnesscited by 3
- 2022Distraction is All You Need for Fairnesscited by 2
- 2023MLHOps: Machine Learning for Healthcare Operationscited by 2
- 2023Towards Bridging the FL Performance-Explainability Trade-Off: A Trustworthy 6G RAN Slicing Use-Casecited by 2
- 2023Fair Few-shot Learning with Auxiliary Setscited by 2
- 2023Fair Active Learning in Low-Data Regimescited by 2
- 2024Specification Overfitting in Artificial Intelligencecited by 2
- 2025Exact Reformulation and Optimization for Direct Metric Optimization in Binary Imbalanced Classificationcited by 2
- 2025A Dual Perspective on Decision-Focused Learning: Scalable Training via Dual-Guided Surrogatescited by 2
- 2023Towards clinical AI fairness: A translational perspectivecited by 1
- 2023Explanation-Guided Fair Federated Learning for Transparent 6G RAN Slicingcited by 1
- 2025Fair-FLIP: Fair Deepfake Detection with Fairness-Oriented Final Layer Input Prioritisingcited by 1
- 2026Fairness Aware Reward Optimizationcited by 1
- 2021The Price of Diversitycited by 0
- 2023Calibrated Data-Dependent Constraints with Exact Satisfaction Guaranteescited by 0
- 2023GroupMixNorm Layer for Learning Fair Modelscited by 0
- 2025Private Rate-Constrained Optimization with Applications to Fair Learningcited by 0
- 2026Separation-Utility Pareto Frontier: An Information-Theoretic Characterizationcited by 0
- 2026Residual-Controlled Multiplier Learning for Stochastic Constrained Decision-Makingcited by 0
50 most cited of 53 All 53 (JSON)
- 2026Controlling for Omitted Variable Bias in Deep Neural Networks26 Aug 2026
- 2026Beyond Binary: Continuous State Optimization with Graph-Structured Objectives10 Aug 2026
- 2026Is Fairness Truly Fair? Towards Reliable Lipschitz Fairness in Multi-Task Learning via Fixed-texorpdfstringδdelta Alignment9 Jun 2026
- 2026Residual-Controlled Multiplier Learning for Stochastic Constrained Decision-Making5 Jun 2026
- 2026Fairness Aware Reward Optimization8 Feb 2026
- 2026Separation-Utility Pareto Frontier: An Information-Theoretic Characterization4 Feb 2026
- 2025A Dual Perspective on Decision-Focused Learning: Scalable Training via Dual-Guided Surrogates7 Nov 2025
- 2025Exact Reformulation and Optimization for Direct Metric Optimization in Binary Imbalanced Classification21 Jul 2025
- 2025Fair-FLIP: Fair Deepfake Detection with Fairness-Oriented Final Layer Input Prioritising11 Jul 2025
- 2025Private Rate-Constrained Optimization with Applications to Fair Learning28 May 2025
- 2025Position: Adopt Constraints Over Fixed Penalties in Deep Learning27 May 2025
- 2024Fair Bilevel Neural Network (FairBiNN): On Balancing fairness and accuracy via Stackelberg Equilibrium21 Oct 2024
38 more
- 2024Secure and Confidential Certificates of Online Fairness17 Sep 2024
- 2024Near-Optimal Solutions of Constrained Learning Problems18 Mar 2024
- 2024Specification Overfitting in Artificial Intelligence13 Mar 2024
- 2023GroupMixNorm Layer for Learning Fair Models19 Dec 2023
- 2023Fair Active Learning in Low-Data Regimes13 Dec 2023
- 2023A Theoretical Approach to Characterize the Accuracy-Fairness Trade-off Pareto Frontier19 Oct 2023
- 2023Toward Operationalizing Pipeline-aware ML Fairness: A Research Agenda for Developing Practical Guidelines and Tools29 Sep 2023
- 2023Data Augmentation via Subgroup Mixup for Improving Fairness13 Sep 2023
- 2023Fair Few-shot Learning with Auxiliary Sets28 Aug 2023
- 2023Towards Bridging the FL Performance-Explainability Trade-Off: A Trustworthy 6G RAN Slicing Use-Case24 Jul 2023
- 2023Explanation-Guided Fair Federated Learning for Transparent 6G RAN Slicing18 Jul 2023
- 2023FAIRER: Fairness as Decision Rationale Alignment27 Jun 2023
- 2023MLHOps: Machine Learning for Healthcare Operations4 May 2023
- 2023fairml: A Statistician's Take on Fair Machine Learning Modelling3 May 2023
- 2023Cross-Institutional Transfer Learning for Educational Models: Implications for Model Performance, Fairness, and Equity1 May 2023
- 2023Towards clinical AI fairness: A translational perspective26 Apr 2023
- 2023Fair-CDA: Continuous and Directional Augmentation for Group Fairness1 Apr 2023
- 2023Calibrated Data-Dependent Constraints with Exact Satisfaction Guarantees15 Jan 2023
- 2022Escaping Saddle Points for Effective Generalization on Class-Imbalanced Data28 Dec 2022
- 2022Estimating and Controlling for Equalized Odds via Sensitive Attribute Predictors25 Jul 2022
- 2022Bias Mitigation for Machine Learning Classifiers: A Comprehensive Survey14 Jul 2022
- 2022Instance-optimal PAC Algorithms for Contextual Bandits5 Jul 2022
- 2022Active Learning with Safety Constraints22 Jun 2022
- 2022What-is and How-to for Fairness in Machine Learning: A Survey, Reflection, and Perspective8 Jun 2022
- 2022FIFA: Making Fairness More Generalizable in Classifiers Trained on Imbalanced Data6 Jun 2022
- 2022Distraction is All You Need for Fairness15 Mar 2022
- 2022Net benefit, calibration, threshold selection, and training objectives for algorithmic fairness in healthcare3 Feb 2022
- 2021A Pre-processing Method for Fairness in Ranking29 Oct 2021
- 2021Fast Approximations for Job Shop Scheduling: A Lagrangian Dual Deep Learning Method12 Oct 2021
- 2021A Sociotechnical View of Algorithmic Fairness27 Sep 2021
- 2021Evaluating Debiasing Techniques for Intersectional Biases21 Sep 2021
- 2021Fairness-aware Summarization for Justified Decision-Making13 Jul 2021
- 2021Training Over-parameterized Models with Non-decomposable Objectives9 Jul 2021
- 2021The Price of Diversity3 Jul 2021
- 2021Measuring Generalization with Optimal Transport7 Jun 2021
- 2021Understanding and Improving Fairness-Accuracy Trade-offs in Multi-Task Learning4 Jun 2021
- 2021An Empirical Framework for Domain Generalization in Clinical Settings20 Mar 2021
- 2021Fair Mixup: Fairness via Interpolation11 Mar 2021
50 newest of 53 All 53 (JSON)
- 2026Fairness Aware Reward Optimizationcited by 1
- 2026Fairness Aware Reward Optimization8 Feb 2026
- 2022Bias Mitigation for Machine Learning Classifiers: A Comprehensive Surveycited by 125
- 2021Fair Mixup: Fairness via Interpolationcited by 109
- 2021Constrained Learning with Non-Convex Lossescited by 42
- 2021Understanding and Improving Fairness-Accuracy Trade-offs in Multi-Task Learningcited by 34
- 2021An Empirical Framework for Domain Generalization in Clinical Settingscited by 32
- 2021Evaluating Debiasing Techniques for Intersectional Biasescited by 30
- 2022Escaping Saddle Points for Effective Generalization on Class-Imbalanced Datacited by 28
- 2021Measuring Generalization with Optimal Transportcited by 24
- 2021A Sociotechnical View of Algorithmic Fairnesscited by 24
- 2021Fast Approximations for Job Shop Scheduling: A Lagrangian Dual Deep Learning Methodcited by 20
- 2022What-is and How-to for Fairness in Machine Learning: A Survey, Reflection, and Perspectivecited by 18
- 2022Net benefit, calibration, threshold selection, and training objectives for algorithmic fairness in healthcarecited by 16
12 most cited of 52 All 52 (JSON)
- 2026Controlling for Omitted Variable Bias in Deep Neural Networks26 Aug 2026
- 2026Beyond Binary: Continuous State Optimization with Graph-Structured Objectives10 Aug 2026
- 2026Is Fairness Truly Fair? Towards Reliable Lipschitz Fairness in Multi-Task Learning via Fixed-texorpdfstringδdelta Alignment9 Jun 2026
- 2026Residual-Controlled Multiplier Learning for Stochastic Constrained Decision-Making5 Jun 2026
- 2026Separation-Utility Pareto Frontier: An Information-Theoretic Characterization4 Feb 2026
- 2025A Dual Perspective on Decision-Focused Learning: Scalable Training via Dual-Guided Surrogates7 Nov 2025
- 2025Exact Reformulation and Optimization for Direct Metric Optimization in Binary Imbalanced Classification21 Jul 2025
- 2025Fair-FLIP: Fair Deepfake Detection with Fairness-Oriented Final Layer Input Prioritising11 Jul 2025
- 2025Private Rate-Constrained Optimization with Applications to Fair Learning28 May 2025
- 2025Position: Adopt Constraints Over Fixed Penalties in Deep Learning27 May 2025
- 2024Fair Bilevel Neural Network (FairBiNN): On Balancing fairness and accuracy via Stackelberg Equilibrium21 Oct 2024
- 2024Secure and Confidential Certificates of Online Fairness17 Sep 2024
12 newest of 52 All 52 (JSON)