How optimal transport can tackle gender biases in multi-class neural-network classifiers for job recommendations?
Not on the map. Why?
Abstract (arXiv)
Automatic recommendation systems based on deep neural networks have become extremely popular during the last decade. Some of these systems can however be used for applications which are ranked as High Risk by the European Commission in the A.I. act, as for instance for online job candidate recommendation. When used in the European Union, commercial AI systems for this purpose will then be required to have to proper statistical properties with regard to potential discrimination they could engender. This motivated our contribution, where we present a novel optimal transport strategy to mitigate undesirable algorithmic biases in multi-class neural-network classification. Our stratey is model agnostic and can be used on any multi-class classification neural-network model. To anticipate the certification of recommendation systems using textual data, we then used it on the Bios dataset, for which the learning task consists in predicting the occupation of female and male individuals, based on their LinkedIn biography. Results show that it can reduce undesired algorithmic biases in this context to lower levels than a standard strategy.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 26 of its 47 references that are in the map. First posted on arXiv 27 Feb 2023.
Builds on
26 of 47 references.
References · 26
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2014Sequence to Sequence Learning with Neural Networkscited by 2,974
- 2016Equality of Opportunity in Supervised Learningcited by 2,000
- 2016Optimization Methods for Large-Scale Machine Learningcited by 1,140
- 2015Aligning Books and Movies: Towards Story-like Visual Explanations by Watching Movies and Reading Bookscited by 1,041
- 2016Semantics derived automatically from language corpora contain human-like biasescited by 894
- 2016Fair prediction with disparate impact: A study of bias in recidivism prediction instrumentscited by 671
- 2018Mitigating Unwanted Biases with Adversarial Learningcited by 663
- 2018Gender Bias in Coreference Resolution: Evaluation and Debiasing Methodscited by 657
- 2016Inherent Trade-Offs in the Fair Determination of Risk Scorescited by 582
14 more
- 2017Men Also Like Shopping: Reducing Gender Bias Amplification using Corpus-level Constraintscited by 420
- 2017On Fairness and Calibrationcited by 406
- 2016Fairness Beyond Disparate Treatment & Disparate Impact: Learning Classification without Disparate Mistreatmentcited by 368
- 2018Learning Adversarially Fair and Transferable Representationscited by 353
- 2019Bias in Bios: A Case Study of Semantic Representation Bias in a High-Stakes Settingcited by 346
- 2019Lipstick on a Pig: Debiasing Methods Cover up Systematic Gender Biases in Word Embeddings But do not Remove Themcited by 268
- 2017Word Embeddings Quantify 100 Years of Gender and Ethnic Stereotypescited by 251
- 2018A Simple Method for Commonsense Reasoningcited by 223
- 2020Faster Wasserstein Distance Estimation with the Sinkhorn Divergencecited by 73
- 2018FNNC: Achieving Fairness through Neural Networkscited by 43
- 2020A survey of bias in Machine Learning through the prism of Statistical Parity for the Adult Data Setcited by 35
- 2019Tackling Algorithmic Bias in Neural-Network Classifiers using Wasserstein-2 Regularizationcited by 18
- 2019Discrimination through optimization: How Facebook's ad delivery can lead to skewed outcomescited by 15
- 2019Algorithms that "Don't See Color": Comparing Biases in Lookalike and Special Ad Audiencescited by 3
Built on by
Citing papers per year: 2023: 1; 2024: 1.
2 papers.