Tensions Between the Proxies of Human Values in AI
Not on the map. Why?
Abstract (arXiv)
Motivated by mitigating potentially harmful impacts of technologies, the AI community has formulated and accepted mathematical definitions for certain pillars of accountability: e.g. privacy, fairness, and model transparency. Yet, we argue this is fundamentally misguided because these definitions are imperfect, siloed constructions of the human values they hope to proxy, while giving the guise that those values are sufficiently embedded in our technologies. Under popularized methods, tensions arise when practitioners attempt to achieve each pillar of fairness, privacy, and transparency in isolation or simultaneously. In this position paper, we push for redirection. We argue that the AI community needs to consider all the consequences of choosing certain formulations of these pillars -- not just the technical incompatibilities, but also the effects within the context of deployment. We point towards sociotechnical research for frameworks for the latter, but push for broader efforts into implementing these in practice.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 56 of its 108 references that are in the map. First posted on arXiv 14 Dec 2022.
Builds on
56 of 108 references.
References · 56
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,040
- 2016Equality of Opportunity in Supervised Learningcited by 2,000
- 2017Towards A Rigorous Science of Interpretable Machine Learningcited by 1,400
- 2018Datasheets for Datasetscited by 1,371
- 2018Model Cards for Model Reportingcited by 1,068
- 2020Beyond Accuracy: Behavioral Testing of NLP models with CheckListcited by 979
- 2016The Mythos of Model Interpretabilitycited by 716
- 2014Certifying and removing disparate impactcited by 715
- 2016Fair prediction with disparate impact: A study of bias in recidivism prediction instrumentscited by 671
- 2016Inherent Trade-Offs in the Fair Determination of Risk Scorescited by 582
- 2017Preventing Fairness Gerrymandering: Auditing and Learning for Subgroup Fairnesscited by 381
38 more
- 2018Fairness Without Demographics in Repeated Loss Minimizationcited by 363
- 2019Differential Privacy Has Disparate Impact on Model Accuracycited by 316
- 2019Measurement and Fairnesscited by 299
- 2022What Does it Mean for a Language Model to Preserve Privacy?cited by 194
- 2019A Framework for Understanding Sources of Harm throughout the Machine Learning Life Cyclecited by 192
- 2018Delayed Impact of Fair Machine Learningcited by 183
- 2021The Values Encoded in Machine Learning Researchcited by 172
- 2017Fairness in Machine Learning: Lessons from Political Philosophycited by 148
- 2020Debugging Tests for Model Explanationscited by 146
- 2021Large-Scale Differentially Private BERTcited by 117
- 2019Lessons from Archives: Strategies for Collecting Sociocultural Data in Machine Learningcited by 116
- 2019Learning to Deceive with Attention-Based Explanationscited by 111
- 2020Participation is not a Design Fix for Machine Learningcited by 110
- 2017Runaway Feedback Loops in Predictive Policingcited by 97
- 2018Model Reconstruction from Model Explanationscited by 84
- 2020On the Privacy Risks of Algorithmic Fairnesscited by 82
- 2019Fairwashing: the risk of rationalizationcited by 81
- 2022Which Explanation Should I Choose? A Function Approximation Perspective to Characterizing Post Hoc Explanationscited by 77
- 2021Beyond Expertise and Roles: A Framework to Characterize the Stakeholders of Interpretable Machine Learning and their Needscited by 64
- 2018Do Explanations make VQA Models more Predictable to a Human?cited by 51
- 2019Roles for Computing in Social Changecited by 49
- 2018How Do Fairness Definitions Fare? Examining Public Attitudes Towards Algorithmic Definitions of Fairnesscited by 48
- 2019Causal Modeling for Fairness in Dynamical Systemscited by 46
- 2020Model extraction from counterfactual explanationscited by 46
- 2019Distribution Density, Tails, and Outliers in Machine Learning: Metrics and Applicationscited by 43
- 2022The Road to Explainability is Paved with Bias: Measuring the Fairness of Explanationscited by 41
- 2022Fairness via Explanation Quality: Evaluating Disparities in the Quality of Post hoc Explanationscited by 40
- 2022Causal Conceptions of Fairness and their Consequencescited by 38
- 2020Explainability for fair machine learningcited by 33
- 2019Explaining Models: An Empirical Study of How Explanations Impact Fairness Judgmentcited by 31
- 2019Interpretable and Differentially Private Predictionscited by 28
- 2020Model Explanations with Differential Privacycited by 23
- 2021Characterizing the risk of fairwashingcited by 21
- 2018Data Science as Political Action: Grounding Data Science in a Politics of Justicecited by 14
- 2017Transparency: Motivations and Challengescited by 10
- 2022An Uncommon Task: Participatory Design in Legal AIcited by 10
- 2022XAI for Cybersecurity: State of the Art, Challenges, Open Issues and Future Directionscited by 10
- 2022Equalizing Credit Opportunity in Algorithms: Aligning Algorithmic Fairness Research with U.S. Fair Lending Regulationcited by 9
50 most cited of 56 All 56 (JSON)
Built on by
Not cited yet.