Towards Fair and Explainable AI using a Human-Centered AI Approach
Not on the map. Why?
Abstract (arXiv)
The rise of machine learning (ML) is accompanied by several high-profile cases that have stressed the need for fairness, accountability, explainability and trust in ML systems. The existing literature has largely focused on fully automated ML approaches that try to optimize for some performance metric. However, human-centric measures like fairness, trust, explainability, etc. are subjective in nature, context-dependent, and might not correlate with conventional performance metrics. To deal with these challenges, we explore a human-centered AI approach that empowers people by providing more transparency and human control. In this dissertation, we present 5 research projects that aim to enhance explainability and fairness in classification systems and word embeddings. The first project explores the utility/downsides of introducing local model explanations as interfaces for machine teachers (crowd workers). Our study found that adding explanations supports trust calibration for the resulting ML model and enables rich forms of teaching feedback. The second project presents D-BIAS, a causality-based human-in-the-loop visual tool for identifying and mitigating social biases in tabular datasets. Apart from fairness, we found that our tool also enhances trust and accountability. The third project presents WordBias, a visual interactive tool that helps audit pre-trained static word embeddings for biases against groups, such as females, or subgroups, such as Black Muslim females. The fourth project presents DramatVis Personae, a visual analytics tool that helps identify social biases in creative writing. Finally, the last project presents an empirical study aimed at understanding the cumulative impact of multiple fairness-enhancing interventions at different stages of the ML pipeline on fairness, utility and different population groups. We conclude by discussing some of the future directions.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 60 of its 364 references that are in the map. First posted on arXiv 12 Jun 2023.
Builds on
60 of 364 references.
References · 60
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
- 2018Deep contextualized word representationscited by 2,285
- 2016Equality of Opportunity in Supervised Learningcited by 2,000
- 2017Towards A Rigorous Science of Interpretable Machine Learningcited by 1,400
- 2017Counterfactual Fairnesscited by 802
- 2018Gender Bias in Coreference Resolution: Evaluation and Debiasing Methodscited by 657
- 2016Inherent Trade-Offs in the Fair Determination of Risk Scorescited by 582
- 2021Retiring Adult: New Datasets for Fair Machine Learningcited by 443
- 2017Men Also Like Shopping: Reducing Gender Bias Amplification using Corpus-level Constraintscited by 420
38 more
- 2017On Fairness and Calibrationcited by 406
- 2017Preventing Fairness Gerrymandering: Auditing and Learning for Subgroup Fairnesscited by 381
- 2018AI Fairness 360: An Extensible Toolkit for Detecting, Understanding, and Mitigating Unwanted Algorithmic Biascited by 319
- 2019Lipstick on a Pig: Debiasing Methods Cover up Systematic Gender Biases in Word Embeddings But do not Remove Themcited by 268
- 2018Manipulating and Measuring Model Interpretabilitycited by 256
- 2018Examining Gender and Race Bias in Two Hundred Sentiment Analysis Systemscited by 234
- 2019Fair Regression: Quantitative Definitions and Reduction-based Algorithmscited by 168
- 2020Detecting Emergent Intersectional Biases: Contextualized Word Embeddings Contain a Distribution of Human-like Biasescited by 167
- 2019One Explanation Does Not Fit All: A Toolkit and Taxonomy of AI Explainability Techniquescited by 164
- 2017A Convex Framework for Fair Regressioncited by 147
- 2019Black is to Criminal as Caucasian is to Police: Detecting and Removing Multiclass Bias in Word Embeddingscited by 146
- 2019Assessing Social and Intersectional Biases in Contextualized Word Representationscited by 134
- 2021Human-Centered Explainable AI (XAI): From Algorithms to User Experiencescited by 123
- 2019FairVis: Visual Analytics for Discovering Intersectional Bias in Machine Learningcited by 93
- 2018Bias Mitigation Post-processing for Individual and Group Fairnesscited by 72
- 2018How do Humans Understand Explanations from Machine Learning Systems? An Evaluation of the Human-Interpretability of Explanationcited by 71
- 2017On Formalizing Fairness in Prediction with Machine Learningcited by 65
- 2019Attenuating Bias in Word Vectorscited by 64
- 2021It's COMPASlicated: The Messy Relationship between RAI Datasets and Algorithmic Fairness Benchmarkscited by 61
- 2021Fair Preprocessing: Towards Understanding Compositional Fairness of Data Transformers in Machine Learning Pipelinecited by 49
- 2018Interpretable to Whom? A Role-based Model for Analyzing Interpretable Machine Learning Systemscited by 47
- 2020The Emerging Landscape of Explainable AI Planning and Decision Makingcited by 44
- 2016Embedding Projector: Interactive Visualization and Interpretation of Embeddingscited by 43
- 2017Machine Teaching: A New Paradigm for Building Machine Learning Systemscited by 41
- 2021Wordcraft: a Human-AI Collaborative Editor for Story Writingcited by 41
- 2020Double-Hard Debias: Tailoring Word Embeddings for Gender Bias Mitigationcited by 36
- 2019Man is to Person as Woman is to Location: Measuring Gender Bias in Named Entity Recognitioncited by 28
- 2018A Survey of Word Embeddings Evaluation Methodscited by 26
- 2017Penalizing Unfairness in Binary Classificationcited by 25
- 2018Understanding Unequal Gender Classification Accuracy from Face Imagescited by 25
- 2020Exploring the Linear Subspace Hypothesis in Gender Bias Mitigationcited by 25
- 2020Assessing Demographic Bias in Named Entity Recognitioncited by 23
- 2020Individual Fairness in Pipelinescited by 22
- 2020Intersectional Bias in Hate Speech and Abusive Language Datasetscited by 22
- 2017Fair Pipelinescited by 21
- 2020Explainable Active Learning (XAL): An Empirical Study of How Local Explanations Impact Annotator Experiencecited by 20
- 2020AraWEAT: Multidimensional Analysis of Biases in Arabic Word Embeddingscited by 20
- 2020Evaluating Bias In Dutch Word Embeddingscited by 15
50 most cited of 60 All 60 (JSON)
Built on by
Citing papers per year: 2024: 1.
1 paper.