mlsanityData to 7 Oct 2026

Towards Fair and Explainable AI using a Human-Centered AI Approach

arXiv 2306.07427 ↗First posted 12 Jun 2023cs.CY cs.HC cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

The rise of machine learning (ML) is accompanied by several high-profile cases that have stressed the need for fairness, accountability, explainability and trust in ML systems. The existing literature has largely focused on fully automated ML approaches that try to optimize for some performance metric. However, human-centric measures like fairness, trust, explainability, etc. are subjective in nature, context-dependent, and might not correlate with conventional performance metrics. To deal with these challenges, we explore a human-centered AI approach that empowers people by providing more transparency and human control. In this dissertation, we present 5 research projects that aim to enhance explainability and fairness in classification systems and word embeddings. The first project explores the utility/downsides of introducing local model explanations as interfaces for machine teachers (crowd workers). Our study found that adding explanations supports trust calibration for the resulting ML model and enables rich forms of teaching feedback. The second project presents D-BIAS, a causality-based human-in-the-loop visual tool for identifying and mitigating social biases in tabular datasets. Apart from fairness, we found that our tool also enhances trust and accountability. The third project presents WordBias, a visual interactive tool that helps audit pre-trained static word embeddings for biases against groups, such as females, or subgroups, such as Black Muslim females. The fourth project presents DramatVis Personae, a visual analytics tool that helps identify social biases in creative writing. Finally, the last project presents an empirical study aimed at understanding the cumulative impact of multiple fairness-enhancing interventions at different stages of the ML pipeline on fairness, utility and different population groups. We conclude by discussing some of the future directions.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 60 of its 364 references that are in the map. First posted on arXiv 12 Jun 2023.

Builds on

60 of 364 references.

References · 60

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  4. 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
  5. 2018Deep contextualized word representationscited by 2,285
  6. 2016Equality of Opportunity in Supervised Learningcited by 2,000
  7. 2017Towards A Rigorous Science of Interpretable Machine Learningcited by 1,400
  8. 2017Counterfactual Fairnesscited by 802
  9. 2018Gender Bias in Coreference Resolution: Evaluation and Debiasing Methodscited by 657
  10. 2016Inherent Trade-Offs in the Fair Determination of Risk Scorescited by 582
  11. 2021Retiring Adult: New Datasets for Fair Machine Learningcited by 443
  12. 2017Men Also Like Shopping: Reducing Gender Bias Amplification using Corpus-level Constraintscited by 420
38 more
  1. 2017On Fairness and Calibrationcited by 406
  2. 2017Preventing Fairness Gerrymandering: Auditing and Learning for Subgroup Fairnesscited by 381
  3. 2018AI Fairness 360: An Extensible Toolkit for Detecting, Understanding, and Mitigating Unwanted Algorithmic Biascited by 319
  4. 2019Lipstick on a Pig: Debiasing Methods Cover up Systematic Gender Biases in Word Embeddings But do not Remove Themcited by 268
  5. 2018Manipulating and Measuring Model Interpretabilitycited by 256
  6. 2018Examining Gender and Race Bias in Two Hundred Sentiment Analysis Systemscited by 234
  7. 2019Fair Regression: Quantitative Definitions and Reduction-based Algorithmscited by 168
  8. 2020Detecting Emergent Intersectional Biases: Contextualized Word Embeddings Contain a Distribution of Human-like Biasescited by 167
  9. 2019One Explanation Does Not Fit All: A Toolkit and Taxonomy of AI Explainability Techniquescited by 164
  10. 2017A Convex Framework for Fair Regressioncited by 147
  11. 2019Black is to Criminal as Caucasian is to Police: Detecting and Removing Multiclass Bias in Word Embeddingscited by 146
  12. 2019Assessing Social and Intersectional Biases in Contextualized Word Representationscited by 134
  13. 2021Human-Centered Explainable AI (XAI): From Algorithms to User Experiencescited by 123
  14. 2019FairVis: Visual Analytics for Discovering Intersectional Bias in Machine Learningcited by 93
  15. 2018Bias Mitigation Post-processing for Individual and Group Fairnesscited by 72
  16. 2018How do Humans Understand Explanations from Machine Learning Systems? An Evaluation of the Human-Interpretability of Explanationcited by 71
  17. 2017On Formalizing Fairness in Prediction with Machine Learningcited by 65
  18. 2019Attenuating Bias in Word Vectorscited by 64
  19. 2021It's COMPASlicated: The Messy Relationship between RAI Datasets and Algorithmic Fairness Benchmarkscited by 61
  20. 2021Fair Preprocessing: Towards Understanding Compositional Fairness of Data Transformers in Machine Learning Pipelinecited by 49
  21. 2018Interpretable to Whom? A Role-based Model for Analyzing Interpretable Machine Learning Systemscited by 47
  22. 2020The Emerging Landscape of Explainable AI Planning and Decision Makingcited by 44
  23. 2016Embedding Projector: Interactive Visualization and Interpretation of Embeddingscited by 43
  24. 2017Machine Teaching: A New Paradigm for Building Machine Learning Systemscited by 41
  25. 2021Wordcraft: a Human-AI Collaborative Editor for Story Writingcited by 41
  26. 2020Double-Hard Debias: Tailoring Word Embeddings for Gender Bias Mitigationcited by 36
  27. 2019Man is to Person as Woman is to Location: Measuring Gender Bias in Named Entity Recognitioncited by 28
  28. 2018A Survey of Word Embeddings Evaluation Methodscited by 26
  29. 2017Penalizing Unfairness in Binary Classificationcited by 25
  30. 2018Understanding Unequal Gender Classification Accuracy from Face Imagescited by 25
  31. 2020Exploring the Linear Subspace Hypothesis in Gender Bias Mitigationcited by 25
  32. 2020Assessing Demographic Bias in Named Entity Recognitioncited by 23
  33. 2020Individual Fairness in Pipelinescited by 22
  34. 2020Intersectional Bias in Hate Speech and Abusive Language Datasetscited by 22
  35. 2017Fair Pipelinescited by 21
  36. 2020Explainable Active Learning (XAL): An Empirical Study of How Local Explanations Impact Annotator Experiencecited by 20
  37. 2020AraWEAT: Multidimensional Analysis of Biases in Arabic Word Embeddingscited by 20
  38. 2020Evaluating Bias In Dutch Word Embeddingscited by 15

50 most cited of 60 All 60 (JSON)

Built on by

Cited by year

Citing papers per year: 2024: 1.

1 paper.