Explainability in Machine Learning: a Pedagogical Perspective
Not on the map. Why?
Abstract (arXiv)
Given the importance of integrating of explainability into machine learning, at present, there are a lack of pedagogical resources exploring this. Specifically, we have found a need for resources in explaining how one can teach the advantages of explainability in machine learning. Often pedagogical approaches in the field of machine learning focus on getting students prepared to apply various models in the real world setting, but much less attention is given to teaching students the various techniques one could employ to explain a model's decision-making process. Furthermore, explainability can benefit from a narrative structure that aids one in understanding which techniques are governed by which questions about the data. We provide a pedagogical perspective on how to structure the learning process to better impart knowledge to students and researchers in machine learning, when and how to implement various explainability techniques as well as how to interpret the results. We discuss a system of teaching explainability in machine learning, by exploring the advantages and disadvantages of various opaque and transparent machine learning models, as well as when to utilize specific explainability techniques and the various frameworks used to structure the tools for explainability. Among discussing concrete assignments, we will also discuss ways to structure potential assignments to best help students learn to use explainability as a tool alongside any given machine learning application. Data science professionals completing the course will have a birds-eye view of a rapidly developing area and will be confident to deploy machine learning more widely. A preliminary analysis on the effectiveness of a recently delivered course following the structure presented here is included as evidence supporting our pedagogical approach.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 16 of its 46 references that are in the map. First posted on arXiv 21 Feb 2022.
Builds on
16 of 46 references.
References · 16
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,040
- 2017Understanding Black-box Predictions via Influence Functionscited by 1,714
- 2019Explainable Artificial Intelligence (XAI): Concepts, Taxonomies, Opportunities and Challenges toward Responsible AIcited by 1,543
- 2017Explanation in Artificial Intelligence: Insights from the Social Sciencescited by 1,201
- 2017Counterfactual Explanations without Opening the Black Box: Automated Decisions and the GDPRcited by 1,086
- 2019Fooling LIME and SHAP: Adversarial Attacks on Post hoc Explanation Methodscited by 440
- 2020Questioning the AI: Informing Design Practices for Explainable AI User Experiencescited by 251
- 2019Explainable Machine Learning in Deploymentcited by 210
- 2019One Explanation Does Not Fit All: A Toolkit and Taxonomy of AI Explainability Techniquescited by 164
- 2020Multi-Objective Counterfactual Explanationscited by 157
4 more
- 2020Principles and Practice of Explainable Machine Learningcited by 99
- 2014Interpreting Tree Ensembles with inTreescited by 37
- 2020Machine Learning Explainability for External Stakeholderscited by 17
- 2017Plan Explanations as Model Reconciliation: Moving Beyond Explanation as Soliloquycited by 1
Built on by
Citing papers per year: 2025: 1.
1 paper.
- 2025Multi-criteria Rank-based Aggregation for Explainable AIcited by 0
- 2025Multi-criteria Rank-based Aggregation for Explainable AI30 May 2025