GAM Coach: Towards Interactive and User-centered Algorithmic Recourse
Not on the map. Why?
Abstract (arXiv)
Machine learning (ML) recourse techniques are increasingly used in high-stakes domains, providing end users with actions to alter ML predictions, but they assume ML developers understand what input variables can be changed. However, a recourse plan's actionability is subjective and unlikely to match developers' expectations completely. We present GAM Coach, a novel open-source system that adapts integer linear programming to generate customizable counterfactual explanations for Generalized Additive Models (GAMs), and leverages interactive visualizations to enable end users to iteratively generate recourse plans meeting their needs. A quantitative user study with 41 participants shows our tool is usable and useful, and users prefer personalized recourse plans over generic plans. Through a log analysis, we explore how users discover satisfactory recourse plans, and provide empirical evidence that transparency can lead to more opportunities for everyday users to discover counterintuitive patterns in ML models. GAM Coach is available at: https://poloclub.github.io/gam-coach/.
Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 49 of its 107 references that are in the map. First posted on arXiv 27 Feb 2023.
Builds on
49 of 107 references.
References · 49
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
- 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,120
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,040
- 2017Counterfactual Explanations without Opening the Black Box: Automated Decisions and the GDPRcited by 1,086
- 2019Explaining Machine Learning Classifiers through Diverse Counterfactual Explanationscited by 612
- 2018Actionable Recourse in Linear Classificationcited by 327
- 2019Counterfactual Visual Explanationscited by 312
- 2018Explanations based on the Missing: Towards Contrastive Explanations with Pertinent Negativescited by 261
- 2015Strategic Classificationcited by 256
- 2020Algorithmic Recourse: from Counterfactual Explanations to Interventionscited by 250
- 2019InterpretML: A Unified Framework for Machine Learning Interpretabilitycited by 243
- 2019Interpretable Counterfactual Explanations Guided by Prototypescited by 223
37 more
- 2021Polyjuice: Generating Counterfactuals for Explaining, Evaluating, and Improving Modelscited by 219
- 2019The What-If Tool: Interactive Probing of Machine Learning Modelscited by 207
- 2019Model-Agnostic Counterfactual Explanations for Consequential Decisionscited by 204
- 2019Preserving Causal Constraints in Counterfactual Explanations for Machine Learning Classifierscited by 143
- 2020Algorithmic recourse under imperfect causal knowledge: a probabilistic approachcited by 139
- 2018Explaining Explanations in AIcited by 136
- 2019Towards Realistic Individual Recourse and Actionable Explanations in Black-Box Decision Making Systemscited by 128
- 2020A survey of algorithmic recourse: definitions, formulations, solutions, and prospectscited by 118
- 2019The Hidden Assumptions Behind Counterfactual Explanations and Principal Reasonscited by 115
- 2021Counterfactual Explanations Can Be Manipulatedcited by 113
- 2019Efficient Search for Diverse Coherent Explanationscited by 111
- 2018How Do Classifiers Induce Agents To Invest Effort Strategically?cited by 82
- 2021If Only We Had Better Counterfactual Explanations: Five Key Deficits to Rectify in the Evaluation of Counterfactual XAI Techniquescited by 82
- 2020Good Counterfactuals and Where to Find Them: A Case-Based Technique for Generating Counterfactuals for Explainable AI (XAI)cited by 79
- 2019Explanation by Progressive Exaggerationcited by 76
- 2019Summit: Scaling Deep Learning Interpretability by Visualizing Activation and Attribution Summarizationscited by 72
- 2020Instance-based Counterfactual Explanations for Time Series Classificationcited by 64
- 2021Beyond Expertise and Roles: A Framework to Characterize the Stakeholders of Interpretable Machine Learning and their Needscited by 64
- 2020On Generating Plausible Counterfactual and Semi-Factual Explanations for Deep Learningcited by 60
- 2020CNN Explainer: Learning Convolutional Neural Networks with Interactive Visualizationcited by 57
- 2017ActiVis: Visual Exploration of Industry-Scale Deep Neural Network Modelscited by 56
- 2018The Challenge of Crafting Intelligible Intelligencecited by 46
- 2020Decisions, Counterfactual Explanations and Strategic Behaviorcited by 44
- 2020How Interpretable and Trustworthy are GAMs?cited by 44
- 2020In Pursuit of Interpretable, Fair and Accurate Machine Learning for Criminal Recidivism Predictioncited by 42
- 2018GAN Lab: Understanding Complex Deep Generative Models using Interactive Visual Experimentationcited by 40
- 2020DECE: Decision Explorer with Counterfactual Explanations for Machine Learning Modelscited by 38
- 2017Rationalization: A Neural Machine Translation Approach to Generating Natural Language Explanationscited by 37
- 2020ViCE: Visual Counterfactual Explanations for Machine Learning Modelscited by 34
- 2021GeCo: Quality Counterfactual Explanations in Real Timecited by 32
- 2017Direct-Manipulation Visualization of Deep Networkscited by 26
- 2022Interpretability, Then What? Editing Machine Learning Models to Reflect Human Knowledge and Valuescited by 25
- 2020Scaling Guarantees for Nearest Counterfactual Explanationscited by 22
- 2022TimberTrek: Exploring and Curating Sparse Decision Trees with Interactive Visualizationcited by 13
- 2015Incentivizing High Quality Crowdworkcited by 12
- 2021AdViCE: Aggregated Visual Counterfactual Explanations for Machine Learning Model Validationcited by 7
- 2020Revealing Neural Network Bias to Non-Experts Through Interactive Counterfactual Examplescited by 4
Built on by
Citing papers per year: 2023: 1; 2024: 4; 2025: 3; 2026: 1.
9 papers.
- 2024MeMemo: On-device Retrieval Augmentation for Private and Personalized Text Generationcited by 12
- 2024Exploiting Preference Elicitation in Interactive and User-centered Algorithmic Recourse: An Initial Explorationcited by 8
- 2023Prediction without Preclusion: Recourse Verification with Reachable Setscited by 4
- 2024AI-Spectra: A Visual Dashboard for Model Multiplicity to Enhance Informed and Transparent Decision-Makingcited by 4
- 2024Reassessing Evaluation Functions in Algorithmic Recourse: An Empirical Study from a Human-Centered Perspectivecited by 3
- 2026From Universal to Individualized Actionability: Revisiting Personalization in Algorithmic Recoursecited by 1
- 2025Evaluating Simplification Algorithms for Interpretability of Time Series Classificationcited by 0
- 2025UGCE: User-Guided Incremental Counterfactual Explorationcited by 0
- 2025Designing User-Centric Metrics for Evaluation of Counterfactual Explanationscited by 0
- 2026From Universal to Individualized Actionability: Revisiting Personalization in Algorithmic Recourse9 Apr 2026
- 2025Designing User-Centric Metrics for Evaluation of Counterfactual Explanations20 Jul 2025
- 2025UGCE: User-Guided Incremental Counterfactual Exploration27 May 2025
- 2025Evaluating Simplification Algorithms for Interpretability of Time Series Classification13 May 2025
- 2024AI-Spectra: A Visual Dashboard for Model Multiplicity to Enhance Informed and Transparent Decision-Making14 Nov 2024
- 2024MeMemo: On-device Retrieval Augmentation for Private and Personalized Text Generation2 Jul 2024
- 2024Reassessing Evaluation Functions in Algorithmic Recourse: An Empirical Study from a Human-Centered Perspective23 May 2024
- 2024Exploiting Preference Elicitation in Interactive and User-centered Algorithmic Recourse: An Initial Exploration8 Apr 2024
- 2023Prediction without Preclusion: Recourse Verification with Reachable Sets24 Aug 2023