Are Good Explainers Secretly Human-in-the-Loop Active Learners?
Not on the map. Why?
Abstract (arXiv)
Explainable AI (XAI) techniques have become popular for multiple use-cases in the past few years. Here we consider its use in studying model predictions to gather additional training data. We argue that this is equivalent to Active Learning, where the query strategy involves a human-in-the-loop. We provide a mathematical approximation for the role of the human, and present a general formalization of the end-to-end workflow. This enables us to rigorously compare this use with standard Active Learning algorithms, while allowing for extensions to the workflow. An added benefit is that their utility can be assessed via simulation instead of conducting expensive user-studies. We also present some initial promising results.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 13 of its 25 references that are in the map. First posted on arXiv 24 Jun 2023.
Builds on
13 of 25 references.
References · 13
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,555
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,070
- 2015Neural Machine Translation of Rare Words with Subword Unitscited by 2,918
- 2019Optuna: A Next-generation Hyperparameter Optimization Frameworkcited by 2,501
- 2017Learning Important Features Through Propagating Activation Differencescited by 1,458
- 2018Universal Sentence Encodercited by 489
- 2019BatchBALD: Efficient and Diverse Batch Acquisition for Deep Bayesian Active Learningcited by 432
- 2018Tune: A Research Platform for Distributed Model Selection and Trainingcited by 395
- 2020Reliable Post hoc Explanations: Modeling Uncertainty in Explainabilitycited by 125
- 2019Diverse mini-batch Active Learningcited by 89
- 2020Interpretation of NLP models through input marginalizationcited by 44
- 2018modAL: A modular active learning framework for Pythoncited by 35
1 more
Built on by
Citing papers per year: 2024: 1.
1 paper.
- 2024On the Fragility of Active Learners for Text Classification23 Mar 2024