Developing Guidelines for Functionally-Grounded Evaluation of Explainable Artificial Intelligence using Tabular Data
Not on the map. Why?
Abstract (arXiv)
Explainable Artificial Intelligence (XAI) techniques are used to provide transparency to complex, opaque predictive models. However, these techniques are often designed for image and text data, and it is unclear how fit-for-purpose they are when applied to tabular data. As XAI techniques are rarely evaluated in settings with tabular data, the applicability of existing evaluation criteria and methods are also unclear and needs (re-)examination. For example, some works suggest that evaluation methods may unduly influence the evaluation results when using tabular data. This lack of clarity on evaluation procedures can lead to reduced transparency and ineffective use of XAI techniques in real world settings. In this study, we examine literature on XAI evaluation to derive guidelines on functionally-grounded assessment of local, post hoc XAI techniques. We identify 20 evaluation criteria and associated evaluation methods, and derive guidelines on when and how each criterion should be evaluated. We also identify key research gaps to be addressed by future work. Our study contributes to the body of knowledge on XAI evaluation through in-depth examination of functionally-grounded XAI evaluation protocols, and has laid the groundwork for future research on XAI evaluation.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 24 of its 86 references that are in the map. First posted on arXiv 30 Sep 2024.
Builds on
24 of 86 references.
References · 24
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,555
- 2017Towards A Rigorous Science of Interpretable Machine Learningcited by 1,416
- 2018A Survey Of Methods For Explaining Black Box Modelscited by 973
- 2021Deep Neural Networks and Tabular Data: A Surveycited by 491
- 2022From Anecdotal Evidence to Quantitative Evaluation Methods: A Systematic Review on Evaluating Explainable AIcited by 302
- 2020One Explanation Does Not Fit All: The Promise of Interactive Explanations for Machine Learning Transparencycited by 64
- 2021Counterfactuals and Causability in Explainable Artificial Intelligence: Theory, Algorithms, and Applicationscited by 59
- 2019ALIME: Autoencoder Based Approach for Local Interpretabilitycited by 41
- 2022The Road to Explainability is Paved with Bias: Measuring the Fairness of Explanationscited by 41
- 2020Model-agnostic Feature Importance and Effects with Dependent Features -- A Conditional Subgroup Approachcited by 37
- 2021Toward Explainable AI for Regression Modelscited by 31
- 2021TS-MULE: Local Interpretable Model-Agnostic Explanations for Time Series Forecast Modelscited by 28
12 more
- 2021To trust or not to trust an explanation: using LEAF to evaluate local linear XAI methodscited by 26
- 2020Post-hoc explanation of black-box classifiers using confident itemsetscited by 21
- 2021Select Wisely and Explain: Active Learning and Probabilistic Local Post-hoc Explainabilitycited by 12
- 2021Conclusive Local Interpretation Rules for Random Forestscited by 9
- 2022s-LIME: Reconciling Locality and Fidelity in Linear Explanationscited by 8
- 2022SLISEMAP: Supervised dimensionality reduction through local explanationscited by 7
- 2022A general-purpose method for applying Explainable AI for Anomaly Detectioncited by 7
- 2020Altruist: Argumentative Explanations through Local Interpretations of Predictive Modelscited by 5
- 2021Coalitional strategies for efficient individual prediction explanationcited by 4
- 2019Local Interpretation Methods to Machine Learning Using the Domain of the Feature Spacecited by 3
- 2022Local Multi-Label Explanations for Random Forestcited by 3
- 2022Using Decision Tree as Local Interpretable Model in Autoencoder-based LIMEcited by 1
Built on by
Citing papers per year: 2025: 2.
2 papers.